DOCSNAP: Integrating NLP and Computer Vision for Comprehensive Document Summarization

[{“box”:0,”content”:”[if 992 equals=”Open Access”]n

n

n

n

Open Access

nn

n

n[/if 992]n

n

Year : August 20, 2024 at 1:43 pm | [if 1553 equals=””] Volume : [else] Volume :[/if 1553] | [if 424 equals=”Regular Issue”]Issue[/if 424][if 424 equals=”Special Issue”]Special Issue[/if 424] [if 424 equals=”Conference”][/if 424] : | Page : –

n

n

n

n

n

n

By

n

[foreach 286]n

vector

n

n

Mohammed Hafeez M K, Ayishathul Misriya K S, Fathima Haifa, Fathimath Zaziba, Khatheejathul Aifa,

n

    n t

  • n

n

n[/foreach]

n

n[if 2099 not_equal=”Yes”]n

    [foreach 286] [if 1175 not_equal=””]n t

  1. Professor, Student, Student, Student, Student Department of Computer Science and Engineering, P A College of Engineering, Mangalore, Department of Computer Science and Engineering, P A College of Engineering, Mangalore, Department of Computer Science and Engineering, P A College of Engineering, Mangalore, Department of Computer Science and Engineering, P A College of Engineering, Mangalore, Department of Computer Science and Engineering, P A College of Engineering, Mangalore Karnataka, Karnataka, Karnataka, Karnataka, Karnataka India, India, India, India, India
  2. n[/if 1175][/foreach]

n[/if 2099][if 2099 equals=”Yes”][/if 2099]n

n

Abstract

nBecause of the exponential growth of digital content, sophisticated tools are required for effective data interpretation and administration.. This project harnesses the capabilities of the Gemini AI model developed by Google DeepMind to address the challenges of PDF summarization and image captioning. Gemini AI integrates cutting-edge algorithms, including transformer architectures, to process textual and visual data seamlessly. The project’s system architecture involves modules for text and image extraction, with a Frontend Interface and Backend Server for efficient processing. Results indicate its effectiveness in enhancing content understanding and retrieval.

n

n

n

Keywords: PDF, image captioning, google deep mind, docsnap, gemini AI model.

n[if 424 equals=”Regular Issue”][This article belongs to Journal of Instrumentation Technology & Innovations(joiti)]

n

[/if 424][if 424 equals=”Special Issue”][This article belongs to Special Issue under section in Journal of Instrumentation Technology & Innovations(joiti)][/if 424][if 424 equals=”Conference”]This article belongs to Conference [/if 424]

n

n

n

How to cite this article: Mohammed Hafeez M K, Ayishathul Misriya K S, Fathima Haifa, Fathimath Zaziba, Khatheejathul Aifa. DOCSNAP: Integrating NLP and Computer Vision for Comprehensive Document Summarization. Journal of Instrumentation Technology & Innovations. July 16, 2024; ():-.

n

How to cite this URL: Mohammed Hafeez M K, Ayishathul Misriya K S, Fathima Haifa, Fathimath Zaziba, Khatheejathul Aifa. DOCSNAP: Integrating NLP and Computer Vision for Comprehensive Document Summarization. Journal of Instrumentation Technology & Innovations. July 16, 2024; ():-. Available from: https://journals.stmjournals.com/joiti/article=July 16, 2024/view=0

nn[if 992 equals=”Open Access”] Full Text PDF Download[/if 992] n

n[if 992 not_equal=’Open Access’] [/if 992]n

nn

nn[if 379 not_equal=””]n

Browse Figures

n

n

[foreach 379]n

n[/foreach]n

n

n

n[/if 379]n

n

References

n[if 1104 equals=””]n

  • Mahalakshmi, , & Fatima, N. S. (2022). “Summarization of text and image captioning in information retrieval using deep learning techniques”. IEEE Access, 10, 18289- 18297.
  • Ghandi, Taraneh, Hamidreza Pourreza, and Hamidreza Mahyar. “Deep learning approaches on image captioning: A review.” ACM Computing Surveys 56.3 (2023): 1-39.
  • Inayathulla, Mohammed. “Image Caption Generation using Deep Learning For Video Summarization Applications.” International Journal of Advanced Computer Science & Applications 15.1 (2024).
  • Xu, M., Rahman, H. A., & Li, F. (2023). Automated Generation of Chinese Text-Image Summaries Using Deep Learning Techniques. Traitement du Signal, 40(6).
  • Gangathimmappa, M., Subramani, N., Sambath, V., Ramanujam, R. A. M., Sammeta, N., & Marimuthu, M. (2023). Deep learning enabled cross‐lingual search with metaheuristic web based query optimization model for multi‐document summarization. Concurrency and Computation: Practice and Experience, 35(2), e7476.
  • Honda, Ukyo, Taro Watanabe, and Yuji Matsumoto. “Switching to discriminative image captioning by relieving a bottleneck of reinforcement learning.” In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, pp. 1124-1134. 2023.
  • Wei, Haiyang, et al. “The synergy of double attention: Combine sentence-level and word-level attention for image captioning.” Computer Vision and Image Understanding 201 (2020): 103068.
  • Huang, Chieh-Yang, et al. “Summaries as captions: Generating figure captions for scientific documents with automated text summarization.” arXiv preprint arXiv:2302.12324 (2023).
  • Li, Jiesi, et al. “Image Captioning with multi-level similarity-guided semantic ” Visual Informatics 5.4 (2021): 41-48.
  • Li, Guodun, et “Similar scenes arouse similar emotions: Parallel data augmentation for stylized image captioning.” Proceedings of the 29th ACM International Conference on Multimedia. 2021.
  • Sakkaravarthy Iyyappan, K., and S. Balasundaram. “A novel multi document summarization with document- elements augmentation for learning materials using concept based ILP and clustering methods.” International Journal of Computers and Applications 46.2 (2024): 78-89.

nn[/if 1104][if 1104 not_equal=””]n

    [foreach 1102]n t

  1. [if 1106 equals=””], [/if 1106][if 1106 not_equal=””],[/if 1106]
  2. n[/foreach]

n[/if 1104]

nn


nn[if 1114 equals=”Yes”]n

n[/if 1114]

n

n

[if 424 not_equal=””][else]Ahead of Print[/if 424] Subscription Original Research

n

n

[if 2146 equals=”Yes”][/if 2146][if 2146 not_equal=”Yes”][/if 2146]n

n

n

n

n

n

n

n

n

n

n

n

n

n

n

n

n

n

n

n

n[if 1748 not_equal=””]

[else]

[/if 1748]n

n

n

Volume
[if 424 equals=”Regular Issue”]Issue[/if 424][if 424 equals=”Special Issue”]Special Issue[/if 424] [if 424 equals=”Conference”][/if 424]
Received June 28, 2024
Accepted July 2, 2024
Published July 16, 2024

n

n

n

n

n

n nfunction myFunction2() {nvar x = document.getElementById(“browsefigure”);nif (x.style.display === “block”) {nx.style.display = “none”;n}nelse { x.style.display = “Block”; }n}ndocument.querySelector(“.prevBtn”).addEventListener(“click”, () => {nchangeSlides(-1);n});ndocument.querySelector(“.nextBtn”).addEventListener(“click”, () => {nchangeSlides(1);n});nvar slideIndex = 1;nshowSlides(slideIndex);nfunction changeSlides(n) {nshowSlides((slideIndex += n));n}nfunction currentSlide(n) {nshowSlides((slideIndex = n));n}nfunction showSlides(n) {nvar i;nvar slides = document.getElementsByClassName(“Slide”);nvar dots = document.getElementsByClassName(“Navdot”);nif (n > slides.length) { slideIndex = 1; }nif (n (item.style.display = “none”));nArray.from(dots).forEach(nitem => (item.className = item.className.replace(” selected”, “”))n);nslides[slideIndex – 1].style.display = “block”;ndots[slideIndex – 1].className += ” selected”;n}n”}]