A Study of ROI Based Sign Language to Text Translation in Real Time Using Deep Learning

Year : 2024 | Volume :01 | Issue : 01 | Page : 8-14
By

    Soujanya S.

  1. Ruhaima

  2. Rajashree Nambiar

  3. Sakshi

  4. Shanthika

  1. Assistant Professor, Department of electronics and communication engineering, Shri Madhwa Vadiraja Institute of Technology and Management, Bantakal, Udupi, Karnataka, India
  2. Student, Department of electronics and communication engineering, Shri Madhwa Vadiraja Institute of Technology and Management, Bantakal, Udupi, Karnataka, India
  3. Assistant Professor, Department of Robotics and AI, NMAM Institute of Technology, Nitte, Karnataka, India
  4. Student, Department of electronics and communication engineering, Shri Madhwa Vadiraja Institute of Technology and Management, Bantakal, Udupi, Karnataka, India
  5. Student, Department of electronics and communication engineering, Shri Madhwa Vadiraja Institute of Technology and Management, Bantakal, Udupi, Karnataka, India

Abstract

Since sign language is their primary form of communication, it plays a significant role in the lives of hearing and speech disabled people. However, since not everyone is conversant in sign language, it is challenging for the disabled to interact with others daily. Sign language is made up of a variety of hand gestures that may stand in for a wide range of words and sentiments. The purpose of this study is to develop a trustworthy communication interpretation. Using image processing and Machine learning, this paper translates Indian Sign Language into legible output. So, we convert the sign languages into letters and then to words and to sentences which can be understood easily by the people who do not understand sign languages. So, this translation may be used for everyday communication and can be used to teach different gestures to autonomous systems that use gestures as input.

Keywords: Gesture recognition, hand gesture scan, sign language, a KINECT sensor, MATLAB

[This article belongs to International Journal of Optical Innovations & Research(ijoir)]

How to cite this article: Soujanya S., Ruhaima, Rajashree Nambiar, Sakshi, Shanthika.A Study of ROI Based Sign Language to Text Translation in Real Time Using Deep Learning.International Journal of Optical Innovations & Research.2024; 01(01):8-14.
How to cite this URL: Soujanya S., Ruhaima, Rajashree Nambiar, Sakshi, Shanthika , A Study of ROI Based Sign Language to Text Translation in Real Time Using Deep Learning ijoir 2024 {cited 2024 Jan 09};01:8-14. Available from: https://journals.stmjournals.com/ijoir/article=2024/view=130973


Browse Figures

References

Viswanathan, Shreyas, et al. “Sign Language To Text And Speech Conversion Using Cnn”, volume-03, issue-05, May-2021, IRJMETS.
Deepika Bansal and Rita Chhikara, “An Improved DCT based Steganography Technique”, International Journal of Computer Applications (0975– 8887), Volume 102– No.14, September
Adewale, Victoria A., and Adejoke O. Olamiti. “conversion of sign language to text and speech using machine learning ” (2018), Journal of research and review in science, Volume-5, December-2018, page-58-65.
NB, Mahesh “Conversion of sign language into text.” International Journal of Applied Engineering Research, Volume-13, issue-9, 2018, p-7154-7161, https://www.ripublication.com/ijaer18/ijaerv13n9_90.pdf.
Lahoti, Sakshi, et “Android based american sign language recognition system with skin segmentation and SVM.” 2018 9th International Conference on Computing, Communication and Networking Technologies (ICCCNT), 10-12th July,2018, Bengaluru, IEEE Xplore, https://ieeexplore.ieee.org/document/8493838.
Vedak, Omkar, et “Sign language interpreter using image processing and machine learning.” International Research Journal of Engineering and Technology (IRJET) (2019), Volume-6, issue-4, April-2019.
Tolentino, Lean Karlo , et al. “Static sign language recognition using deep learning.” Int. J. Mach. Learn. Comput Volume-9, issue-6, December (2019): 821-827.
Sruthi, J., and A. Lijiya. “Signet: A deep learning based Indian sign language recognition system.” 2019 International conference on communication and signal processing (ICCSP). IEEE, 04-06 April,2019, Chennai, India, https://ieeexplore.ieee.org/abstract/document/8698006.
Kunjumon, Jinsu, and Rajesh Kannan Megalingam. “Hand gesture recognition system for translating indian sign language into text and ” 2019 International Conference on Smart Systems and Inventive Technology (ICSSIT). IEEE, 27-29 November, Tirunelveli, India, 2019, https://ieeexplore.ieee.org/document/8987762.
Liao, Yanqiu, et al. “Dynamic sign language recognition based on video sequence with BLSTM-3D residual networks.” IEEE Access, Volume-7, (2019), p-38044-38054, https://ieeexplore.ieee.org/document/8667292.
Tiku, Kohsheen, et al. “Real-time conversion of sign language to text and ” 2020 Second International Conference on Inventive Research in Computing Applications (ICIRCA). IEEE, 15-17th July, Coimbatore 2020, https://ieeexplore.ieee.org/document/9182877.
Wu, Ronghui, et “Full-fiber auxetic-interlaced yarn sensor for sign-language translation glove assisted by artificial neural network.”Nano-micro letters 14.1 (2022), Springer, 1- 14, file:///C:/Users/PC53/Downloads/s40820-022-00887-5.pdf
Kirpan, Priyanka, et “Wearable Glove that Translate Sign Language into Text and Speech.”, Volume-11, Issue-4, April-2022, Impact Factor-8.118, IJIRSET, P-3571-3575, file:///C:/Users/PC53/Downloads/70_WGSL_NC.pdf.

Regular Issue Subscription Review Article
Volume 01
Issue 01
Received July 28, 2023
Accepted August 11, 2023
Published January 9, 2024
Views: 64