Sasikumar M.
Lekha Achuth
- Student, Department of Computer Applications, People’s Education Society University, Bengaluru, Karnataka, India
- Associate Professor, Department of Computer Applications, People’s Education Society University, Bengaluru, Karnataka, India
Abstract
There are around 63 million people in India with speech and hearing disabilities, and the number goes all the way up to 300 million across the world. All of them face issues in their day-to-day life as they can only have conversations with gestures. American Sign Language (ASL) mobile translator with convolutional neural network (CNN) algorithm is an easy-to-use mobile application, which uses complex images and video recognizing models built with an open-source tool called OpenCV. It efficiently recognizes gestures being shown to the camera and translates it to voice message, which can be understood by a normal person. Being a mobile application, it is portable and can be carried anywhere.
Keywords: American Sign Language, convolutional neural networks, image classification, machine learning, object detection
[This article belongs to International Journal of Algorithms Design and Analysis Review(ijadar)]
Browse Figures
References
He K, Zhang X, Ren S, Sun J. Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA, June 27–30, 2016. pp. 770–
Jenkins J, Rashad S. An innovative method for automatic American Sign Language interpretation using machine learning and Leap motion controller. In: IEEE 12th Annual Ubiquitous Computing, Electronics & Mobile Communication Conference (UEMCON), New York, NY, USA, December 1–4, 2021. pp. 633– doi: 10.1109/UEMCON53757.2021.9666640.
Boulares M, Jemni M. Mobile sign language translation system for deaf community. In: W4A 2012 – International Cross-Disciplinary Conference on Web Accessibility, Lyon, France, April 16–17, 2012. Article 37, pp. 1–4. doi: 10.1145/2207016.2207049.
Bird JJ, Ekárt A, Faria DR. British Sign Language recognition via late fusion of computer vision and Leap motion with transfer learning to American Sign Language. Sensors (Basel, Switzerland). 2020; 20: 5151. doi: 10.3390/s20185151.
Murthy GR, Jadon RS. A review of vision based hand gestures recognition. Int J Inform Technol Knowledge Manage. 2009; 2 (2): 405–410.
Tawalare S, Karale N, Pande S, Khamparia A. Identification of characters (digits) through customized convolutional neural network. Lecture Notes Data Eng Commun Technol. 2022; 122: 38– doi: 10.1007/978-981-16-6285-0_38.
Srivastava S, Gangwar A, Mishra R, Singh S. Sign language recognition system using TensorFlow Object Detection API. In: Woungang I, Dhurandher SK, Pattanaik KK, Verma A, Verma P, editors. Advanced Network Technologies and Intelligent Computing. Volume 1. Berlin, Germany: Springer; 2022. pp. Volume 1, pp. 634–646. doi: 10.1007/978-3-030-96040-7_48.
Johnny S, Nirmala SJ. Sign language translator using machine learning. SN Computer Sci. 2022; 3: 1–6.
Al-Saffar AAM, Tao H, Talab MA. Review of deep convolution neural network in image classification. In: International Conference on Radar, Antenna, Microwave, Electronics, and Telecommunications, (ICRAMET), Jakarta, Indonesia, October 23–24, 2017. pp. 1–6. doi: 10.1109/ICRAMET.2017.8253139.
Szegedy S, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A. Going deeper with convolutions. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA, June 7–12, 2015. pp. 1–9. doi: 10.1109/CVPR.2015.7298594.
Goyal S, Sharma I, Sharma S. Sign language recognition system for deaf and dumb people. Int J Eng Res Technol. 2013; 2 (4): 382–387.
Krizhevsky A, Sutskever I, Hinton GE. ImageNet classification with deep convolutional neural networks. Commun ACM. 2017; 60 (6): 84–90. doi: 10.1145/3065386.
| Volume | 01 |
| Issue | 02 |
| Received | October 27, 2023 |
| Accepted | November 2, 2023 |
| Published | December 5, 2023 |