Hand Gesture Recognition Systems: A Review of Vision-based and Sensor-based Approaches

Year : 2024 | Volume :01 | Issue : 01 | Page : 15-20
By

    Akash Rahate

  1. Akash Peddewad

  2. Vaibhav Chamvad

  3. Shruti Raykhelkar

  4. A.M. Chadchankar

  1. Student, Department of Computer Engineering, NBN Singhad School of Engineering, Pune, Maharashtra, India
  2. Student, Department of Computer Engineering, NBN Singhad School of Engineering, Pune, Maharashtra, India
  3. Student, Department of Computer Engineering, NBN Singhad School of Engineering, Pune, Maharashtra, India
  4. Student, Department of Computer Engineering, NBN Singhad School of Engineering, Pune, Maharashtra, India
  5. Assistant Professor, Department of Computer Engineering, NBN Singhad School of Engineering, Pune, Maharashtra, India

Abstract

With many real-world uses, such as sign language translation and human-computer interaction, hand gesture detection is a crucial area of study in the science of computer vision. In this study, we propose a Convolutional Neural Network (CNN) model that uses real-time camera images to recognise hand gestures. A collection of hand motion photographs spanning the English alphabet (A-Z) was gathered, and the images were pre-processed to exclude any backdrop and create black and white versions. The CNN model, which was trained using the pre-processed images, produced a 95% accuracy rate on the test dataset. We used Python to develop the model and combined it with an intuitive software interface to predict hand gestures in real time with the system camera. We used Python to develop the model and combined it with an intuitive software interface to predict hand gestures in real time with the system camera. Our system has the potential to be an important resource in several sectors and domains, such as helping those with speech impairments and controlling technological devices. Real-time hand gesture recognition is made reliable and accurate by the suggested model and technology, which may be applied in a variety of contexts.

Keywords: Hand-sign, convolutional neural network, computer vision, image preprocessing

[This article belongs to International Journal of Optical Innovations & Research(ijoir)]

How to cite this article: Akash Rahate, Akash Peddewad, Vaibhav Chamvad, Shruti Raykhelkar, A.M. Chadchankar.Hand Gesture Recognition Systems: A Review of Vision-based and Sensor-based Approaches.International Journal of Optical Innovations & Research.2024; 01(01):15-20.
How to cite this URL: Akash Rahate, Akash Peddewad, Vaibhav Chamvad, Shruti Raykhelkar, A.M. Chadchankar , Hand Gesture Recognition Systems: A Review of Vision-based and Sensor-based Approaches ijoir 2024 {cited 2024 Mar 01};01:15-20. Available from: https://journals.stmjournals.com/ijoir/article=2024/view=133980


References

  1. Sun JH, Ji TT, Zhang SB, Yang JK, Ji GR. Research on the hand gesture recognition based on deep learning. In2018 12th International symposium on antennas, propagation, and EM theory (ISAPE) 2018 Dec 3 (pp. 1–4). IEEE.
  2. Nidhibahen Patel, Dr. Selena (Jing) He. A Survey on Hand Gesture Recognition Techniques, Methods, and Tools. International Journal of Research in Advent Technology, Vol.6, No.6, June 2018. 939–957.
  3. Wang Z, Hou Y, Jiang K, Dou W, Zhang C, Huang Z, Guo Y. Hand gesture recognition based on active ultrasonic sensing of smartphone: a survey. IEEE Access. 2019 Aug 8; 7:111897–922.
  4. Salim S, Jamil MM, Ambar R, Wahab MH. A review on hand gesture and sign language techniques for hearing impaired person. Machine Learning Techniques for Smart City Applications: Trends and Solutions. 2022 Sep 20:35–44.
  5. Mohamed, M. B. Mustafa, and N. Jomhari, “A Review of the Hand Gesture Recognition System: Current Progress and Future Directions,” in IEEE Access, vol. 9, pp. 157422–157436, 2021, doi: 10.1109/ACCESS.2021.3129650.
  6. Rautaray and A. Agrawal, “Vision Based Hand Gesture Recognition for Human-Computer Interaction: A Survey,” Artificial Intelligence Review, vol. 43, pp. 1–54, 2015.
  7. Zulpukharkyzy Zholshiyeva L, Kokenovna Zhukabayeva T, Turaev S, Aimambetovna Berdiyeva M, Tokhtasynovna Jambulova D. Hand gesture recognition methods and applications: A literature survey. InThe 7th International Conference on Engineering & MIS 2021 2021 Oct 11 (pp. 1–8).
  8. Pisharady PK, Saerbeck M. Recent methods and databases in vision-based hand gesture recognition: A review. Computer Vision and Image Understanding. 2015 Dec 1; 141:152–165.
  9. Halarnkar P, Shah S, Shah H, Shah H, Shah J. Gesture recognition technology: a review. International Journal of Engineering Science and Technology. 2012 Nov;4(11):4648–54.
  10. Xia Z, Lei Q, Yang Y, Zhang H, He Y, Wang W, Huang M. Vision-based hand gesture recognition for human-robot collaboration: a survey. In2019 5th International Conference on Control, Automation and Robotics (ICCAR) 2019 Apr 19 (pp. 198–205). IEEE.
  11. Qi J, Ma L, Cui Z, Yu Y. Computer vision-based hand gesture recognition for human-robot interaction: a review. Complex & Intelligent Systems. 2023 Jul 19:1–26.
  12. Chanu OR, Pillai A, Sinha S, Das P. Comparative study for vision based and data-based hand gesture recognition technique. In2017 International Conference on Intelligent Communication and Computational Techniques (ICCT) 2017 Dec 22 (pp. 26–31). IEEE.
  13. Hasan HS, Kareem SA. Human computer interaction for vision-based hand gesture recognition: a survey. In2012 International Conference on Advanced Computer Science Applications and Technologies (ACSAT) 2012 Nov 26 (pp. 55–60). IEEE.
  14. Kakkoth SS, Gharge S. Survey on real time hand gesture recognition. In2017 International Conference on Current Trends in Computer, Electrical, Electronics and Communication (CTCEEC) 2017 Sep 8 (pp. 948–954). IEEE.
  15. Tripathi R, Verma B. Survey on vision-based dynamic hand gesture recognition. The Visual Computer. 2023 Dec 9:1–29.
Regular Issue Subscription Review Article
Volume 01
Issue 01
Received October 18, 2023
Accepted November 14, 2023
Published March 1, 2024
Views: 50