Implementation of Human Gesture Recognition Using CNN

Year : 2024 | Volume :15 | Issue : 02 | Page : 24-37
By

A. A. Hakim,

A. D. Harale,

A. O. Mulani,

K. J. Karande,

  1. PG Student, SKN Sinhgad College of Engineering, Korti, Pandharpur,, Maharashtra, India
  2. Assistant Professor, SKN Sinhgad College of Engineering, Korti, Pandharpur,, Maharashtra, India
  3. Professor, SKN Sinhgad College of Engineering, Korti, Pandharpur,, Maharashtra, India
  4. Principal, SKN Sinhgad College of Engineering, Korti, Pandharpur,, Maharashtra, India

Abstract

A gesture popularity system based entirely on convolutional neural networks (CNNs). Preprocessing techniques include segmentation, polygonal approximation, contour construction, morphological filters, and resource characteristic extraction. Various convolutional neural networks are employed for training and testing, with results compared to existing architectures and protocols. All generated measurements and convergence graphs produced at any point during education are examined and contested in order to verify the reliability of the approach offered. Our project was created to record hand gestures as we entered and predict textual signal languages. It makes use of the Raspberry Pi module, which is among the best for editing photos and filming videos.

Keywords: Raspberry Pi, Hand Gesture, Feature Extraction, Python, Open CV

[This article belongs to Journal of Control & Instrumentation(joci)]

How to cite this article: A. A. Hakim, A. D. Harale, A. O. Mulani, K. J. Karande. Implementation of Human Gesture Recognition Using CNN. Journal of Control & Instrumentation. 2024; 15(02):24-37.
How to cite this URL: A. A. Hakim, A. D. Harale, A. O. Mulani, K. J. Karande. Implementation of Human Gesture Recognition Using CNN. Journal of Control & Instrumentation. 2024; 15(02):24-37. Available from: https://journals.stmjournals.com/joci/article=2024/view=161768



References

  1. Lakshmi, M. Sri Lakshmi andPrem Kumar Singuluri, “Real-Time Hand Gesture Recognition for Improved Communication with Deaf and Hard of Hearing Individuals”,International Journal of Intelligent systems and applications in engineering, May 2023
  2. Oinam Robita Chanu, Anushree Pillai, Spandan Sinha and Piyanka Das, “Comparative Study for Vision Based and Data Based Hand Gesture Recognition Technique”,2017 International Conference on Intelligent Communication and Computational Techniques (ICCT), Manipal University Jaipur, 2017
  3. Datta, Pushan Kumar; Biswas, Abhishek; Ghosh, Ahona and Chaudhury Nilanjana ,”Creation of Image Segmentation Classifiers for Sign Language Processing for Deaf and Dumb”, 8th International Conference on Reliability, Infocom Technologies and Optimization (Trends and Future Directions) (ICRITO) doi:10.1109/ICRITO48877.2020.9197978
  4. Bhujbal, Mr. Vishal and Warhade, K.K.,”Hand Sign Recognition Based Communication System for Speech Disable People”,IEEE 2018 Second International Conference on Intelligent Computing and Control Systems (ICICCS) – Madurai, India
  5. Mahmood, Mayyadah Ramiz and Abdulazeez, Adnan Mohsin, “Different Model for Hand Gesture Recognition with a Novel Line Feature Extraction”,2019 International Conference on Advanced Science and Engineering (ICOASE). doi:10.1109/ICOASE.2019.8723731
  6. Soeb Hussain, Rupal Saxena, Xie Han, Jameel Ahmed Khan and Prof. Hyunchul Shin, “Hand Gesture Recognition Using Deep Learning”, 978-1-5386-2285-8/17/$31.00 ©2017 IEEE
  7. Alnaim, Norah; Abbod, Maysam; Albar, and Abdulrahman. “Hand Gesture Recognition Using Convolutional Neural Network for People Who Have Experienced A Stroke.”,. 3rd International Symposium on Multidisciplinary Studies and Innovative Technologies (ISMSIT) – doi:10.1109/ISMSIT.2019.8932739 (2019)
  8. Varga, S. M. Matheson and A. Hamilton-Wright, “Aggregate Features in Multisample Classification Problems,” in IEEE Journal of Biomedical and Health Informatics, vol. 19, no. 2, pp. 486-492, March 2015, doi: 10.1109/JBHI.2014.
  9. Dawod, Ahmad Yahya and Chakpitak, Nopasit,”Novel Technique for Isolated Sign Language Based on Fingerspelling Recognition”,[IEEE 2019 13th International Conference on Software, Knowledge, Information Management and Applications (SKIMA) – Island of Ulkulhas, Maldives (2019.8.26-2019.8.28)] 2019 13th International Conference on Software, Knowledge, Information Management and Applications (SKIMA) -. , (), 1–8. doi:10.1109/SKIMA47702.2019.8982452
  10. Ponraj, Godwin and Ren, Hongliang, “Sensor Fusion Of Leap Motion Controller And Flex Sensors Using Kalman Filter For Human Finger Tracking”. IEEE Sensors Journal, (), 1–1. doi:10.1109/JSEN.2018.2790801
  11. Zhang, Xiaoliang; Yang, Ziqi; Chen, Taiyu; Chen, Diliang; Huang and Ming-Chun. “Cooperative Sensing and Wearable Computing for Sequential Hand Gesture Recognition”, IEEE Sensors Journal, (), 1–1. doi:10.1109/JSEN.2019.2904595
  12. Kapidis, Georgios; Poppe, Ronald; Van Dam, Elsbeth; Noldus, Lucas and Veltkamp, Remco,”Egocentric Hand Track and Object-Based Human Action Recognition”[IEEE 2019 IEEE SmartWorld, Ubiquitous Intelligence & Computing, Advanced & Trusted Computing, Scalable Computing & Communications, Cloud & Big Data Computing, Internet of People and Smart City Innovation (SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI) – Leicester, United Kingdom (2019.8.19-2019.8.23)]
  13. G. Lee and S. M. Lee, “Smart Wearable Hand Device for Sign Language Interpretation System with Sensors Fusion“, 1558-1748 (c) 2017 IEEE
  14. Jian Wu and Lu Sun, “A Wearable System for Recognizing American Sign Language in Real-time Using IMU and Surface EMG Sensors “August 2016 DOI:1109/JBHI.2016.2598302
  15. Siddharth S. Rautaray and Anupam Agrawal, “Real TIME HAND GESTURE RECOGNITION SYSTEM FOR DYNAMIC APPLICATIONS”, International Journal of UbiComp (IJU), vol.3, No.1, January 2012.
  16. Shital M. Chavan1 and Smitha Raveendran,”Hand Gesture Movement Tracking System for Human Computer Interaction “,International Research Journal of Engineering and Technology (IRJET) e-ISSN: 2395 -0056 Volume: 02 Issue: 08 | Nov-2015 p-ISSN: 2395-0072 © 2015, IRJET ISO 9001:2008 Certified Journal Page 1536
  • DEVICE”,February 2013DOI:1109/ICICES.2013.6508395Conference: Information Communication and Embedded Systems (ICICES), 2013.

 


Regular Issue Subscription Original Research
Volume 15
Issue 02
Received June 6, 2024
Accepted June 11, 2024
Published August 8, 2024

Check Our other Platform for Workshops in the field of AI, Biotechnology & Nanotechnology.
Check Out Platform for Webinars in the field of AI, Biotech. & Nanotech.