Hand Gesture Control Robotic Arm using OpenCV and NodeMCU

Year : 2024 | Volume :11 | Issue : 01 | Page : –
By

Vaibhav Vaijnath Sakhare

Rohit Ingale

Atharv Mehetre

Jai Desai

  1. Student Department of Electronics and Telecommunication Engineering,Sinhgad College of Engineering, Savitribai Phule Pune University Maharashtra India
  2. Student Department of Electronics and Telecommunication Engineering,Sinhgad College of Engineering, Savitribai Phule Pune University Maharashtra India
  3. Student Department of Electronics and Telecommunication Engineering,Sinhgad College of Engineering, Savitribai Phule Pune University Maharashtra India
  4. Professor Department of Electronics and Telecommunication Engineering,Sinhgad College of Engineering, Savitribai Phule Pune University Maharashtra India

Abstract

In this research paper, an innovative method is proposed for controlling a robotic arm through the use of hand gestures, utilizing the advanced features of Node MCU and OpenCV. By bringing together these cutting-edge technologies, the system enables seamless real-time communication and image processing between the user and the robotic arm. The process involves capturing hand gestures through a camera and using the powerful OpenCV library to identify and interpret them. This translation of gestures into corresponding commands allows for intuitive and precise manipulation of the robotic arm. To enable wireless control and communication, the system utilizes the Node MCU microcontroller. Through experimental analysis, the effectiveness and accuracy of this hand gesture control approach are demonstrated.

Keywords: Hand Gesture Recognition, Robotic Arm, Node MCU, OpenCV, Image Processing, Human- Machine Interaction.

[This article belongs to Journal of Semiconductor Devices and Circuits(josdc)]

How to cite this article: Vaibhav Vaijnath Sakhare, Rohit Ingale, Atharv Mehetre, Jai Desai. Hand Gesture Control Robotic Arm using OpenCV and NodeMCU. Journal of Semiconductor Devices and Circuits. 2024; 11(01):-.
How to cite this URL: Vaibhav Vaijnath Sakhare, Rohit Ingale, Atharv Mehetre, Jai Desai. Hand Gesture Control Robotic Arm using OpenCV and NodeMCU. Journal of Semiconductor Devices and Circuits. 2024; 11(01):-. Available from: https://journals.stmjournals.com/josdc/article=2024/view=151147

Browse Figures

References

  • Abhishek, S, K., Qubeley, Fai, L. C., Ho, & Derek. (2016). Glove-based hand gesture recognition sign language translator using capacitive touch sensor. In 2016 IEEE International Conference on Electron Devices and Solid-State Circuits (EDSSC) (pp. 334- 337): IEEE.
  • Ahuja, M. K., & Singh, A. (2015). Static vision based Hand Gesture recognition using principal component analysis. Paper presented at the 2015 IEEE 3rd International Conference on MOOCs, Innovation and Technology in Education (MITE).
  • Bretzner, , Laptev, I., & Lindeberg, T. (2002). Hand gesture recognition using multi-scale colour features, hierarchical models and particle filtering. Paper presented at the Proceedings of fifth IEEE international conference on automatic face gesturerecognition.
  • Chen, -S., Fu, C.-M., & Huang, C.-L. (2003). Hand gesture recognition using a real-time tracking method and hidden Markov models. Image and vision computing, 21(8), 745-758.
  • Dipietro, L., Sabatini, A. M., & Dario, P. (2008). A Survey of Glove-Based Systems and Their Applications. Ieee transactions on systems, man, and cybernetics, part c (applications and reviews), 38(4), 461- 482.
  • -C. Chang, I.-Y Chen, and Y.-S. Huang, “Hand Pose Recognition Using Curvature Scale Space”, IEEE International Conference on Pattern Recognition, 2002.
  • Abhijit Nale, Ankush Barkade, Pravin Ekhande, and Shreyas Dayal, “Hand Gesture Recognition for Robotic Car Control”, IJARCST, Vol. 3, Issue 1 (2015).
  • Sanwar S, Ahmed MI. Automated Object Sorting System with Real-Time Image Processing and Robotic Gripper Mechanism Control. Journal of Engineering Advancements. 2023 Sep 4;4(03):70-9.
  • Mahajan V, Kawale S, Koshti S, Kshirsagar V. REVIEW PAPER ON GESTURE CONTROLLED ROBOT WITH ROBOTIC ARM.
  • Shaikh MA, Dhavalikar M. Design and Development of Prototype for Advanced Industrial Manipulator. International Journal of COMADEM. 2022 Oct 1;25(4).
  • Malik MJ, Aditya M, Varma DR, Sidhartha G, Sohan P, Rao SG, Adnan MM. Specific Object Picking Robotic Arm Using Haar Cascades. InE3S Web of Conferences 2024 (Vol. 529, p. 04008). EDP Sciences.
  • Lim YS. Application of intelligent gesture control to simultaneously control multiple remote devices (Doctoral dissertation, UTAR).
  • Paterson J, Aldabbagh A. Gesture-controlled robotic arm utilizing opencv. In2021 3rd International Congress on Human-Computer Interaction, Optimization and Robotic Applications (HORA) 2021 Jun 11 (pp. 1-6). IEEE.
  • Budhiraja A. Gesture Controlled Robotic Arm for Social Distancing. Gesture. 2023 May;2023.
  • Dasgupta S, Ghosh A. Bluetooth Controlled Arduino Based Robotic Arm. Asian Journal For Convergence In Technology (AJCT) ISSN-2350-1146. 2021 Apr 5;7(1):115-20.
  • Gawli K, Karande P, Belose P, Bhadirke T, Bhargava A. Internet of things (IoT) based robotic arm. Int. Res. J. Eng. Technol. 2017;4(03).
Regular Issue Subscription Review Article
Volume 11
Issue 01
Received May 21, 2024
Accepted May 30, 2024
Published June 8, 2024
Views: 17