IoT-Enabled and Hand Gesture Controlled Robotic Arm Using Blynk IoT and OpenCV

Year : 2025 | Volume : 15 | Issue : 02 | Page : 36-46
    By

    Bhaven Bankar Bankar.,

  • Ruchira Pagar,

  • Yogesh Bhangale,

  • T.V. Kafare,

  1. Student, Department of Electronics and Telecommunication Engineering, Sinhgad College of Engineering, Vadgaon (BK), Pune, Maharashtra, India
  2. Student, Department of Electronics and Telecommunication Engineering, Sinhgad College of Engineering, Vadgaon (BK), Pune, Maharashtra, India
  3. Student, Department of Electronics and Telecommunication Engineering, Sinhgad College of Engineering, Vadgaon (BK), Pune, Maharashtra, India
  4. Assistant Professor, Department of Electronics and Telecommunication Engineering, Sinhgad College of Engineering, Vadgaon (BK), Pune, Maharashtra, India

Abstract

document.addEventListener(‘DOMContentLoaded’,function(){frmFrontForm.scrollToID(‘frm_container_abs_193457’);});Edit Abstract & Keyword

Robotic arms have become vital in environments that necessitate control, stability, and remote operation. This study presents a low-cost, multifunctional robotic arm that operates in four distinct modes: gesture control using OpenCV, IoT-based control via the Blynk platform and ESP32, joystick- based manual control, and an automatic mode driven by coordinates stored on an SD card. The system integrates multiple control mechanisms through the ESP32 microcontroller and utilizes servo motors for precise actuation. Mode switching is enabled via push buttons, while MQTT protocol ensures reliable and responsive communication across components. This modular and adaptable design makes the system suitable for industrial, assistive applications. It also supports remote-controlled operations, making it suitable for simple remote pick-and-place tasks where high precision is not required.

Keywords: ESP32, Blynk IoT, robotic arm, MQTT, Servo motor, joystick, coordinates, gesture

[This article belongs to Journal of Aerospace Engineering & Technology ]

How to cite this article:
Bhaven Bankar Bankar., Ruchira Pagar, Yogesh Bhangale, T.V. Kafare. IoT-Enabled and Hand Gesture Controlled Robotic Arm Using Blynk IoT and OpenCV. Journal of Aerospace Engineering & Technology. 2025; 15(02):36-46.
How to cite this URL:
Bhaven Bankar Bankar., Ruchira Pagar, Yogesh Bhangale, T.V. Kafare. IoT-Enabled and Hand Gesture Controlled Robotic Arm Using Blynk IoT and OpenCV. Journal of Aerospace Engineering & Technology. 2025; 15(02):36-46. Available from: https://journals.stmjournals.com/joaet/article=2025/view=0


document.addEventListener(‘DOMContentLoaded’,function(){frmFrontForm.scrollToID(‘frm_container_ref_193457’);});Edit

References

1. Sihombing P, Muhammad RB, Herriyance H, Elviwani E. Robotic arm controlling based on fingers and hand gesture. In 2020 IEEE 3rd International Conference on Mechanical, Electronics, Computer, and Industrial Technology (MECnIT). 2020 Jun 25; 40–45.
2. Saleheen MM, Fahad MR, Khan R. Gesture-controlled robotic arm. In 2023 IEEE International Conference on Computer Science, Information Technology and Engineering (ICCoSITE). 2023Feb 16; 495–499.
3. Paterson J, Aldabbagh A. Gesture-controlled robotic arm utilizing opencv. In 2021 IEEE 3rd International Congress on Human-Computer Interaction, Optimization and Robotic Applications (HORA). 2021 Jun 11; 1–6.
4. Singh G, Singh AK, Yadav A, Bhardwaj I, Chauhan U. IoT developed Wi-Fi controlled rover with robotic arm using NodeMCU. In 2020 IEEE 2nd International Conference on Advances in Computing, Communication Control and Networking (ICACCCN). 2020 Dec 18; 497–501.
5. Janagiraman S, Mithun P, Hemashri S, Susan MB. Gestures to Movements Crafting A Robotic Arm With OPENCV. In 2024 IEEE International Conference on Emerging Research in Computational Science (ICERCS). 2024 Dec 12; 1–6.

6. Alshdadi AA. Evaluation of IoT-based smart home assistance for elderly people using robot. Electronics. 2023 Jun 11; 12(12): 2627.
7. Chai X, Li G, Lin Y, Xu Z, Tang Y, Chen X, Zhou M. Sign language recognition and translation with kinect. In IEEE Conf on AFGR. 2013 Apr 22; 655: 4.
8. Lu S, Metaxas D, Samaras D, Oliensis J. Using multiple cues for hand tracking and model refinement. In 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003 Proceedings. 2003 Jun 18; 2: II–443.
9. Ahmed S, Alam R, Hossain MR, Islam MM, Hossain MI, Tabassum T. An IoT based Smart Robot that Aids in the Prevention of COVID19 Spread. In 2022 IEEE 4th International Conference on Sustainable Technologies for Industry 4.0 (STI). 2022 Dec 17; 1–6.
10. Abusukhon A. Toward achieving a balance between the user satisfaction and the power conservation in the internet of things. IEEE Internet Things J. 2021 Jan 18; 8(14): 10998–1015.

Regular Issue Subscription Review Article
Volume 15
Issue 02
Received 15/04/2025
Accepted 07/05/2025
Published 22/05/2025
Publication Time 37 Days
137

[first_name] [last_name]

My IP

PlumX Metrics