Siraj Shaikh,
Bhakti Walimbe,
Abhijeet Shinde,
Sanket Sase,
- Student Department of Electronics and Telecommunication Engineering, SKNCOE, SPPU, Pune Maharashtra India
- Student Department of Electronics and Telecommunication Engineering, SKNCOE, SPPU, Pune Maharashtra India
- Student Department of Electronics and Telecommunication Engineering, SKNCOE, SPPU, Pune Maharashtra India
- Student Department of Electronics and Telecommunication Engineering, SKNCOE, SPPU, Pune Maharashtra India
Abstract
In a time when human-computer interaction (HCI) is changing quickly, generating user-friendly interfaces is essential. This paper presents a new technique to HCI using virtual mouse and keyboard systems based on gesture recognition. This system replaces classical input devices by permitting users to control their computers with hand gestures using computer vision techniques. We created an optical mouse and keyboard technique that can recognize hand gestures recorded by a regular webcam by utilizing computer vision algorithms. Different gestures cause corresponding mouse clicks, keyboard inputs, and mouse movements through image processing. The implementation only needs a webcam as hardware and is written in Python using the PyCharm platform. The device works well as a virtual mouse and keyboard, offering smooth control without the demand for cables or other external hardware. The efficiency and user experience of computer interaction can be improved by permitting users to input text using natural hand gestures, navigate interfaces, and execute left and right clicks. This work provides opportunities for more organic and intuitive paradigms in HCI.
Keywords: Gesture Recognition, Virtual Mouse, Virtual Keyboard, Computer Vision, Human-Computer Interaction
References
[1] Sun JH, Ji TT, Zhang SB, Yang JK, Ji GR. Research on the hand gesture recognition based on deep learning. In2018 12th International symposium on antennas, propagation and EM theory (ISAPE) 2018 Dec 3 (pp. 1-4). IEEE.
[2] Rekha KB, Sampreeth R, Sai YY, Navatha M, Nayak R. Gesture-Driven Computing: Pioneering Control with Eye Tracking and Computer Vision. In2024 3rd International Conference for Innovation in Technology (INOCON) 2024 Mar 1 (pp. 1-9). IEEE.
[3] Da Silva RA, Veiga AC. Algorithm for decoding visual gestures for an assistive virtual keyboard. IEEE Latin America Transactions. 2020 Nov;18(11):1909-16. [4] Kumar P, Rautaray SS, Agrawal A. Hand data glove: A new generation real-time mouse for human-computer interaction. In2012 1st international conference on Recent Advances in Information Technology (RAIT) 2012 Mar 15 (pp. 750-755). IEEE.
[5] S. Sadhana Rao,” Sixth Sense Technology”, Proceedings of the International Conference onCommunicationand Computational Intelligence– 2010, pp.336-339.
[6] Game P. M., Mahajan A.R,”A gestural user interface to Interact with computer system ”, International Journal on Science and Technology (IJSAT) Volume II, Issue I, (Jan.- Mar.) 2011, pp.018 – 027.
[7] S. S. Rautaray and A. Agrawal, A Novel Human Computer Interface Based on Hand Gesture Recognition using Computer Vision Techniques, In Proceedings of ACM IITM’10, pp. 292–296, (2010)
[8] G. M. Gandhi and Salvi, ”Artificial Intelligence Integrated Blockchain For Training Autonomous Cars,” 2019 Fifth International Conference on Science Technology Engineering and Mathematics (ICONSTEM), Chennai, India, 2019, pp. 157 – 161
[9] Jesudoss A, Subramaniam NP. EAM: architecting efficient authentication model for internet security using image-based one time password technique. Indian Journal of Science and Technology. 2016 Feb;9(7):1-6.
[10] Praveena A, Eriki MK, Enjam DT. Implementation of smart attendance monitoring using open-CV and python. Journal of Computational and Theoretical Nanoscience. 2019 Aug 1;16(8):3290-5.
Journal of Microelectronics and Solid State Devices
| Volume | |
| Received | July 1, 2024 |
| Accepted | July 15, 2024 |
| Published | July 28, 2024 |