Pooja J. Pawar,
Archana S. Banait,
- Research Scholar, Department of Computer Engineering, Mumbai Education Trust, Bhujbal Knowledge City, Nashik, Maharashtra, India
- Assistant Professor, Department of Computer Engineering, Mumbai Education Trust, Bhujbal Knowledge City, Nashik, Maharashtra, India
Abstract
The mouse and keyboard have been replaced by new input mechanisms brought about by the quick development of Human-Computer Interaction (HCI). Using computer vision and deep learning techniques, this study explores the possibility of replacing actual mouse inputs in a computer system with hand gestures. We created a virtual mouse system that uses a normal webcam to record hand motions. Computer vision algorithms then process these gestures to handle mouse operations including clicking, scrolling, zooming, and moving the cursor. A range of situations, such as changes in hand size, gesture speed, and ambient lighting, were used to test the system. The system achieves 99% accuracy under ideal conditions, but it dips to 92% under dim or overexposed lighting and at distances longer than 30 cm, according to key findings. Moreover, it is still difficult to recognize intricate actions like scrolling and right-clicking. Future versions will include more training data for gesture refinement, adaptive illumination correction algorithms, and different recognition techniques to address these problems. The technology provides a creative and affordable solution for those with physical limitations in spite of these obstacles, and it holds out hope for future immersive hands-free digital system interaction.
Keywords: Computer vision, deep learning, hand gesture recognition, virtual mouse, human-computer interaction, python
[This article belongs to Current Trends in Signal Processing ]
Pooja J. Pawar, Archana S. Banait. Generic Virtual Mouse. Current Trends in Signal Processing. 2025; 15(02):26-32.
Pooja J. Pawar, Archana S. Banait. Generic Virtual Mouse. Current Trends in Signal Processing. 2025; 15(02):26-32. Available from: https://journals.stmjournals.com/ctsp/article=2025/view=0
References
- Palsodkar P, Pathak A, Khawle K, Srivastava K, Fulzele M, Khurge D. Controlling Mouse Movement Using Hand Gestures and Voice Commands. In 2023 IEEE 4th International Conference for Emerging Technology (INCET). 2023 May 26; 1–5.
- Shibly KH, Dey SK, Islam MA, Showrav SI. Design and development of hand gesture based virtual mouse. In 2019 IEEE 1st International Conference on Advances in Science, Engineering and Robotics Technology (ICASERT). 2019 May 3; 1–5.
- Ranawat M, Rajadhyaksha M, Lakhani N, Shankarmani R. Hand gesture recognition based virtual mouse events. In 2021 IEEE 2nd International Conference for Emerging Technology (INCET). 2021 May 21; 1–4.
- Matlani R, Dadlani R, Dumbre S, Mishra S, Tewari A. Virtual mouse using hand gestures. In 2021 IEEE international conference on technological advancements and innovations (ICTAI). 2021 Nov 10; 340–345.
- Dahake RP, Kharat MU. Face recognition from video using threshold based clustering. Turk J Comput Math Educ. 2021; 12(1S): 272–85.
- Zhou Q, Fitzmaurice G, Anderson F. In-depth mouse: Integrating desktop mouse into virtual reality. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. 2022 Apr 29; 1–17.
- Volk T, Althoff F, Lang M, Grahn H. A Generic User Interface Framework. In Proc of the 9th Int Conf on Human-Computer Interaction. 2011 Aug 1; 1–9.
- Pointecker F, Schwajda D, List D, Anthes C. A generic architecture for cross-virtuality. In: ISS’21 Workshop Proceedings: Transitional Interfaces in Mixed and Cross-Reality: A New Frontier?; 2021 Nov 14; Łódź, Poland. New York (NY): ACM; 2021. p. 1–6. Available from: https://doi.org/10.18148/kops/352-2-1l3l2wncu3tgb5.
- Althoff F, Volk T, McGlaun G, Lang MK. A generic user interface framework for virtual reality applications. In Proceedings 9th HCI (HCI International 2001) Conference, New Orleans, Louisiana, USA. 2001; 5–10.
- Salmeron-Majadas S, Baker RS, Santos OC, Boticario JG. A machine learning approach to leverage individual keyboard and mouse interaction behavior from multiple users in real-world learning scenarios. IEEE Access. 2018 Jul 20; 6: 39154–79.

Current Trends in Signal Processing
| Volume | 15 |
| Issue | 02 |
| Received | 19/05/2025 |
| Accepted | 24/05/2025 |
| Published | 25/06/2025 |
| Publication Time | 37 Days |
[last_name]
