Sheetal Nilawar
Yashswini Inamdar
Charusheela Pandit
- Student Department of Computer Engineering, Vishwaniketan’s Institute of Management Entrepreneurship and Engineering Technology (ViMEET), Khalapur Maharashtra India
- Student Department of Computer Engineering, Vishwaniketan’s Institute of Management Entrepreneurship and Engineering Technology (ViMEET), Khalapur Maharashtra India
- Assistant Professor Department of Computer Engineering, Vishwaniketan’s Institute of Management Entrepreneurship and Engineering Technology (ViMEET), Khalapur Maharashtra India
Abstract
The “Air Touch Mouse Interface” introduces a groundbreaking method for human-computer interaction (HCI) by utilizing hand gestures captured through web cameras to control cursor movements without physical input devices. This project investigates the feasibility and effectiveness of employing image processing techniques to interpret hand gestures as mouse inputs, thereby enhancing the accessibility and versatility of computing interfaces. By eliminating the dependency on traditional mice and mouse pads, the proposed interface offers users a more intuitive and natural interaction experience, in line with the principles of Natural User Interface (NUI) design. Furthermore, the research explores potential applications of this technology in areas such as sign language recognition and motion-based gaming. Through comprehensive experimentation and analysis, this project aims to demonstrate the practicality and efficiency of the Air Touch Mouse Interface in improving user interaction with computing systems.
Keywords: Air Touch Mouse Interface, Human-Computer Interaction (HCI), Hand Gesture Recognition, Image Processing, Natural User Interface (NUI), Web Camera, Cursor Control, Sign Language Recognition, Motion-Based Gaming.
[This article belongs to Journal of Operating Systems Development & Trends(joosdt)]
References
1. Dubey S, Agarwal H, Singh J, Singh H. Virtual Mouse Using Hand Gesture. Journal of Advanced Research in Image Processing and Applications. 2023 Aug 8;6(1):16–8.
2. Nandwalkar J, Mandal M, Khirari A, Bhalchim T. Control Mouse using Hand Gesture and Voice. International Journal for Research in Applied Science & Engineering Technology (IJRASET). 2023;11(4):3261–3268.
3. Barot T, Karhadkar S. Development of platform independent hand gesture controlled wearable mouse. In2018 3rd International Conference for Convergence in Technology (I2CT) 2018 Apr 6 (pp. 1–5). IEEE.
4. Tran DS, Ho NH, Yang HJ, Kim SH, Lee GS. Real-time virtual mouse system using RGB-D images and fingertip detection. Multimedia Tools and Applications. 2021 Mar;80:10473–90.
5. Shriram S, Nagaraj B, Jaya J, Shankar S, Ajay P. Deep learning-based real-time AI virtual mouse system using computer vision to avoid COVID-19 spread. Journal of healthcare engineering. 2021 Oct 25;2021.
6. Kumar R, Gupta R, Faraz MS. Application and Designing of Wireless Mouse using Object Tracking. In2019 6th International Conference on Computing for Sustainable Global Development (INDIACom) 2019 Mar 13 (pp. 22–26). IEEE.
7. Reddy KB, Fayazuddin M, Manohar MJ, Tavanam V. Artificial Intelligence Based Virtual Mouse. International Journal of Computer Science and Mobile Computing. 2022.
8. Shraddha Gaikwad, Devansh Rane. AI Virtual Mouse. International Research Journal of Engineering and Technology (IRJET). 2022;09(05):1293–1295.
9. Kavitha R, Janasruthi S U, Lokitha S, Tharani G. Hand Gesture Controlled Virtual Mouse Using Artificial Intelligence. IJARIIE. 2023;9(2):307–320.
10. Nikhil Srivastava. Invisible Mouse: Interacting with Computer Systems without Physical Mouse. International Journal of Engineering Research & Technology (IJERT). 2012;1(5):1–4.
11. Mistry P, Maes P. Mouseless: a computer mouse as small as invisible. InCHI’11 Extended Abstracts on Human Factors in Computing Systems 2011 May 7 (pp. 1099–1104).
12. Pradhan A, Deepak BB. Design of intangible interface for mouseless computer handling using hand gestures. Procedia Computer Science. 2016 Jan 1;79:287–92.
13. Tejaswi D, Preethi G, Sirisha B, Swathi K, Priya DJ, Sravani G. Mouseless Cursor Using Facial Movements. Journal of Engineering Sciences. 2023;14(04).
14. Villar N, Izadi S, Rosenfeld D, Benko H, Helmes J, Westhues J, Hodges S, Ofek E, Butler A, Cao X, Chen B. Mouse 2.0: multi-touch meets the mouse. InProceedings of the 22nd annual ACM symposium on User interface software and technology 2009 Oct 4 (pp. 33–42).
15. Sandra BK, Vardhan KH, Uday C, Surya VS, Raju B, Kumar DV. Gesture-Controlvirtual-Mouse. International Research Journal of Modernization in Engineering Technology and Science. 2022 Apr;4(04).
16. Chen X, Guo H, Wang G, Zhang L. Motion feature augmented recurrent neural network for skeleton-based dynamic hand gesture recognition. In2017 IEEE International Conference on Image Processing (ICIP) 2017 Sep 17 (pp. 2881–2885). IEEE.
17. Lee, G., Lee, S., Kim, J., & Kim, J. H. (2020). Hand Gesture Recognition for Human-Computer Interaction: A Review. Sensors, 20(19), 5543.
18. Wu M. Gesture Recognition in Virtual reality. Psychomachina. 2023 Dec 13;1:1–10.
19. Feng C, Wang N, Jiang Y, Zheng X, Li K, Wang Z, Chen X. Wi-learner: Towards one-shot learning for cross-domain wi-fi based gesture recognition. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies. 2022 Sep 7;6(3):1–27.
20. Wang S, Wang A, Ran M, Liu L, Peng Y, Liu M, Su G, Alhudhaif A, Alenezi F, Alnaim N. Hand gesture recognition framework using a lie group based spatio-temporal recurrent network with multiple hand-worn motion sensors. Information Sciences. 2022 Aug 1;606:722–41.
21. Kumar D, Ganesh A. A critical review on hand gesture recognition using semg: Challenges, application, process and techniques. InJournal of Physics: Conference Series 2022 Aug 1 (Vol. 2327, No. 1, p. 012075). IOP Publishing.
22. Du G, Guo D, Su K, Wang X, Teng S, Li D, Liu PX. A mobile gesture interaction method for augmented reality games using hybrid filters. IEEE Transactions on Instrumentation and Measurement. 2022 Jun 13;71:1–2.
23. Sharma V, Jaiswal M, Sharma A, Saini S, Tomar R. Dynamic Two Hand Gesture Recognition using CNN-LSTM based networks. In 2021 IEEE international symposium on smart electronic systems (iSES) 2021 Dec 18 (pp. 224–229). IEEE.
24. Sharma S, Singh S. Vision-based hand gesture recognition using deep learning for the interpretation of sign language. Expert Systems with Applications. 2021 Nov 15;182:115657.
25. Song Z, Cao Z, Li Z, Wang J, Liu Y. Inertial motion tracking on mobile and wearable devices: Recent advancements and challenges. Tsinghua Science and Technology. 2021 Apr 20;26(5):692–705.
26. Moin A, Zhou A, Rahimi A, Menon A, Benatti S, Alexandrov G, Tamakloe S, Ting J, Yamamoto N, Khan Y, Burghardt F. A wearable biosensing system with in-sensor adaptive machine learning for hand gesture recognition. Nature Electronics. 2021 Jan;4(1):54–63.
27. Park S, Wang X, Chen K, Lee Y. STATION: Gesture-Based Authentication for Voice Interfaces. IEEE Internet of Things Journal. 2024 Mar 28.
28. Zhou H, Wang D, Yu Y, Zhang Z. Research progress of human–computer interaction technology based on gesture recognition. Electronics. 2023 Jun 25;12(13):2805.
29. Fang B, Sun F, Liu H, Guo D. A novel data glove using inertial and magnetic sensors for motion capture and robotic arm-hand teleoperation. Industrial Robot: An International Journal. 2017 Mar 20;44(2):155–65.
30. Chaaraoui AA, Florez-Revuelta F. Adaptive human action recognition with an evolving bag of key poses. IEEE transactions on Autonomous mental Development. 2014 Apr 7;6(2):139–52.
Journal of Operating Systems Development & Trends
| Volume | 11 |
| Issue | 01 |
| Received | February 24, 2024 |
| Accepted | April 12, 2024 |
| Published | May 7, 2024 |