Air Touch Mouse Interface

Year : 2024 | Volume :11 | Issue : 01 | Page : 1-16
By

Sheetal Nilawar

Yashswini Inamdar

Charusheela Pandit

  1. Student Department of Computer Engineering, Vishwaniketan’s Institute of Management Entrepreneurship and Engineering Technology (ViMEET), Khalapur Maharashtra India
  2. Student Department of Computer Engineering, Vishwaniketan’s Institute of Management Entrepreneurship and Engineering Technology (ViMEET), Khalapur Maharashtra India
  3. Assistant Professor Department of Computer Engineering, Vishwaniketan’s Institute of Management Entrepreneurship and Engineering Technology (ViMEET), Khalapur Maharashtra India

Abstract

The “Air Touch Mouse Interface” introduces a groundbreaking method for human–computer interaction (HCI) by utilizing hand gestures captured through web cameras to control cursor movements without physical input devices. This project investigates the feasibility and effectiveness of employing image processing techniques to interpret hand gestures as mouse inputs, thereby enhancing the accessibility and versatility of computing interfaces. By eliminating the dependency on traditional mice and mouse pads, the proposed interface offers users a more intuitive and natural interaction experience, in line with the principles of natural user interface (NUI) design. Furthermore, the research explores potential applications of this technology in areas such as sign language recognition and motion-based gaming. Through comprehensive experimentation and analysis, this project aims to demonstrate the practicality and efficiency of the Air Touch Mouse Interface in improving user interaction with computing systems.

Keywords: Air touch mouse interface, human–computer interaction (HCI), hand gesture recognition, image processing, natural user interface (NUI), web camera, cursor control, sign language recognition, motion-based gaming

[This article belongs to Journal of Operating Systems Development & Trends(joosdt)]

How to cite this article: Sheetal Nilawar, Yashswini Inamdar, Charusheela Pandit. Air Touch Mouse Interface. Journal of Operating Systems Development & Trends. 2024; 11(01):1-16.
How to cite this URL: Sheetal Nilawar, Yashswini Inamdar, Charusheela Pandit. Air Touch Mouse Interface. Journal of Operating Systems Development & Trends. 2024; 11(01):1-16. Available from: https://journals.stmjournals.com/joosdt/article=2024/view=145325

References

  1. Dubey S, Agarwal H, Singh J, Singh H. Virtual mouse using hand gesture. J Adv Res Image Process Appl. 2023;6:16–18.
  2. Nandwalkar DJ, Mandal M, Khirari A, Bhalchim T. Control mouse using hand gesture and voice. International Journal for Research in Applied Science and Engineering Technology. 2023;11:3261–3268. DOI: 10.22214/ijraset.2023.50850.
  3. Barot T, Karhadkar S. Development of platform independent hand gesture controlled wearable mouse. In: 3rd International Conference for Convergence in Technology (I2CT). IEEE Publications; 2018. pp. 1–5. DOI: 10.1109/I2CT.2018.8529544.
  4. Tran DS, Ho NH, Yang HJ, Kim SH, Lee GS. Real-time virtual mouse system using RGB-D images and fingertip detection. Multimedia Tools and Applications. 2021;80:10473–10490. DOI: 10.1007/s11042-020-10156-5.
  5. Shriram S, Nagaraj B, Jaya J, Shankar S, Ajay P. Deep learning-based real-time AI virtual mouse system using computer vision to avoid COVID-19 spread. Journal of Healthcare Engineering. 2021;2021:8133076. DOI: 10.1155/2021/8133076, PubMed: 34733459.
  6. Chaaraoui AA, Florez-Revuelta F. Adaptive human action recognition with an evolving bag of key poses. IEEE Trans Auton Ment Dev. 2014;6:139–152. DOI: 10.1109/TAMD.2014.2315676.
  7. Chen X, Guo H, Wang G, Zhang L. Motion feature augmented recurrent neural network for skeleton-based dynamic hand gesture recognition. In: IEEE International Conference on Image Processing (ICIP). IEEE Publications; 2017. pp. 2881–2885. DOI: 10.1109/ICIP.2017.8296809.
  8. Lee G, Lee S, Kim J, Kim JH. Hand gesture recognition for human–computer interaction: A review. Sensors. 2020;20:5543.
  9. Song Z, Cao Z, Li Z, Wang J, Liu Y. Inertial motion tracking on mobile and wearable devices: Recent advancements and challenges. Tsinghua Science and Technology. 2021;26:692–705. DOI: 10.26599/TST.2021.9010017.
  10. Sharma S, Singh S. Vision-based hand gesture recognition using deep learning for the interpretation of sign language. Expert Systems with Applications. 2021;182:115657. DOI: 10.1016/j.eswa.2021.
  11. Sharma V, Jaiswal M, Sharma A, Saini S, Tomar R. Dynamic two hand gesture recognition using CNN-LSTM based networks. In: IEEE International Symposium on smart electronic systems (iSES), Vol. 2021. IEEE Publications; 2021. pp. 224–229. DOI: 10.1109/iSES52644.2021.00059.
  12. Moin A, Zhou A, Rahimi A, Menon A, Benatti S, Alexandrov G, et al. A wearable biosensing system with in-sensor adaptive machine learning for hand gesture recognition. Nature Electronics. 2021;4:54–63. DOI: 10.1038/s41928-020-00510-8.
  13. Fang B, Sun F, Liu H, Guo D. A novel data glove using inertial and magnetic sensors for motion capture and robotic arm-hand teleoperation. Ind Robot. 2017;44:155–165. DOI: 10.1108/IR-07-2016-0179.
  14. Du G, Guo D, Su K, et al. A mobile gesture interaction method for augmented reality games using hybrid filters. IEEE Trans Instrum Meas. 2022;71:1–12. DOI: 10.1109/TIM.2022.3181305.
  15. Zhou H, Wang D, Yu Y, Zhang Z. Research progress of human–computer interaction technology based on gesture recognition. Electronics. 2023;12:2805. DOI: 10.3390/electronics12132805.
  16. Kumar D, Ganesh A. A critical review on hand gesture recognition using SEMG: Challenges [Application], process and techniques. In: Journal of Physics: Conference Series. Vol. 2327, No. 1, p. 012075. IOP Publishing; 2022.
  17. Wang S, Wang A, Ran M, Liu L, Peng Y, Liu M, et al. Hand gesture recognition framework using a lie group based spatio-temporal recurrent network with multiple hand-worn motion sensors. Information Sciences. 2022;606:722–741. DOI: 10.1016/j.ins.2022.05.085.
  18. Wu M. Gesture recognition in virtual reality. Psychomachina. 2023;1:1–10. DOI: 10.59388/pm
  19. Feng C, Wang N, Jiang Y, et al. Wi-learner: Towards one-shot learning for cross-domain wi-fi based gesture recognition. Proc ACM Interact Mob Wearable Ubiquitous Technol. 2022;6:1–27. DOI: 10.1145/3550318.
  20. Park S, Wang X, Chen K, Lee Y. STATION: Gesture-based authentication for voice interfaces. IEEE Internet of Things Journal. 2024;1–1. DOI: 10.1109/JIOT.2024.3382721.
  21. Kumar R, Gupta R, Faraz MS. Application and designing of wireless mouse using object tracking. In: 2019 6th International Conference on Computing for Sustainable Global Development (INDIACom). IEEE Publications; 2019. pp. 22–26.
  22. Reddy KB, Fayazuddin M, Manohar MJ, Tavanam V. Artificial intelligence based virtual mouse. International Journal of Computer Science and Mobile Computing. 2022;11:25–35. DOI: 10.47760/ijcsmc.2022.v11i01.005.
  23. Gaikwad S. Devansh rane. [AI virtual mouse]. International Research Journal of Engineering and Technology (IRJET). 2022;09:1293–1295.
  24. Kavitha R, Janasruthi SU, Lokitha S, Tharani G. Hand gesture controlled virtual mouse using artificial intelligence. IJARIIE. 2023;9:307–320.
  25. Srivastava N. Invisible mouse: Interacting with computer systems without physical mouse. International Journal of Engineering Research and Technology (IJERT). 2012;1:1–4.
  26. Mistry P, Maes P. Mouseless: A computer mouse as small as invisible. In: CHI’11 Extended Abstracts on Human Factors in Computing Systems; 2011. pp. 1099–1104. DOI: 10.1145/1979742.
  27. Pradhan A, Deepak BBLV. Design of intangible interface for mouseless computer handling using hand gestures. Procedia Computer Science. 2016;79:287–292. DOI: 10.1016/j.procs.2016.03.037.
  28. Tejaswi D, Preethi G, Sirisha B, Swathi K, Priya DJ, Sravani G. Mouseless cursor using facial movements. Journal of Engineering Sciences. 2023;14.
  29. Villar N, Izadi S, Rosenfeld D, Benko H, Helmes J, Westhues J, et al. Mouse 2.0: Multi-touch meets the mouse. In: Proceedings of the 22nd Annual ACM Symposium on User Interface Software and Technology 2009 Oct 4. 2009. pp. 33–42. DOI: 10.1145/1622176.1622184.
  30. Sandra BK, Vardhan KH, Uday C, Surya VS, Raju B, Kumar DV. Gesture-Controlvirtual-mouse. International Research Journal of Modernization in Engineering Technology and Science. 2022;4.
Regular Issue Subscription Review Article
Volume 11
Issue 01
Received February 24, 2024
Accepted April 12, 2024
Published May 7, 2024
Views: 58