Integrating Deep Learning and Computer Vision for Recognizing American Sign Language

Year : 2024 | Volume :14 | Issue : 03 | Page : –
By

Shivam Khachane,

Kanchan Pujari,

Rushikesh Khandagale,

Nishu Lodhi,

  1. Student, Department of Electronics and Telecommunication, Smt. Kashibai Navale College of Engineering, Savitribai Phule Pune University, Pune, Maharashtra, India
  2. Assistant Professor, Department of Electronics and Telecommunication, Smt. Kashibai Navale College of Engineering, Savitribai Phule Pune University, Pune, Maharashtra, India
  3. Student, Department of Electronics and Telecommunication, Smt. Kashibai Navale College of Engineering, Savitribai Phule Pune University, Pune, Maharashtra, India
  4. Student, Department of Electronics and Telecommunication, Smt. Kashibai Navale College of Engineering, Savitribai Phule Pune University, Pune, Maharashtra, India

Abstract

The only habit talk, and hearing-impaired crowd can ideas is by utilizing the nonverbal communication. The main problem at this moment somewhat ideas is that the non-impaired community, the one cannot comprehend the nonverbal communication would not be able to write accompanying these crowd or vice versa. The project is purposely devised to admit unwilling and dumb societies to transport ideas and connect with the organization. It aims to help along middle from two points talk and hearing-impaired nation and the nonimpaired community. Speech impairment is a restriction that influences an individual’s ability to write efficiently. Many existent studies have proposed procedures for nonverbal communication acknowledgment. This study is proposed at full American Sign Language (ASL) acknowledgment. With current advances in deep education and computer view, skilled has existed hopeful progress in the fields of gesture acknowledgment. Thus, this study is still proposed to extract features from finger and help motions. The system does not demand the history expected perfectly dark. It everything on nearly any qualification. The project uses a concept alter plan to identify, exceptionally English alphabetic nonverbal communication, and convert it into idea. The focus of this work searches out designs a fantasy-located application that offers American sign language rewording to idea so aiding ideas betwixt signers and non-signers. The projected model takes figure sequences and extracts temporal and geographical appearance from bureaucracy. Later using Inception, a CNN (Convolution Neural Network) spatial features will be recognized.

Keywords: Convolution Neural Networks (CNN), Machine learning, American Sign Language (ASL), Computer vision, Deep Learning.

[This article belongs to Current Trends in Information Technology(ctit)]

How to cite this article: Shivam Khachane, Kanchan Pujari, Rushikesh Khandagale, Nishu Lodhi. Integrating Deep Learning and Computer Vision for Recognizing American Sign Language. Current Trends in Information Technology. 2024; 14(03):-.
How to cite this URL: Shivam Khachane, Kanchan Pujari, Rushikesh Khandagale, Nishu Lodhi. Integrating Deep Learning and Computer Vision for Recognizing American Sign Language. Current Trends in Information Technology. 2024; 14(03):-. Available from: https://journals.stmjournals.com/ctit/article=2024/view=0



References

  1. Bantupalli K, Xie Y. American sign language recognition using deep learning and computer vision. In2018 IEEE international conference on big data (big data) 2018 Dec 10 (pp. 4896-4899). IEEE.
  2. Cohen I, Sebe N, Garg A, Chen LS, Huang TS. Facial expression recognition from video sequences: temporal and static modeling. Computer Vision and image understanding. 2003 Jul 1;91(1-2):160-87.
  3. Rajan RG, Leo MJ. A comprehensive analysis on sign language recognition system. International Journal of Recent Technology and Engineering (IJRTE). 2019 Mar;7(6).
  4. Nandy, A., Prasad, J.S., Mondal, S., Chakraborty, P. and Nandi, G.C., 2010. Recognition of isolated indian sign language gesture in real time. In Information Processing and Management: International Conference on Recent Trends in Business Administration and Information Processing, BAIP 2010, Trivandrum, Kerala, India, March 26-27, 2010. Proceedings(pp. 102-107). Springer Berlin Heidelberg.
  5. Tripathi K, Baranwal N, Nandi GC. Continuous dynamic Indian Sign Language gesture recognition with invariant backgrounds. In2015 international conference on advances in computing, communications and informatics (ICACCI) 2015 Aug 10 (pp. 2211-2216). IEEE.
  6. Neidle C, Thangali A, Sclaroff S. Challenges in development of the american sign language lexicon video dataset (asllvd) corpus. In5th workshop on the representation and processing of sign languages: interactions between corpus and Lexicon, LREC 2012 May 27.
  7. Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A. Going deeper with convolutions. InProceedings of the IEEE conference on computer vision and pattern recognition 2015 (pp. 1-9).
  8. Schmidhuber J, Hochreiter S. Long short-term memory. Neural Comput. 1997 Nov 15;9(8):1735-80.
  9. Srivastava S, Gangwar A, Mishra R, Singh S. Sign language recognition system using TensorFlow object detection API. InInternational conference on advanced network technologies and intelligent computing 2021 Dec 17 (pp. 634-646). Cham: Springer International Publishing.
  10. Pugeault N, Bowden R. Spelling it out: Real-time ASL fingerspelling recognition. In2011 IEEE International conference on computer vision workshops (ICCV workshops) 2011 Nov 6 (pp. 1114-1119). IEEE.

Regular Issue Subscription Review Article
Volume 14
Issue 03
Received July 3, 2024
Accepted September 5, 2024
Published September 11, 2024

function myFunction2() {
var x = document.getElementById(“browsefigure”);
if (x.style.display === “block”) {
x.style.display = “none”;
}
else { x.style.display = “Block”; }
}
document.querySelector(“.prevBtn”).addEventListener(“click”, () => {
changeSlides(-1);
});
document.querySelector(“.nextBtn”).addEventListener(“click”, () => {
changeSlides(1);
});
var slideIndex = 1;
showSlides(slideIndex);
function changeSlides(n) {
showSlides((slideIndex += n));
}
function currentSlide(n) {
showSlides((slideIndex = n));
}
function showSlides(n) {
var i;
var slides = document.getElementsByClassName(“Slide”);
var dots = document.getElementsByClassName(“Navdot”);
if (n > slides.length) { slideIndex = 1; }
if (n (item.style.display = “none”));
Array.from(dots).forEach(
item => (item.className = item.className.replace(” selected”, “”))
);
slides[slideIndex – 1].style.display = “block”;
dots[slideIndex – 1].className += ” selected”;
}

Check Our other Platform for Workshops in the field of AI, Biotechnology & Nanotechnology.
Check Out Platform for Webinars in the field of AI, Biotech. & Nanotech.