Vol. 4 No. 4 (2025): October
RESEARCH ARTICLES

Indian Sign Language Translator Using CNN

DOWNLOAD PDF
  • Aadhya Satrasala,
  • Anish B K Koundinya,
  • Devadula Gayatri,
  • Seshadri Lasya,
  • Anil Kumar Ambore
Aadhya Satrasala
School of Computer Science and Engineering, REVA University, Bengaluru, Karnataka, India
Anish B K Koundinya
School of Computer Science and Engineering, REVA University, Bengaluru, Karnataka, India
Devadula Gayatri
School of Computer Science and Engineering, REVA University, Bengaluru, Karnataka, India
Seshadri Lasya
School of Computer Science and Engineering, REVA University, Bengaluru, Karnataka, India
Anil Kumar Ambore
School of Computer Science and Engineering, REVA University, Bengaluru, Karnataka, India
DOI: https://doi.org/10.5281/zenodo.15279424

Published 2025-04-25

Keywords

  • Indian Sign Language Translator,
  • MediaPipe,
  • Convolutional Neural Network (CNN),
  • Feed Forward Neural Networks,
  • Hand Gesture Recognition

How to Cite

Aadhya Satrasala, Anish B K Koundinya, Devadula Gayatri, Seshadri Lasya, & Anil Kumar Ambore. (2025). Indian Sign Language Translator Using CNN. International Journal of Computational Learning & Intelligence, 4(4), 792–798. https://doi.org/10.5281/zenodo.15279424

Copyright (c) 2025 Aadhya Satrasala, Anish B K Koundinya, Devadula Gayatri, Seshadri Lasya, Anil Kumar Ambore

Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Abstract

This paper main focus is to create a real-time Indian Sign Language (ISL) translator designed to overcome the gap between the deaf and hard-of-hearing population and the hearing population. By leveraging computer vision techniques and machine learning models, the system can accurately recognize a wide range of ISL gestures and translate them into corresponding text outputs in English.  The application is intended to facilitate seamless communication, enhancing accessibility in various settings such as education, healthcare, and daily interactions. This solution aims to foster greater inclusion and social integration for ISL users while addressing the lack of real-time ISL translation tools in India.
DOWNLOAD PDF

References

  1. Ahmed, S. T., Kumar, V. V., Singh, K. K., Singh, A., Muthukumaran, V., & Gupta, D. (2022). 6G enabled federated learning for secure IoMT resource recommendation and propagation analysis. Computers and Electrical Engineering, 102, 108210.
  2. Chand, H. V., & Karthikeyan, J. (2022). CNN-based driver drowsiness detection system using emotion analysis.
  3. Das, A., Gawde, S., Suratwala, K., & Kalbande, D. (2018). Sign language recognition using deep learning on custom processed static gesture images. In 2018 International Conference on Smart City and Emerging Technology (ICSCET). IEEE.
  4. Dubey, P. (2021). Sign language conversion flex sensor based on IoT. International Journal of Research in Engineering and Science (IJRES).
  5. Goyal, K., & Velmathi, G. (2022). Indian sign language recognition using MediaPipe Holistic.
  6. Katoch, S., Singh, V., & Tiwary, U. S. (2022). Indian sign language recognition system using SURF with SVM and CNN.
  7. Kumar, S. S., Ahmed, S. T., Sandeep, S., Madheswaran, M., & Basha, S. M. (2022). Unstructured Oncological Image Cluster Identification Using Improved Unsupervised Clustering Techniques. Computers, Materials & Continua, 72(1). Bora, J., Dehingia, S., Boruah, A., Chetia, A. A., & Gogoi, D. (2022). Real-time Assamese sign language recognition using MediaPipe and deep learning.
  8. Nandy, A. (2010). Recognition of isolated Indian sign language gestures in real-time. In International Conference on Recent Trends in Business Administration and Information Processing, Kerala, India.
  9. Patel, H. B., Patel, B. D., Patel, N., & Akilan, T. (2020). ES2ISL: An advancement in speech to sign language translation using 3D avatar animator. In 2020 IEEE Canadian Conference.
  10. Rajarajeswari, S., Renji, N. M., Kumari, P., Keshavamurthy, M., & Kruthika, K. (2022). Real-time translation of Indian sign language to assist the hearing and speech impaired. In Roy, S., Sinwar, D., Perumal, T., Slowik, A., & Tavares, J. M. R. S. (Eds.), Innovations in Computational Intelligence and Computer Vision (AISC). Springer, Singapore.
  11. Saija, K., Shah, V., & Sangeetha, S. (2019). WordNet based sign language machine translation: From English voice to ISL gloss. In 2019 IEEE India Council International Conference (INDICON).
  12. Sathiyamoorthi, V., Ilavarasi, A. K., Murugeswari, K., Ahmed, S. T., Devi, B. A., & Kalipindi, M. (2021). A deep convolutional neural network based computer aided diagnosis system for the prediction of Alzheimer's disease in MRI images. Measurement, 171, 108838.
  13. Shaikh, F., Darunde, S., & Mali, S. (2019). Sign language translation system for railway station announcements. In 2019 IEEE Bombay Signature Conference (IBSC).
  14. Shivashankara, S., & Srinath, S. (2018). American sign language recognition system: An optimal approach. International Journal of Image, Graphics and Signal Processing (IJIGSP).