Enhancing Sign Language Learning with Augmented Reality


  • Hawa Mohd Ekhsan Universiti Teknologi MARA, Perlis Branch, Arau Campus
  • Mohamad Daniel Muhamad Khairi Universiti Teknologi MARA, Perlis Branch, Arau Campus
  • Jiwa Noris Hamid Universiti Teknologi MARA, Perlis Branch, Arau Campus




augmented reality, mobile application, sign language, disability


Sign language is the communication language used by people with disabilities, especially deaf and hearing-impaired people. The communication between normal and disabled people using sign language will help them carry out their daily activities. Unfortunately, normal people are not aware of the importance of sign language because they are not directly dealing with disabled persons. Besides, some normal people found that sign language is difficult to learn. This study focuses on developing a mobile application for sign language with augmented reality features. This application is targeted at normal people as a sign language learning tool, and augmented reality will make the learning process effective and exciting. The methodology for this study is the ADDIE model that consists of five phases, namely Analysis, Design, Development, Implementation, and Evaluation. This application will assist the users in learning sign language interactively and interestingly. The evaluation of the application was done by the expert in the related background and the normal people. The usability test result revealed that the sign language application is usable for normal people to know and learn the basic sign language. In conclusion, the sign language application is an interesting application for normal people to use and learn sign language.


Download data is not yet available.


Almutairi, A., & Al-Megren, S. (2017). Augmented reality for the literacy development of deaf children: A preliminary investigation. Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2017), 359–360.

Bragg, D. (2020). Sign Language Interfaces : Discussing the Field ’ s Biggest Challenges. Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems (CHI EA '20). 1–5.

Deb, S., Suraksha, & Bhattacharya, P. (2018). Augmented Sign Language Modeling(ASLM) with interaction design on smartphone - an assistive learning and communication tool for inclusive classroom. Procedia Computer Science, 125, 492–500.

Hafit, H., Xiang, C. W., Yusof, M. M., Wahid, N., & Kassim, S. (2019). Malaysian Sign Language Mobile Learning Application : A recommendation app to communicate with hearing-impaired communities. International Journal of Electrical and Computer Engineering (IJECE), 9(6), 5512.

Razalli, A. R., Mamat, N., Razali, N., Yasin, M. H. M., Lakulu, M., Hashim, A. T. M., & Ariffin, A. (2021). Development of Prayer Mobile Application Software for The Hearing Impaired (Deaf) Based on Malaysian Sign Language. International Journal of Academic Research in Business and Social Sciences, 11(6), 1108–1122.

Saidin, N. F., Halim, N. D. A., & Yahaya, N. (2016). Designing Mobile Augmented Reality (MAR) for Learning Chemical Bonds. In Proceedings of the 2nd International Colloquium of Art and Design Education Research (i-CADER 2015) (pp. 367–377). Springer Singapore.

Soogund, N.-U.-N., & Joseph, M. H. (2019). SignAR: A Sign Language Translator Application with Augmented Reality using Text and Image Recognition. 2019 IEEE International Conference on Intelligent Techniques in Control, Optimization and Signal Processing (INCOS 2019), 3(1), 1–5.




How to Cite

Mohd Ekhsan, H., Muhamad Khairi, M. D. ., & Hamid, J. N. (2022). Enhancing Sign Language Learning with Augmented Reality. Journal of Computing Research and Innovation, 7(1), 147–154. https://doi.org/10.24191/jcrinn.v7i1.277



General Computing