Literature Survey on AURA: Augmented Reality Glasses for Enhancing Accessibility of Visually and Hearing Impaired Users

Abstract

 Communication barriers in everyday situations affect the social interactions of DHH individuals. This work proposes an AR smart glasses-based system that will integrate ASR, recognition of sign language, and visual text overlay to support accessible two-way 
communication. The system captures speech using ASR models and converts sign-language gestures using a CNN/LSTM-based 
recognition pipeline; real-time text output is presented to the user using the AR display. Although the architecture presented here is still conceptual, it does point out how AR can be of help in furthering social inclusion. Future efforts will involve the implementation of the prototype, model accuracy testing, and latency optimization to prepare the system for real-world applications.