Cutting Edge '25

End-to-End Sign Language Recognition Pipeline

By

Catagories

Play Video

"Sign Language Recognition (SLR) plays a crucial role in enhancing communication accessibility for deaf and hard-of-hearing communities. This paper introduces an energy-efficient, end-to-end SLR pipeline optimized for real-time edge deployment. Our approach centers on a novel hybrid architecture that integrates MaskedConv1D layers with a Bidirectional Long Short-Term Memory (BiLSTM) network, further enhanced by an attention mechanism to effectively extract and leverage spatio-temporal features from sign gesture sequences. The pipeline incorporates a robust preprocessing module utilizing MediaPipe-based landmark extraction and a selective temporal sampling strategy, which together reduce input redundancy while preserving critical gesture dynamics. Additionally, a lightweight, prompt-driven language model is employed for on-the-fly grammatical correction and translation, ensuring high semantic fidelity under computational constraints. Experimental evaluations on the SSL400 dataset demonstrate competitive classification accuracy, low computational overhead, and high inference speed, making the system well-suited for resource-limited edge devices. These contributions provide a scalable foundation for practical SLR applications and highlight future enhancements in multimodal fusion and on-device language processing."

Vision Quest

Check out the visionary projects our students have brought up in this year
VisuaLit

VisuaLit is an AI-powered eBook reader that redefines traditional reading by merging visual storytelling, audio narration, and contextual learning into…

VenDoor

The VenDoor application is a fully functional mobile application designed to create a bridge between mobile vendors and their customers…

UniGuide

UniGuide is a student-focused platform that helps individuals make smart educational and career decisions. It offers a comprehensive database of…