Bridging Silence and Speech: An AI-Powered Leap for Inclusion
Aishwarya Karnataki and data scientist Parikshit Sohoni have designed the Fifth Sense, to enable real-time communication for the hearing- and speech-impaired, this innovation could redefine disability inclusion in India’s classrooms, clinics, and workplaces.
Updated on: 19 June 2023
Sector
Solution
Technology
State of Origin
Impact Metrics
98% accuracy
in understanding and translation.
50 gestures
enabled for real-time communication.
Hearing loss is the world’s most prevalent sensory disability, affecting over 430 million people globally, according to the World Health Organization (WHO). In India, with an estimated 63 million people experiencing significant auditory impairment, the need for accessible solutions is pressing. Yet only 10% of those who need assistive technologies (AT) globally have access to them (WHO GReAT Report 2022).
Fifth Sense addresses this disparity. Unlike traditional aids such as hearing devices or cochlear implants—which are limited to users with residual hearing—this device is designed for individuals with complete hearing and speech impairment. It belongs to the third, and most advanced, class of AT: communication-enabling wearables. The system comprises motion-sensing gloves or a smartwatch, translating Indian Sign Language (ISL) gestures into spoken English, and vice versa, through an embedded microphone and display screen.
Gesture-to-speech: AI meets ergonomics
The core technology of Fifth Sense lies in its motion capture sensors—six per hand—that collect linear and rotational data to decode each sign gesture. This data feeds into an AI engine trained with gesture sets aligned to India’s standardised ISL vocabulary, currently comprising 20,000 officially recognised signs.
But the innovation doesn’t stop at translation. Fifth Sense also applies Natural Language Processing (NLP) to reorder gestures into grammatically correct English sentences. Simultaneously, reverse communication is enabled through speech-to-text and image conversion for the hearing-impaired user, making the device bi-directional and eliminating dependence on interpreters.
Aligning With national priorities and development frameworks
Fifth Sense represents a strong alignment with India’s Accessible India Campaign (Sugamya Bharat Abhiyan), which seeks to enhance universal accessibility in communication, education, and employment for persons with disabilities. By enabling barrier-free interaction, the device also supports goals under:
-
Digital India: Facilitating inclusive tech innovation at scale, even in offline or low-infrastructure contexts.
-
Samagra Shiksha Abhiyan and NEP 2020: Enabling equitable classroom participation and digital learning for students with disabilities.
-
Ayushman Bharat Digital Mission: Promoting accessible health services through privacy-preserving, interpreter-free medical interactions.
-
Start-up India and Make in India: Developed entirely in India by GlovatriX Private Limited, Fifth Sense embodies citizen-led innovation with global scalability.
-
Viksit Bharat@2047: Supporting inclusive, technology-driven solutions that promote dignity, independence, and equity.
From restaurants to research centres: Ground-level impact
Pilot deployments have begun in restaurants like Terrasinne Kitchen and Bar in Pune and Mirchi & Mime in Mumbai, where staff with hearing impairments now use Fifth Sense to manage custom orders and complex interactions—eliminating the need for third-party managers.
In educational settings, early surveys at CR Ranganathan College for the Deaf in Pune revealed that students could comprehend only 30% of what teachers said due to lack of eye contact and real-time translation. Fifth Sense could dramatically improve such learning outcomes.
Scaling the future of inclusive tech
With a planned launch price of ₹25,000 and initial deployment focused on workplace and educational settings, Fifth Sense is building a robust case for mainstreaming assistive technologies in India. As algorithms expand to support local languages and domain-specific vocabulary, the device is poised for wide application—from public service counters and emergency response, to courtrooms and mental health services.
By addressing an invisible disability with precision AI and deeply empathetic design, Fifth Sense isn’t just a device—it’s a statement. A statement that inclusion is not an afterthought but an innovation imperative.
Share Your Story Today, Shape Viksit Bharat Tomorrow
Got an idea, innovation, or experience that's making a difference? Share your story now and ignite India's transformation because your voice can drive the future forward!
BUILD YOUR OWN
BUILD YOUR OWN
How can I implement this innovation effectively?
How is this innovation being adopted around the world?
Where else could this innovation make an impact?
Who has seen real results from using this innovation?
What insights do experts share about this innovation?
What policies support or influence this innovation?
How could this innovation evolve in the future?
Is this innovation accessible and inclusive for everyone?
How can I contribute to or participate in this innovation?
What resources can help me explore this innovation further?
If you would like to know more about this innovation, fill this form to contact the innovator.
Handpicked stories tailored just for you
Explore stories that inspire, inform, and ignite new ideas across tech, innovation, and real-world impact
From Sea to Fuel: How Indian Researchers Are Turning Seaweed into Clean Energy
An Indian marine bioenergy initiative is converting seaweed into high-energy biofuels using mechanised ocean farming and hydrothermal liquefaction. By producing...
Read More