Bridging Silence and Speech: An AI-Powered Leap for Inclusion

Bridging Silence and Speech: An AI-Powered Leap for Inclusion

Aishwarya Karnataki and data scientist Parikshit Sohoni have designed the Fifth Sense, to enable real-time communication for the hearing- and speech-impaired, this innovation could redefine disability inclusion in India’s classrooms, clinics, and workplaces.

Updated on: 19 June 2023

sector

Sector

Healthcare
education

Solution

Assistive Health
Healthcare

Technology

AI
space

State of Origin

Maharashtra
Fifth Sense is a revolutionary communication-enabling wearable designed for individuals with complete hearing and speech impairment, translating Indian Sign Language gestures into spoken English and vice versa. Developed by GlovatriX Private Limited, this device aligns with India’s national priorities for accessibility and inclusivity, supporting initiatives like the Accessible India Campaign and Digital India. With applications in various sectors from education to healthcare, Fifth Sense aims to mainstream assistive technologies in India, paving the way for a more inclusive and equitable society.

Impact Metrics

98% accuracy

in understanding and translation.

50 gestures

enabled for real-time communication.

 

Hearing loss is the world’s most prevalent sensory disability, affecting over 430 million people globally, according to the World Health Organization (WHO). In India, with an estimated 63 million people experiencing significant auditory impairment, the need for accessible solutions is pressing. Yet only 10% of those who need assistive technologies (AT) globally have access to them (WHO GReAT Report 2022).

Fifth Sense addresses this disparity. Unlike traditional aids such as hearing devices or cochlear implants—which are limited to users with residual hearing—this device is designed for individuals with complete hearing and speech impairment. It belongs to the third, and most advanced, class of AT: communication-enabling wearables. The system comprises motion-sensing gloves or a smartwatch, translating Indian Sign Language (ISL) gestures into spoken English, and vice versa, through an embedded microphone and display screen.

Gesture-to-speech: AI meets ergonomics

The core technology of Fifth Sense lies in its motion capture sensors—six per hand—that collect linear and rotational data to decode each sign gesture. This data feeds into an AI engine trained with gesture sets aligned to India’s standardised ISL vocabulary, currently comprising 20,000 officially recognised signs.

But the innovation doesn’t stop at translation. Fifth Sense also applies Natural Language Processing (NLP) to reorder gestures into grammatically correct English sentences. Simultaneously, reverse communication is enabled through speech-to-text and image conversion for the hearing-impaired user, making the device bi-directional and eliminating dependence on interpreters.

Aligning With national priorities and development frameworks

Fifth Sense represents a strong alignment with India’s Accessible India Campaign (Sugamya Bharat Abhiyan), which seeks to enhance universal accessibility in communication, education, and employment for persons with disabilities. By enabling barrier-free interaction, the device also supports goals under:

  • Digital India: Facilitating inclusive tech innovation at scale, even in offline or low-infrastructure contexts.

  • Samagra Shiksha Abhiyan and NEP 2020: Enabling equitable classroom participation and digital learning for students with disabilities.

  • Ayushman Bharat Digital Mission: Promoting accessible health services through privacy-preserving, interpreter-free medical interactions.

  • Start-up India and Make in India: Developed entirely in India by GlovatriX Private Limited, Fifth Sense embodies citizen-led innovation with global scalability.

  • Viksit Bharat@2047: Supporting inclusive, technology-driven solutions that promote dignity, independence, and equity.

From restaurants to research centres: Ground-level impact

Pilot deployments have begun in restaurants like Terrasinne Kitchen and Bar in Pune and Mirchi & Mime in Mumbai, where staff with hearing impairments now use Fifth Sense to manage custom orders and complex interactions—eliminating the need for third-party managers.

In educational settings, early surveys at CR Ranganathan College for the Deaf in Pune revealed that students could comprehend only 30% of what teachers said due to lack of eye contact and real-time translation. Fifth Sense could dramatically improve such learning outcomes.

Scaling the future of inclusive tech

With a planned launch price of ₹25,000 and initial deployment focused on workplace and educational settings, Fifth Sense is building a robust case for mainstreaming assistive technologies in India. As algorithms expand to support local languages and domain-specific vocabulary, the device is poised for wide application—from public service counters and emergency response, to courtrooms and mental health services.

By addressing an invisible disability with precision AI and deeply empathetic design, Fifth Sense isn’t just a device—it’s a statement. A statement that inclusion is not an afterthought but an innovation imperative.

Share Your Story Today, Shape Viksit Bharat Tomorrow

Got an idea, innovation, or experience that's making a difference? Share your story now and ignite India's transformation because your voice can drive the future forward!

BUILD YOUR OWN

faq-msg-icon

BUILD YOUR OWN

How can I implement this innovation effectively?
How is this innovation being adopted around the world?
Where else could this innovation make an impact?
Who has seen real results from using this innovation?
What insights do experts share about this innovation?
What policies support or influence this innovation?
How could this innovation evolve in the future?
Is this innovation accessible and inclusive for everyone?
How can I contribute to or participate in this innovation?
What resources can help me explore this innovation further?

If you would like to know more about this innovation, fill this form to contact the innovator.