Advancements in artificial intelligence (AI) and digital technology are offering new opportunities for individuals with hearing impairments to more fully participate in cultural and social events. Beverly Biderman, a Toronto resident with significant hearing loss since childhood, has shared her experience using so-called “captioning glasses” that convert speech to text in real time, enabling her to attend talks, plays, and concerts with greater ease and accessibility.
Biderman has relied on cochlear implants to manage her hearing loss, but she described longstanding challenges when engaging with live performances or spoken events. Common accommodations such as wheelchair access or sign language interpretation often did not meet her needs. Assistive listening devices were frequently unreliable, and traditional solutions like reading scripts in advance or lip-reading in front-row seats were burdensome and insufficient.
The captioning glasses she uses are equipped with advanced digital microphones and pair wirelessly with an app on her smartphone. The app leverages AI to rapidly and accurately transcribe speech, displaying the text on the lower portion of the glasses’ lenses as transparent captions. This technology allows the wearer to both see the environment and read the transcriptions simultaneously, providing a more complete sensory experience.
“Weary of depending on uncertain accommodations, I can now attend events like anyone who can hear,” Biderman said, highlighting the profound emotional impact of being able to access dialogue and lyrics in real time. She recounted attending a play about Leonard Cohen, where she was able to follow every spoken word and song lyric for the first time, an experience that brought back vivid memories of past frustration and enjoyment.
Beyond aiding those with hearing loss, some models of captioning glasses incorporate additional features such as real-time translation between languages, potentially benefiting travelers and others in multilingual settings. Biderman expressed anticipation about trying this translation function during an upcoming trip.
However, the integration of AI in this format also raises privacy and ethical concerns. Certain devices produced by major technology companies offer capabilities to record video unobtrusively, which could be misused, for instance, by capturing footage without subjects' knowledge or consent. Proponents note that similar technology can assist visually impaired users by converting visual information to auditory output, highlighting both positive applications and potential risks.
The emergence of AI-powered captioning glasses represents a significant step toward greater inclusion for individuals with hearing impairments while prompting discussion about balancing technological benefits with privacy considerations.