Scientists have developed a brain-computer interface (BCI) that enables people with paralysis to communicate through a digital avatar by simultaneously decoding speech and associated gestures from a single brain implant. The breakthrough represents a significant advance in neurotechnology aimed at restoring multiple forms of communication for individuals who have lost the ability to speak.

The research, led by Samantha Brosler at the University of California, San Francisco (UCSF), was detailed in a paper published in Nature Neuroscience. The system employs machine learning to interpret brainwaves into words and a limited set of gestures, such as nodding, shaking the head, waving, shrugging, and giving a thumbs-up. In the study, the device successfully decoded speech and up to 10 gestures in one participant, and four in another. Brosler highlighted the importance of gestures as they can convey meaning, emphasis, emotion, and context that complement or sometimes replace spoken language.

This initial proof-of-concept research aims to expand the system’s capabilities to include a larger vocabulary and more continuous movements across the body, which could offer a richer communication experience. The technology holds potential for millions of people with intact cognitive function who have impaired speech due to conditions such as stroke, amyotrophic lateral sclerosis (ALS), or other neurological disorders. Researchers also foresee potential applications for patients with cerebral palsy or autism who face challenges with vocalization.

The field of communication prostheses is attracting growing attention and investment. Companies like Neuralink, founded by Elon Musk, and Precision Neuroscience are working on similar brain interface technologies. In parallel, Echo Neurotechnologies, co-founded by Edward Chang—who also leads the UCSF research team—is developing brain implant hardware that supports these applications.

Experts have noted the significance of the UCSF team’s findings in understanding how the brain processes speech and gestures. Richard Rosch, a brain dynamics specialist at King’s College London, pointed out that the research demonstrates considerable overlap in the brain regions involved in speech and hand gestures. This suggests that brain functions may be more integrated than previously believed, rather than strictly compartmentalized.

However, Rosch cautioned that the technology remains far from widespread use due to the need for invasive brain surgery and limitations in decoding movements on the side of the body opposite the implant. Scott Wellington, a researcher at the Bath Institute for the Augmented Human, University of Bath, acknowledged the promising nature of the work but emphasized challenges remain in customizing the system for individual patients and scaling it as a standard assistive device.

While still in the early stages, the new research marks a notable step toward more versatile communication aids for those affected by severe paralysis and speech loss.