Project will push the boundaries of real-time brain-to-speech decoding with artificial intelligence algorithms and a miniaturized, wireless device.
Geneva, Switzerland – A research consortium led by the UMC Utrecht Brain Center (the Netherlands) in collaboration with Graz University of Technology (Austria), the Wyss Center for Bio and Neuroengineering (Switzerland) and CorTec (Germany) is to receive a grant through the European Innovation Council (EIC) Pathfinder Challenge mechanism.
The researchers aim to develop a unique fully implantable Brain-Computer Interface (BCI) system for people with locked-in syndrome (LIS) – a condition in which paralysis severely limits communication. The BCI will be unprecedented in its small size, with wireless broadband data transmission, and powered via induction so will not require batteries. Suitable for use at home, it will be capable of decoding speech in real-time to enable people with LIS to communicate with family and caregivers.
The project will further develop the Wyss Center’s fully implantable wireless ABILITY system to connect to customized electrocorticography (ECoG) electrode grids, developed by CorTec, that detect brain signals from the surface of the brain. The ambitious timeline aims for full implant development and verification in the first two years of the project, with the second two years focusing on clinical studies and algorithm improvements to restore communication in locked-in patients with amyotrophic lateral sclerosis (ALS) or brainstem stroke.
ALS is a progressive neurodegenerative disease in which people gradually lose the ability to move and talk, eventually all means of communication are lost, leaving patients isolated. Brainstem stroke can render people unable to speak or move, without recovery.
“As a first step to enable the patients to interact with the system, we will set up the decoding for mouse clicks and cursor control from intended movements, which we have shown to be feasible in previous research,” explains Prof. Dr. Gernot Müller-Putz, Head of the Institute of Neural Engineering and its associated Laboratory of Brain-Computer Interfaces at the Graz University of Technology.
“Our BCI system will go far beyond current technology,” says Prof. Nick Ramsey from the UMC Utrecht Brain Center, the Netherlands, who coordinates the project. “We want to create a sustainable, high-resolution BCI by combining state-of-the-art hardware and software based on artificial intelligence (AI).”
“This new project builds on the promising preliminary data from our clinical study enabling communication with a completely locked-in participant, and our pre-clinical study currently underway with the wireless, implantable ABILITY device.” said Dr. Jonas Zimmermann, Senior Neuroscientist at the Wyss Center. “In this project we will record from a larger area of the brain and explore new decoding algorithms that have the potential to tackle important clinical and social needs for people with ALS but also for those with other neurological conditions that impair movement and communication.”
Dr. Tracy Laabs, Chief Development Officer at the Wyss Center, is excited: “After several years of prototype developments, this project will allow us to make the crucial final steps that will bring our system to the patient”.
The BCI system will be trialed in two people with locked-in syndrome in the home environment. The brain surface-lining electrode grids will collect high resolution neural data that will be decoded using AI algorithms to translate the brain signals to computer speech in real-time.
The research project ‘Intracranial Neurotelemetry to Restore Communication’ (INTRECOM) is part of the EIC Pathfinder Challenge program in which the European Innovation Council supports visionary, entrepreneurial researchers who have bold ideas for radically new technologies. The Swiss participants receive support from the Swiss State Secretariat for Education, Research and Innovation (SERI).