Dataset Information

Generalizable spelling using a speech neuroprosthesis in an individual with severe limb and vocal paralysis.

ABSTRACT: Neuroprostheses have the potential to restore communication to people who cannot speak or type due to paralysis. However, it is unclear if silent attempts to speak can be used to control a communication neuroprosthesis. Here, we translated direct cortical signals in a clinical-trial participant (ClinicalTrials.gov; NCT03698149) with severe limb and vocal-tract paralysis into single letters to spell out full sentences in real time. We used deep-learning and language-modeling techniques to decode letter sequences as the participant attempted to silently spell using code words that represented the 26 English letters (e.g. "alpha" for "a"). We leveraged broad electrode coverage beyond speech-motor cortex to include supplemental control signals from hand cortex and complementary information from low- and high-frequency signal components to improve decoding accuracy. We decoded sentences using words from a 1,152-word vocabulary at a median character error rate of 6.13% and speed of 29.4 characters per minute. In offline simulations, we showed that our approach generalized to large vocabularies containing over 9,000 words (median character error rate of 8.23%). These results illustrate the clinical viability of a silently controlled speech neuroprosthesis to generate sentences from a large vocabulary through a spelling-based approach, complementing previous demonstrations of direct full-word decoding.

SUBMITTER: Metzger SL

PROVIDER: S-EPMC9643551 | biostudies-literature | 2022 Nov

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Generalizable spelling using a speech neuroprosthesis in an individual with severe limb and vocal paralysis.

Metzger Sean L SL Liu Jessie R JR Moses David A DA Dougherty Maximilian E ME Seaton Margaret P MP Littlejohn Kaylo T KT Chartier Josh J Anumanchipalli Gopala K GK Tu-Chan Adelyn A Ganguly Karunesh K Chang Edward F EF

Nature communications 20221108 1

Neuroprostheses have the potential to restore communication to people who cannot speak or type due to paralysis. However, it is unclear if silent attempts to speak can be used to control a communication neuroprosthesis. Here, we translated direct cortical signals in a clinical-trial participant (ClinicalTrials.gov; NCT03698149) with severe limb and vocal-tract paralysis into single letters to spell out full sentences in real time. We used deep-learning and language-modeling techniques to decode ...[more]

PMID: 36347863

Similar Datasets

Project description:BackgroundImplantable brain-computer interfaces (BCIs), functioning as motor neuroprostheses, have the potential to restore voluntary motor impulses to control digital devices and improve functional independence in patients with severe paralysis due to brain, spinal cord, peripheral nerve or muscle dysfunction. However, reports to date have had limited clinical translation.MethodsTwo participants with amyotrophic lateral sclerosis (ALS) underwent implant in a single-arm, open-label, prospective, early feasibility study. Using a minimally invasive neurointervention procedure, a novel endovascular Stentrode BCI was implanted in the superior sagittal sinus adjacent to primary motor cortex. The participants undertook machine-learning-assisted training to use wirelessly transmitted electrocorticography signal associated with attempted movements to control multiple mouse-click actions, including zoom and left-click. Used in combination with an eye-tracker for cursor navigation, participants achieved Windows 10 operating system control to conduct instrumental activities of daily living (IADL) tasks.ResultsUnsupervised home use commenced from day 86 onwards for participant 1, and day 71 for participant 2. Participant 1 achieved a typing task average click selection accuracy of 92.63% (100.00%, 87.50%-100.00%) (trial mean (median, Q1-Q3)) at a rate of 13.81 (13.44, 10.96-16.09) correct characters per minute (CCPM) with predictive text disabled. Participant 2 achieved an average click selection accuracy of 93.18% (100.00%, 88.19%-100.00%) at 20.10 (17.73, 12.27-26.50) CCPM. Completion of IADL tasks including text messaging, online shopping and managing finances independently was demonstrated in both participants.ConclusionWe describe the first-in-human experience of a minimally invasive, fully implanted, wireless, ambulatory motor neuroprosthesis using an endovascular stent-electrode array to transmit electrocorticography signals from the motor cortex for multiple command control of digital devices in two participants with flaccid upper limb paralysis.

Dataset Information

Generalizable spelling using a speech neuroprosthesis in an individual with severe limb and vocal paralysis.

Publications

Generalizable spelling using a speech neuroprosthesis in an individual with severe limb and vocal paralysis.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets