A high-performance neuroprosthesis for speech decoding and avatar control.

ABSTRACT: Speech neuroprostheses have the potential to restore communication to people living with paralysis, but naturalistic speed and expressivity are elusive¹. Here we use high-density surface recordings of the speech cortex in a clinical-trial participant with severe limb and vocal paralysis to achieve high-performance real-time decoding across three complementary speech-related output modalities: text, speech audio and facial-avatar animation. We trained and evaluated deep-learning models using neural data collected as the participant attempted to silently speak sentences. For text, we demonstrate accurate and rapid large-vocabulary decoding with a median rate of 78 words per minute and median word error rate of 25%. For speech audio, we demonstrate intelligible and rapid speech syn

SUBMITTER: Metzger SL 

PROVIDER: S-EPMC10826467 | biostudies-literature | 2023 Aug

REPOSITORIES: biostudies-literature