A bilingual speech neuroprosthesis driven by cortical articulatory representations shared between languages.

ABSTRACT: Advancements in decoding speech from brain activity have focused on decoding a single language. Hence, the extent to which bilingual speech production relies on unique or shared cortical activity across languages has remained unclear. Here, we leveraged electrocorticography, along with deep-learning and statistical natural-language models of English and Spanish, to record and decode activity from speech-motor cortex of a Spanish-English bilingual with vocal-tract and limb paralysis into sentences in either language. This was achieved without requiring the participant to manually specify the target language. Decoding models relied on shared vocal-tract articulatory representations across languages, which allowed us to build a syllable classifier that generalized across a shared set of Engli

SUBMITTER: Silva AB 

PROVIDER: S-EPMC11554235 | biostudies-literature | 2024 Aug

REPOSITORIES: biostudies-literature