Real-Time Control of an Articulatory-Based Speech Synthesizer for Brain Computer Interfaces.

ABSTRACT: Restoring natural speech in paralyzed and aphasic people could be achieved using a Brain-Computer Interface (BCI) controlling a speech synthesizer in real-time. To reach this goal, a prerequisite is to develop a speech synthesizer producing intelligible speech in real-time with a reasonable number of control parameters. We present here an articulatory-based speech synthesizer that can be controlled in real-time for future BCI applications. This synthesizer converts movements of the main speech articulators (tongue, jaw, velum, and lips) into intelligible speech. The articulatory-to-acoustic mapping is performed using a deep neural network (DNN) trained on electromagnetic articulography (EMA) data recorded on a reference speaker synchronously with the produced speech signal. This DNN is the

SUBMITTER: Bocquelet F 

PROVIDER: S-EPMC5120792 | biostudies-literature | 2016 Nov

REPOSITORIES: biostudies-literature