The interrelationship between the face and vocal tract configuration during audiovisual speech.

ABSTRACT: It is well established that speech perception is improved when we are able to see the speaker talking along with hearing their voice, especially when the speech is noisy. While we have a good understanding of where speech integration occurs in the brain, it is unclear how visual and auditory cues are combined to improve speech perception. One suggestion is that integration can occur as both visual and auditory cues arise from a common generator: the vocal tract. Here, we investigate whether facial and vocal tract movements are linked during speech production by comparing videos of the face and fast magnetic resonance (MR) image sequences of the vocal tract. The joint variation in the face and vocal tract was extracted using an application of principal components analysis (PCA), and we demo

SUBMITTER: Scholes C 

PROVIDER: S-EPMC7768679 | biostudies-literature | 2020 Dec

REPOSITORIES: biostudies-literature