Animated virtual characters to explore audio-visual speech in controlled and naturalistic environments.

ABSTRACT: Natural speech is processed in the brain as a mixture of auditory and visual features. An example of the importance of visual speech is the McGurk effect and related perceptual illusions that result from mismatching auditory and visual syllables. Although the McGurk effect has widely been applied to the exploration of audio-visual speech processing, it relies on isolated syllables, which severely limits the conclusions that can be drawn from the paradigm. In addition, the extreme variability and the quality of the stimuli usually employed prevents comparability across studies. To overcome these limitations, we present an innovative methodology using 3D virtual characters with realistic lip movements synchronized on computer-synthesized speech. We used commercially accessible and affordable

SUBMITTER: Theze R 

PROVIDER: S-EPMC7511320 | biostudies-literature | 2020 Sep

REPOSITORIES: biostudies-literature