Cue integration in categorical tasks: insights from audio-visual speech perception.

ABSTRACT: Previous cue integration studies have examined continuous perceptual dimensions (e.g., size) and have shown that human cue integration is well described by a normative model in which cues are weighted in proportion to their sensory reliability, as estimated from single-cue performance. However, this normative model may not be applicable to categorical perceptual dimensions (e.g., phonemes). In tasks defined over categorical perceptual dimensions, optimal cue weights should depend not only on the sensory variance affecting the perception of each cue but also on the environmental variance inherent in each task-relevant category. Here, we present a computational and experimental investigation of cue integration in a categorical audio-visual (articulatory) speech perception task. Our results s

SUBMITTER: Bejjanki VR 

PROVIDER: S-EPMC3102664 | biostudies-literature | 2011

REPOSITORIES: biostudies-literature