Dynamical predictive coding with reservoir computing performs noise-robust multi-sensory speech recognition.

ABSTRACT: Multi-sensory integration is a perceptual process through which the brain synthesizes a unified perception by integrating inputs from multiple sensory modalities. A key issue is understanding how the brain performs multi-sensory integrations using a common neural basis in the cortex. A cortical model based on reservoir computing has been proposed to elucidate the role of recurrent connectivity among cortical neurons in this process. Reservoir computing is well-suited for time series processing, such as speech recognition. This inquiry focuses on extending a reservoir computing-based cortical model to encompass multi-sensory integration within the cortex. This research introduces a dynamical model of multi-sensory speech recognition, leveraging predictive coding combined with reservoir comp

SUBMITTER: Yonemura Y 

PROVIDER: S-EPMC11456454 | biostudies-literature | 2024

REPOSITORIES: biostudies-literature