Association between different sensory modalities based on concurrent time series data obtained by a collaborative reservoir computing model.

ABSTRACT: Humans perceive the external world by integrating information from different modalities, obtained through the sensory organs. However, the aforementioned mechanism is still unclear and has been a subject of widespread interest in the fields of psychology and brain science. A model using two reservoir computing systems, i.e., a type of recurrent neural network trained to mimic each other's output, can detect stimulus patterns that repeatedly appear in a time series signal. We applied this model for identifying specific patterns that co-occur between information from different modalities. The model was self-organized by specific fluctuation patterns that co-occurred between different modalities, and could detect each fluctuation pattern. Additionally, similarly to the case where perception i

SUBMITTER: Kanemura I 

PROVIDER: S-EPMC9813012 | biostudies-literature | 2023 Jan

REPOSITORIES: biostudies-literature