Dataset Information

Intelligibility of audiovisual sentences drives multivoxel response patterns in human superior temporal cortex.

ABSTRACT: Regions of the human posterior superior temporal gyrus and sulcus (pSTG/S) respond to the visual mouth movements that constitute visual speech and the auditory vocalizations that constitute auditory speech, and neural responses in pSTG/S may underlie the perceptual benefit of visual speech for the comprehension of noisy auditory speech. We examined this possibility through the lens of multivoxel pattern responses in pSTG/S. BOLD fMRI data was collected from 22 participants presented with speech consisting of English sentences presented in five different formats: visual-only; auditory with and without added auditory noise; and audiovisual with and without auditory noise. Participants reported the intelligibility of each sentence with a button press and trials were sorted post-hoc into those that were more or less intelligible. Response patterns were measured in regions of the pSTG/S identified with an independent localizer. Noisy audiovisual sentences with very similar physical properties evoked very different response patterns depending on their intelligibility. When a noisy audiovisual sentence was reported as intelligible, the pattern was nearly identical to that elicited by clear audiovisual sentences. In contrast, an unintelligible noisy audiovisual sentence evoked a pattern like that of visual-only sentences. This effect was less pronounced for noisy auditory-only sentences, which evoked similar response patterns regardless of intelligibility. The successful integration of visual and auditory speech produces a characteristic neural signature in pSTG/S, highlighting the importance of this region in generating the perceptual benefit of visual speech.

SUBMITTER: Rennig J

PROVIDER: S-EPMC8819942 | biostudies-literature | 2022 Feb

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Intelligibility of audiovisual sentences drives multivoxel response patterns in human superior temporal cortex.

Rennig Johannes J Beauchamp Michael S MS

NeuroImage 20211211

Regions of the human posterior superior temporal gyrus and sulcus (pSTG/S) respond to the visual mouth movements that constitute visual speech and the auditory vocalizations that constitute auditory speech, and neural responses in pSTG/S may underlie the perceptual benefit of visual speech for the comprehension of noisy auditory speech. We examined this possibility through the lens of multivoxel pattern responses in pSTG/S. BOLD fMRI data was collected from 22 participants presented with speech ...[more]

PMID: 34906712

Similar Datasets

Project description:Disrupted synchronized oscillatory firing of pyramidal neuronal networks in the cerebral cortex in the gamma frequency band (i.e., 30-100 Hz) mediates many of the cognitive deficits and symptoms of schizophrenia. In fact, the density of dendritic spines and the average somal area of pyramidal neurons in layer 3 of the cerebral cortex, which mediate both long-range (associational) and local (intrinsic) corticocortical connections, are decreased in subjects with this illness. To explore the molecular pathophysiology of pyramidal neuronal dysfunction, we extracted ribonucleic acid (RNA) from laser-captured pyramidal neurons from layer 3 of Brodmann's area 42 of the superior temporal gyrus (STG) from postmortem brains from schizophrenia and normal control subjects. We then profiled the messenger RNA (mRNA) expression of these neurons, using microarray technology. We identified 1331 mRNAs that were differentially expressed in schizophrenia, including genes that belong to the transforming growth factor beta (TGF-?) and the bone morphogenetic proteins (BMPs) signaling pathways. Disturbances of these signaling mechanisms may in part contribute to the altered expression of other genes found to be differentially expressed in this study, such as those that regulate extracellular matrix (ECM), apoptosis, and cytoskeletal and synaptic plasticity. In addition, we identified 10 microRNAs (miRNAs) that were differentially expressed in schizophrenia; enrichment analysis of their predicted gene targets revealed signaling pathways and gene networks that were found by microarray to be dysregulated, raising an interesting possibility that dysfunction of pyramidal neurons in schizophrenia may in part be mediated by a concerted dysregulation of gene network functions as a result of the altered expression of a relatively small number of miRNAs. Taken together, findings of this study provide a neurobiological framework within which specific hypotheses about the molecular mechanisms of pyramidal cell dysfunction in schizophrenia can be formulated.

Dataset Information

Intelligibility of audiovisual sentences drives multivoxel response patterns in human superior temporal cortex.

Publications

Intelligibility of audiovisual sentences drives multivoxel response patterns in human superior temporal cortex.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets