Decoding of the other's focus of attention by a temporal cortex module.
Ontology highlight
ABSTRACT:
SUBMITTER: Ramezanpour H
PROVIDER: S-EPMC7007515 | biostudies-literature | 2020 Feb
REPOSITORIES: biostudies-literature
Publications
Decoding of the other's focus of attention by a temporal cortex module.
Ramezanpour Hamidreza H Thier Peter P
Proceedings of the National Academy of Sciences of the United States of America 20200121 5
Faces attract the observer's attention toward objects and locations of interest for the other, thereby allowing the two agents to establish joint attention. Previous work has delineated a network of cortical "patches" in the macaque cortex, processing faces, eventually also extracting information on the other's gaze direction. Yet, the neural mechanism that links information on gaze direction, guiding the observer's attention to the relevant object, has remained elusive. Here we present electrop ...[more]
Similar Datasets
Project description:Recognizing objects in cluttered scenes requires attentional mechanisms to filter out distracting information. Previous studies have found several physiological correlates of attention in visual cortex, including larger responses for attended objects. However, it has been unclear whether these attention-related changes have a large impact on information about objects at the neural population level. To address this question, we trained monkeys to covertly deploy their visual attention from a central fixation point to one of three objects displayed in the periphery, and we decoded information about the identity and position of the objects from populations of ? 200 neurons from the inferior temporal cortex using a pattern classifier. The results show that before attention was deployed, information about the identity and position of each object was greatly reduced relative to when these objects were shown in isolation. However, when a monkey attended to an object, the pattern of neural activity, represented as a vector with dimensionality equal to the size of the neural population, was restored toward the vector representing the isolated object. Despite this nearly exclusive representation of the attended object, an increase in the salience of nonattended objects caused "bottom-up" mechanisms to override these "top-down" attentional enhancements. The method described here can be used to assess which attention-related physiological changes are directly related to object recognition, and should be helpful in assessing the role of additional physiological changes in the future.
| S-EPMC3102370 | biostudies-literature
Project description:Theory of Mind (ToM) is involved in experiencing the mental states and/or emotions of others. A further distinction can be drawn between emotion and perception/sensation. We investigated the mechanisms engaged when participants' attention is driven toward specific states. Accordingly, 21 right-handed healthy individuals performed a modified ToM task in which they reflected about someone's emotion or someone's body sensation, while they were in a functional magnetic resonance imaging scanner. The analysis of brain activity evoked by this task suggests that the two conditions engage a widespread common network previously found involved in affective ToM (temporo-parietal junction (TPJ), parietal cortex, dorso-lateral prefrontal cortex (DLPFC), medial- prefrontal cortex (MPFC), Insula). Critically, the key brain result is that body sensation implicates selectively ventromedial prefrontal cortex (VMPFC). The current findings suggest that only paying attention to the other's body sensations modulates a self-related representation (VMPFC).
| S-EPMC9949495 | biostudies-literature
Project description:Meditation practices are often used to cultivate interoception or internally-oriented attention to bodily sensations, which may improve health via cognitive and emotional regulation of bodily signals. However, it remains unclear how meditation impacts internal attention (IA) states due to lack of measurement tools that can objectively assess mental states during meditation practice itself, and produce time estimates of internal focus at individual or group levels. To address these measurement gaps, we tested the feasibility of applying multi-voxel pattern analysis (MVPA) to single-subject fMRI data to: (1) learn and recognize internal attentional states relevant for meditation during a directed IA task; and (2) decode or estimate the presence of those IA states during an independent meditation session. Within a mixed sample of experienced meditators and novice controls (N = 16), we first used MVPA to develop single-subject brain classifiers for five modes of attention during an IA task in which subjects were specifically instructed to engage in one of five states [i.e., meditation-related states: breath attention, mind wandering (MW), and self-referential processing, and control states: attention to feet and sounds]. Using standard cross-validation procedures, MVPA classifiers were trained in five of six IA blocks for each subject, and predictive accuracy was tested on the independent sixth block (iterated until all volumes were tested, N = 2,160). Across participants, all five IA states were significantly recognized well above chance (>41% vs. 20% chance). At the individual level, IA states were recognized in most participants (87.5%), suggesting that recognition of IA neural patterns may be generalizable for most participants, particularly experienced meditators. Next, for those who showed accurate IA neural patterns, the originally trained classifiers were applied to a separate meditation run (10-min) to make an inference about the percentage time engaged in each IA state (breath attention, MW, or self-referential processing). Preliminary group-level analyses demonstrated that during meditation practice, participants spent more time attending to breath compared to MW or self-referential processing. This paradigm established the feasibility of using MVPA classifiers to objectively assess mental states during meditation at the participant level, which holds promise for improved measurement of internal attention states cultivated by meditation.
| S-EPMC7483757 | biostudies-literature
Project description:Ventral temporal cortex (VTC) is the latest stage of the ventral "what" visual pathway, which is thought to code the identity of a stimulus regardless of its position or size [1, 2]. Surprisingly, recent studies show that position information can be decoded from VTC [3-5]. However, the computational mechanisms by which spatial information is encoded in VTC are unknown. Furthermore, how attention influences spatial representations in human VTC is also unknown because the effect of attention on spatial representations has only been examined in the dorsal "where" visual pathway [6-10]. Here, we fill these significant gaps in knowledge using an approach that combines functional magnetic resonance imaging and sophisticated computational methods. We first develop a population receptive field (pRF) model [11, 12] of spatial responses in human VTC. Consisting of spatial summation followed by a compressive nonlinearity, this model accurately predicts responses of individual voxels to stimuli at any position and size, explains how spatial information is encoded, and reveals a functional hierarchy in VTC. We then manipulate attention and use our model to decipher the effects of attention. We find that attention to the stimulus systematically and selectively modulates responses in VTC, but not early visual areas. Locally, attention increases eccentricity, size, and gain of individual pRFs, thereby increasing position tolerance. However, globally, these effects reduce uncertainty regarding stimulus location and actually increase position sensitivity of distributed responses across VTC. These results demonstrate that attention actively shapes and enhances spatial representations in the ventral visual pathway.
| S-EPMC4348205 | biostudies-literature
Project description:The present study investigates the temporal dynamics of the brain activity predicting the sensory outcomes of observed hand-object interactions of others. Participants are presented with pictures of a hand grasping or withdrawing from noxious and neutral objects. They are then asked to judge whether this hand-object interaction causes painful consequences. In the early stages of stimulus processing, the effect of action was observed in the event-related potential components N1 and N2. Significant interactions of action × object were observed in the later components P3 and late positive potential (LPP): only when the object was noxious, the action "grasp" elicited a significantly larger amplitude than the action "withdrawal". These results suggest that: on the one hand, when observing the hand-object interaction from the third-person perspective, the action type of others can be processed in an automatic style. On the other hand, integrating the information of action and object to predict the sensory consequence of this interaction is a top-down, cognitive controlled processing. The current findings are different from previous studies using first-person perspective visual stimuli which support that the processing of hand-object interaction is rapid and automatic.
| S-EPMC5118620 | biostudies-literature
Project description:Prospective memory (PM) denotes the function to realize intentions after a delay while being immersed in distracting ongoing (OG) activity. Here, we scrutinize the often-reported involvement of rostral prefrontal cortex (rPFC; approximating Brodmann area 10) in such situations: This region might mediate attention between external stimuli and the internally maintained intention, that is, between stimulus-oriented (SO) and stimulus-independent (SI) processing. Using functional magnetic resonance imaging (fMRI) we orthogonally crossed 1) PM versus OG activity only, with 2) SO versus SI attention. In support of the hypothesis, common regions of medial rPFC exhibited greater blood oxygen level-dependent (BOLD) signal for the contrasts of both OG task only versus PM and SO versus SI attending. However, activation related to the former contrast extended more superiorly, suggesting a functional gradient along a dorsal-ventral axis within this region. Moreover, region-of-interest analyses revealed that PM versus OG task only was associated with greater BOLD signal in left lateral rPFC, reflecting the requirement to maintain delayed intentions. Distinct aspects of this region were also transiently engaged at transitions between SO and SI conditions. These results are consistent with the hypothesis that some of the rostral prefrontal signal changes associated with PM performance reflect relative differences in SO versus SI processing.
| S-EPMC3388891 | biostudies-other
Project description:Attention is an indispensable component of active vision. Contrary to the widely accepted notion that temporal cortex processing primarily focusses on passive object recognition, a series of very recent studies emphasize the role of temporal cortex structures, specifically the superior temporal sulcus (STS) and inferotemporal (IT) cortex, in guiding attention and implementing cognitive programs relevant for behavioral tasks. The goal of this theoretical paper is to advance the hypothesis that the temporal cortex attention network (TAN) entails necessary components to actively participate in attentional control in a flexible task-dependent manner. First, we will briefly discuss the general architecture of the temporal cortex with a focus on the STS and IT cortex of monkeys and their modulation with attention. Then we will review evidence from behavioral and neurophysiological studies that support their guidance of attention in the presence of cognitive control signals. Next, we propose a mechanistic framework for executive control of attention in the temporal cortex. Finally, we summarize the role of temporal cortex in implementing cognitive programs and discuss how they contribute to the dynamic nature of visual attention to ensure flexible behavior.
| S-EPMC9846471 | biostudies-literature
Project description:Decoding brain cognitive states from neuroimaging signals is an important topic in neuroscience. In recent years, deep neural networks (DNNs) have been recruited for multiple brain state decoding and achieved good performance. However, the open question of how to interpret the DNN black box remains unanswered. Capitalizing on advances in machine learning, we integrated attention modules into brain decoders to facilitate an in-depth interpretation of DNN channels. A four-dimensional (4D) convolution operation was also included to extract temporo-spatial interaction within the fMRI signal. The experiments showed that the proposed model obtains a very high accuracy (97.4%) and outperforms previous researches on the seven different task benchmarks from the Human Connectome Project (HCP) dataset. The visualization analysis further illustrated the hierarchical emergence of task-specific masks with depth. Finally, the model was retrained to regress individual traits within the HCP and to classify viewing images from the BOLD5000 dataset, respectively. Transfer learning also achieves good performance. Further visualization analysis shows that, after transfer learning, low-level attention masks remained similar to the source domain, whereas high-level attention masks changed adaptively. In conclusion, the proposed 4D model with attention module performed well and facilitated interpretation of DNNs, which is helpful for subsequent research.
| S-EPMC9057093 | biostudies-literature
Project description:Event-related potentials (ERPs) are used extensively to investigate the neural mechanisms of attention control and selection. The univariate ERP approach, however, has left important questions inadequately answered. We addressed two questions by applying multivariate pattern classification to multichannel ERPs in two cued visual spatial attention experiments (N = 56): (a) impact of cueing strategies (instructional vs. probabilistic) on attention control and selection and (b) neural and behavioral effects of individual differences. Following cue onset, the decoding accuracy (cue left vs. cue right) began to rise above chance level earlier and remained higher in instructional cueing (~80 ms) than in probabilistic cueing (~160 ms), suggesting that unilateral attention focus leads to earlier and more distinct formation of the attention control set. A similar temporal sequence was also found for target-related processing (cued target vs. uncued target), suggesting earlier and stronger attention selection under instructional cueing. Across the two experiments: (a) individuals with higher cue-related decoding accuracy showed higher magnitude of attentional modulation of target-evoked N1 amplitude, suggesting that better formation of anticipatory attentional state leads to stronger modulation of target processing, and (b) individuals with higher target-related decoding accuracy showed faster reaction times (or larger cueing effects), suggesting that stronger selection of task-relevant information leads to better behavioral performance. Taken together, multichannel ERPs combined with machine learning decoding yields new insights into attention control and selection that complement the univariate ERP approach, and along with the univariate ERP approach, provides a more comprehensive methodology to the study of visual spatial attention.
| S-EPMC7469865 | biostudies-literature
Project description:Spatial neglect is a common clinical syndrome involving disruption of the brain's attention-related circuitry, including the dorsocaudal temporal cortex. In macaques, the attention deficits associated with neglect can be readily modeled, but the absence of evidence for temporal cortex involvement has suggested a fundamental difference from humans. To map the neurological expression of neglect-like attention deficits in macaques, we measured attention-related fMRI activity across the cerebral cortex during experimental induction of neglect through reversible inactivation of the superior colliculus and frontal eye fields. During inactivation, monkeys exhibited hallmark attentional deficits of neglect in tasks using either motion or non-motion stimuli. The behavioral deficits were accompanied by marked reductions in fMRI attentional modulation that were strongest in a small region on the floor of the superior temporal sulcus; smaller reductions were also found in frontal eye fields and dorsal parietal cortex. Notably, direct inactivation of the mid-superior temporal sulcus (STS) cortical region identified by fMRI caused similar neglect-like spatial attention deficits. These results identify a putative macaque homolog to temporal cortex structures known to play a central role in human neglect.
| S-EPMC6401289 | biostudies-literature