Analogous intermediate shape coding in vision and touch.
Ontology highlight
ABSTRACT:
SUBMITTER: Yau JM
PROVIDER: S-EPMC2738619 | biostudies-literature | 2009 Sep
REPOSITORIES: biostudies-literature
Publications
Analogous intermediate shape coding in vision and touch.
Yau Jeffrey M JM Pasupathy Anitha A Fitzgerald Paul J PJ Hsiao Steven S SS Connor Charles E CE
Proceedings of the National Academy of Sciences of the United States of America 20090904 38
We recognize, understand, and interact with objects through both vision and touch. Conceivably, these two sensory systems encode object shape in similar ways, which could facilitate cross-modal communication. To test this idea, we studied single neurons in macaque monkey intermediate visual (area V4) and somatosensory (area SII) cortex, using matched shape stimuli. We found similar patterns of shape sensitivity characterized by tuning for curvature direction. These parallel tuning patterns imply ...[more]
Similar Datasets
Project description:Area V4 is the first object-specific processing stage in the ventral visual pathway, just as area MT is the first motion-specific processing stage in the dorsal pathway. For almost 50 years, coding of object shape in V4 has been studied and conceived in terms of flat pattern processing, given its early position in the transformation of 2D visual images. Here, however, in awake monkey recording experiments, we found that roughly half of V4 neurons are more tuned and responsive to solid, 3D shape-in-depth, as conveyed by shading, specularity, reflection, refraction, or disparity cues in images. Using 2-photon functional microscopy, we found that flat- and solid-preferring neurons were segregated into separate modules across the surface of area V4. These findings should impact early shape-processing theories and models, which have focused on 2D pattern processing. In fact, our analyses of early object processing in AlexNet, a standard visual deep network, revealed a similar distribution of sensitivities to flat and solid shape in layer 3. Early processing of solid shape, in parallel with flat shape, could represent a computational advantage discovered by both primate brain evolution and deep-network training.
| S-EPMC7856003 | biostudies-literature
Project description:Current views on multisensory motion integration assume separate substrates where visual motion perceptually dominates tactile motion [1, 2]. However, recent neuroimaging findings demonstrate strong activation of visual motion processing areas by tactile stimuli [3-6], implying a potentially bidirectional relationship. To test the relationship between visual and tactile motion processing, we examined the transfer of motion aftereffects. In the well-known visual motion aftereffect, adapting to visual motion in one direction causes a subsequently presented stationary stimulus to be perceived as moving in the opposite direction [7, 8]. The existence of motion aftereffects in the tactile domain was debated [9-11], though robust tactile motion aftereffects have recently been demonstrated [12, 13]. By using a motion adaptation paradigm, we found that repeated exposure to visual motion in a given direction produced a tactile motion aftereffect, the illusion of motion in the opponent direction across the finger pad. We also observed that repeated exposure to tactile motion induces a visual motion aftereffect, biasing the perceived direction of counterphase gratings. These crossmodal aftereffects, operating both from vision to touch and from touch to vision, present strong behavioral evidence that the processing of visual and tactile motion rely on shared representations that dynamically impact modality-specific perception.
| S-EPMC3398123 | biostudies-literature
Project description:Central banks incorporate various security features in their banknotes to enable themselves, the general public, retailers and professional cash handlers to detect counterfeits. In two field experiments, we tested central bank counterfeit experts and non-experts (the general public) in their ability to detect counterfeited euro banknotes. We varied exposure duration and perceptual modality (sight, touch or both). The counterfeit banknotes were actual counterfeits taken out of circulation. Experiment 1, in which participants only viewed the banknotes, showed that experts did reasonably well in detecting counterfeits even when exposure duration was limited to 500 ms. Non-experts did not reach the criterion for decent performance, marked by d' = 1.25, although they did perform above chance. In Experiment 2, participants could both see and touch the banknotes, which resulted in better performance especially with longer exposure durations. The main finding of the current study is that visual information mostly impacts the decision-making process during the first glance, whereas tactile information increasingly aids performance as it continues to be accrued over time. Implications for the design of security features of new banknotes are discussed.
| S-EPMC7441122 | biostudies-literature
Project description:Hand movements are essential for tactile perception of objects. However, the specific functions served by active touch strategies, and their dependence on physiological parameters, are unclear and understudied. Focusing on planar shape perception, we tracked at high resolution the hands of 11 participants during shape recognition task. Two dominant hand movement strategies were identified: contour following and scanning. Contour following movements were either tangential to the contour or oscillating perpendicular to it. Scanning movements crossed between distant parts of the shapes' contour. Both strategies exhibited non-uniform coverage of the shapes' contours. Idiosyncratic movement patterns were specific to the sensed object. In a second experiment, we have measured the participants' spatial and temporal tactile thresholds. Significant portions of the variations in hand speed and in oscillation patterns could be explained by the idiosyncratic thresholds. Using data-driven simulations, we show how specific strategy choices may affect receptors activation. These results suggest that motion strategies of active touch adapt to both the sensed object and to the perceiver's physiological parameters.
| S-EPMC8861104 | biostudies-literature
Project description:Inferences about functional correspondences between functional networks of human and non-human primates largely rely on proximity and anatomical expansion models. However, it has been demonstrated that topologically correspondent areas in two species can have different functional properties, suggesting that anatomy-based approaches should be complemented with alternative methods to perform functional comparisons. We have recently shown that comparative analyses based on temporal correlations of sensory-driven fMRI responses can reveal functional correspondent areas in monkeys and humans without relying on spatial assumptions. Inter-species activity correlation (ISAC) analyses require the definition of seed areas in one species to reveal functional correspondences across the cortex of the same and other species. Here we propose an extension of the ISAC method that does not rely on any seed definition, hence a method void of any spatial assumption. Specifically, we apply independent component analysis (ICA) separately to monkey and human data to define species-specific networks of areas with coherent stimulus-related activity. Then, we use a hierarchical cluster analysis to identify ICA-based ISAC clusters of monkey and human networks with similar timecourses. We implemented this approach on fMRI data collected in monkeys and humans during movie watching, a condition that evokes widespread sensory-driven activity throughout large portions of the cortex. Using ICA-based ISAC, we detected seven monkey-human clusters. The timecourses of several clusters showed significant correspondences either with the motion energy in the movie or with eye-movement parameters. Five of the clusters spanned putative homologous functional networks in either primary or extrastriate visual regions, whereas two clusters included higher-level visual areas at topological locations that are not predicted by cortical surface expansion models. Overall, our ICA-based ISAC analysis complemented the findings of our previous seed-based investigations, and suggested that functional processes can be executed by brain networks in different species that are functionally but not necessarily anatomically correspondent. Overall, our method provides a novel approach to reveal evolution-driven functional changes in the primate brain with no spatial assumptions.
| S-EPMC3472137 | biostudies-literature
Project description:Touch is a key channel for conveying meaning in social interactions. The affective quality of touch and its effects on well-being are shaped by relational context (relationship between touch giver vs. recipient) and person variables (e.g. adult attachment style). Yet, such effects have not been explored in relation to the meaning ascribed to touch. We used data from the Touch Test, the world's largest touch survey, which included questions on the degree to which people felt and related specific emotions and intentions to imagined gentle stroking touch and hugs. In N = 23,428, we examined how relational context (imagined source of touch) and person variables (gender, recalled positive childhood touch and adult attachment style) were associated with positive (e.g. love, desire, support) and negative (e.g. fear, anger, warning) emotions and intentions related to imagined touch. Love, desire and support were endorsed more when participants had had their partner (vs. someone else) in mind, and women (vs. men) gave lower ratings for desire overall. Gentle stroking touch was most linked with arousal when participants had had their partner in mind. Further, more positive childhood touch and secure and anxious attachment scores were associated with more positive emotions and intentions, while the opposite was found for avoidant attachment scores. Lastly, positive childhood touch and higher anxious attachment scores were related to greater discrimination between distinct emotion and intention categories, while higher attachment avoidance was associated with reduced discriminability. Thus, contextual and person variables matter in shaping the meaning of social touch.
| S-EPMC7616566 | biostudies-literature
Project description:Active sensation requires the convergence of external stimuli with representations of body movements. We used mouse behavior, electrophysiology and optogenetics to dissect the temporal interactions among whisker movement, neural activity and sensation of touch. We photostimulated layer 4 activity in single barrels in a closed loop with whisking. Mimicking touch-related neural activity caused illusory perception of an object at a particular location, but scrambling the timing of the spikes over one whisking cycle (tens of milliseconds) did not abolish the illusion, indicating that knowledge of instantaneous whisker position is unnecessary for discriminating object locations. The illusions were induced only during bouts of directed whisking, when mice expected touch, and in the relevant barrel. Reducing activity biased behavior, consistent with a spike count code for object detection at a particular location. Our results show that mice integrate coding of touch with movement over timescales of a whisking bout to produce perception of active touch.
| S-EPMC3695000 | biostudies-literature
Project description:Sense of body ownership and body representation are fundamental parts of human consciousness, but the contribution of the visual modality to their development remains unclear. We tested congenitally and late blind adults on a somatosensory version of the rubber hand illusion, and on the Aristotle illusion, in which sighted controls touching a single sphere with crossed fingers commonly report perceiving two. We found that congenitally and late blind individuals did not report subjectively experiencing the rubber hand illusion. However, in an objective measure, the congenitally blind did not show a recalibration of the position of their hand towards the rubber hand while late blind and sighted individuals did. By contrast, all groups experienced the Aristotle illusion. This pattern of results provides evidence for a dissociation of the concepts of body ownership and spatial recalibration and, furthermore, suggests different reference frames for hands (external space) and fingers (anatomical space).
| S-EPMC4206865 | biostudies-other
Project description:Previous research on early deafness has primarily focused on the behavioral and neural changes in the intact visual and tactile modalities. However, how early deafness changes the interplay of these two modalities is not well understood. In the current study, we investigated the effect of auditory deprivation on visuo-tactile interaction by measuring the cross-modal motion aftereffect. Consistent with previous findings, motion aftereffect transferred between vision and touch in a bidirectional manner in hearing participants. However, for deaf participants, the cross-modal transfer occurred only in the tactile-to-visual direction but not in the visual-to-tactile direction. This unidirectional cross-modal motion aftereffect found in the deaf participants could not be explained by unisensory motion aftereffect or discrimination threshold. The results suggest a reduced visual influence on tactile motion perception in early deaf individuals.
| S-EPMC7902672 | biostudies-literature
Project description:Laboratory automation requires reliable and precise handling of microplates, but existing robotic systems often struggle to achieve this, particularly when navigating around the dynamic and variable nature of laboratory environments. This work introduces a novel method integrating simultaneous localization and mapping (SLAM), computer vision, and tactile feedback for the precise and autonomous placement of microplates. Implemented on a bi-manual mobile robot, the method achieves fine-positioning accuracies of ± 1.2 mm and ± 0.4°. The approach was validated through experiments using both mockup and real laboratory instruments, demonstrating at least a 95% success rate across varied conditions and robust performance in a multi-stage protocol. Compared to existing methods, our framework effectively generalizes to different instruments without compromising efficiency. These findings highlight the potential for enhanced robotic manipulation in laboratory automation, paving the way for more reliable and reproducible experimental workflows.
| S-EPMC11752899 | biostudies-literature