Applying a novel visual-to-touch sensory substitution for studying tactile reference frames.
Ontology highlight
ABSTRACT:
SUBMITTER: Yizhar O
PROVIDER: S-EPMC8137949 | biostudies-literature | 2021 May
REPOSITORIES: biostudies-literature
Publications
Applying a novel visual-to-touch sensory substitution for studying tactile reference frames.
Yizhar Or O Buchs Galit G Heimler Benedetta B Friedman Doron D Amedi Amir A
Scientific reports 20210520 1
Perceiving the spatial location and physical dimensions of touched objects is crucial for goal-directed actions. To achieve this, our brain transforms skin-based coordinates into a reference frame by integrating visual and posture information. In the current study, we examine the role of posture in mapping tactile sensations to a visual image. We developed a new visual-to-touch sensory substitution device that transforms images into a sequence of vibrations on the arm. 52 blindfolded participant ...[more]
Similar Datasets
Project description:Multimodal perception is the predominant means by which individuals experience and interact with the world. However, sensory dysfunction or loss can significantly impede this process. In such cases, cross-modality research offers valuable insight into how we can compensate for these sensory deficits through sensory substitution. Although sight and hearing are both used to estimate the distance to an object (e.g., by visual size and sound volume) and the perception of distance is an important element in navigation and guidance, it is not widely studied in cross-modal research. We investigate the relationship between audio and vibrotactile frequencies (in the ranges 47-2,764 Hz and 10-99 Hz, respectively) and distances uniformly distributed in the range 1-12 m. In our experiments participants mapped the distance (represented by an image of a model at that distance) to a frequency via adjusting a virtual tuning knob. The results revealed that the majority (more than 76%) of participants demonstrated a strong negative monotonic relationship between frequency and distance, across both vibrotactile (represented by a natural log function) and auditory domains (represented by an exponential function). However, a subgroup of participants showed the opposite positive linear relationship between frequency and distance. The strong cross-modal sensory correlation could contribute to the development of assistive robotic technologies and devices to augment human perception. This work provides the fundamental foundation for future assisted HRI applications where a mapping between distance and frequency is needed, for example for people with vision or hearing loss, drivers with loss of focus or response delay, doctors undertaking teleoperation surgery, and users in augmented reality (AR) or virtual reality (VR) environments.
| S-EPMC10965077 | biostudies-literature
Project description:Vision is crucial for daily tasks and interacting with the environment, but visual impairment can hinder these activities. Many sensory substitution products and studies prioritize providing abundant and accurate information, yet often overlook the inherent relationship between different modalities, potentially preventing users from receiving information intuitively. This study investigated the representation of visual distance using auditory and vibrotactile frequency through a series of psychological cross-modal matching experiments. By establishing mapping functions between auditory/vibrotactile frequency and visual distance, we aim to facilitate the design of sensory substitution devices that take visual distance information (ranging from 1 m to 12 m) and convert it into non-visual information (auditory frequency within the range 47-2764 Hz or vibrotactile frequency within the range 10-99 Hz). Results show distinct patterns regarding the correlation between visual distance and frequency in both auditory (auditory frequency-to-visual distance) and vibrotactile (vibrotactile frequency-to-visual distance) domains. The prevailing trend (59%) was a monotonic negative correlation (i.e. higher frequencies are associated with shorter distances), while 24% of participants demonstrated a consistently positive correlation. Additionally, we compare this study with our previous investigations into the reverse cross-modal mapping of visual distance-to-auditory frequency and visual distance-to-vibrotactile frequency. We reveal common patterns between these two studies (negative and positive correlations), suggesting a bidirectional mapping between visual distance and frequency in both auditory and vibrotactile domains, and the potential for new sensory substitution devices for those with visual impairment by integrating underlying cross-modal mechanisms to enhance intuitive and natural human-machine interaction.
| S-EPMC11875370 | biostudies-literature
Project description:Perceptual judgements about our physical environment are informed by somatosensory information. In real-world exploration, this often involves dynamic hand movements to contact surfaces, termed active touch. The current study investigated cortical oscillatory changes during active exploration to inform the estimation of surface properties and hedonic preferences of two textured stimuli: smooth silk and rough hessian. A purpose-built touch sensor quantified active touch, and oscillatory brain activity was recorded from 129-channel electroencephalography. By fusing these data streams at a single trial level, oscillatory changes within the brain were examined while controlling for objective touch parameters (i.e., friction). Time-frequency analysis was used to quantify changes in cortical oscillatory activity in alpha (8-12 Hz) and beta (16-24 Hz) frequency bands. Results reproduce findings from our lab, whereby active exploration of rough textures increased alpha-band event-related desynchronisation in contralateral sensorimotor areas. Hedonic processing of less preferred textures resulted in an increase in temporoparietal beta-band and frontal alpha-band event-related desynchronisation relative to most preferred textures, suggesting that higher order brain regions are involved in the hedonic processing of texture. Overall, the current study provides novel insight into the neural mechanisms underlying texture perception during active touch and how this process is influenced by cognitive tasks.
| S-EPMC10946733 | biostudies-literature
Project description:Recent investigations indicate that retinal motion is not directly available for perception when moving around [Souman JL, et al. (2010) J Vis 10:14], possibly pointing to suppression of retinal speed sensitivity in motion areas. Here, we investigated the distribution of retinocentric and head-centric representations of self-rotation in human lower-tier visual motion areas. Functional MRI responses were measured to a set of visual self-motion stimuli with different levels of simulated gaze and simulated head rotation. A parametric generalized linear model analysis of the blood oxygen level-dependent responses revealed subregions of accessory V3 area, V6(+) area, middle temporal area, and medial superior temporal area that were specifically modulated by the speed of the rotational flow relative to the eye and head. Pursuit signals, which link the two reference frames, were also identified in these areas. To our knowledge, these results are the first demonstration of multiple visual representations of self-motion in these areas. The existence of such adjacent representations points to early transformations of the reference frame for visual self-motion signals and a topography by visual reference frame in lower-order motion-sensitive areas. This suggests that visual decisions for action and perception may take into account retinal and head-centric motion signals according to task requirements.
| S-EPMC3136271 | biostudies-literature
Project description:In upright stance, light touch of a space-stationary touch reference reduces spontaneous sway. Moving the reference evokes sway responses which exhibit non-linear behavior that has been attributed to sensory reweighting. Reweighting refers to a change in the relative contribution of sensory cues signaling body sway in space and light touch cues signaling finger position with respect to the body. Here we test the hypothesis that the sensory fusion process involves a transformation of light touch signals into the same reference frame as other sensory inputs encoding body sway in space, or vice versa. Eight subjects lightly gripped a robotic manipulandum which moved in a circular arc around the ankle joint. A pseudo-randomized motion sequence with broad spectral characteristics was applied at three amplitudes. The stimulus was presented at two different heights and therefore different radial distances, which were matched in terms of angular motion. However, the higher stimulus evoked a significantly larger sway response, indicating that the response was not matched to stimulus angular motion. Instead, the body sway response was strongly related to the horizontal translation of the manipulandum. The results suggest that light touch is integrated as the horizontal distance between body COM and the finger. The data were well explained by a model with one feedback loop minimizing changes in horizontal COM-finger distance. The model further includes a second feedback loop estimating the horizontal finger motion and correcting the first loop when the touch reference is moving. The second loop includes the predicted transformation of sensory signals into the same reference frame and a non-linear threshold element that reproduces the non-linear sway responses, thus providing a mechanism that can explain reweighting.
| S-EPMC5991370 | biostudies-literature
Project description:The sensory signals that drive movement planning arrive in a variety of 'reference frames', and integrating or comparing them requires sensory transformations. We propose a model in which the statistical properties of sensory signals and their transformations determine how these signals are used. This model incorporates the patterns of gaze-dependent errors that we found in our human psychophysics experiment when the sensory signals available for reach planning were varied. These results challenge the widely held ideas that error patterns directly reflect the reference frame of the underlying neural representation and that it is preferable to use a single common reference frame for movement planning. We found that gaze-dependent error patterns, often cited as evidence for retinotopic reach planning, can be explained by a transformation bias and are not exclusively linked to retinotopic representations. Furthermore, the presence of multiple reference frames allows for optimal use of available sensory information and explains task-dependent reweighting of sensory signals.
| S-EPMC2749235 | biostudies-literature
Project description:In dynamic multisensory environments, the perceptual system corrects for discrepancies arising between modalities. For instance, in the ventriloquism aftereffect (VAE), spatial disparities introduced between visual and auditory stimuli lead to a perceptual recalibration of auditory space. Previous research has shown that the VAE is underpinned by multiple recalibration mechanisms tuned to different timescales, however it remains unclear whether these mechanisms use common or distinct spatial reference frames. Here we asked whether the VAE operates in eye- or head-centred reference frames across a range of adaptation timescales, from a few seconds to a few minutes. We developed a novel paradigm for selectively manipulating the contribution of eye- versus head-centred visual signals to the VAE by manipulating auditory locations relative to either the head orientation or the point of fixation. Consistent with previous research, we found both eye- and head-centred frames contributed to the VAE across all timescales. However, we found no evidence for an interaction between spatial reference frames and adaptation duration. Our results indicate that the VAE is underpinned by multiple spatial reference frames that are similarly leveraged by the underlying time-sensitive mechanisms.
| S-EPMC8128243 | biostudies-literature
Project description:The skin of the forearm is, in one sense, a flat 2-dimensional (2D) sheet, but in another sense approximately cylindrical, mirroring the 3-dimensional (3D) volumetric shape of the arm. The role of frames of reference based on the skin as a 2D sheet versus based on the musculoskeletal structure of the arm remains unclear. When we rotate the forearm from a pronated to a supinated posture, the skin on its surface is displaced. Thus, a marked location will slide with the skin across the underlying flesh, and the touch perceived at this location should follow this displacement if it is localized within a skin-based reference frame. We investigated, however, if the perceived tactile locations were also affected by the rearrangement in underlying musculoskeletal structure, that is, displaced medially and laterally on a pronated and supinated forearm, respectively. Participants pointed to perceived touches (Experiment 1), or marked them on a (3D) size-matched forearm on a computer screen (Experiment 2). The perceived locations were indeed displaced medially after forearm pronation in both response modalities. This misperception was reduced (Experiment 1), or absent altogether (Experiment 2) in the supinated posture when the actual stimulus grid moved laterally with the displaced skin. The grid was perceptually stretched at medial-lateral axis, and it was displaced distally, which suggest the influence of skin-based factors. Our study extends the tactile localization literature focused on the skin-based reference frame and on the effects of spatial positions of body parts by implicating the musculoskeletal factors in localization of touch on the body. (PsycINFO Database Record (c) 2018 APA, all rights reserved).
| S-EPMC6205026 | biostudies-literature
Project description:Animals living in and interacting with natural environments must monitor and respond to changing conditions and unpredictable situations. Using information from multiple sensory systems allows them to modify their behavior in response to their dynamic environment but also creates the challenge of integrating different, and potentially contradictory, sources of information for behavior control. Understanding how multiple information streams are integrated to produce flexible and reliable behavior is key to understanding how behavior is controlled in natural settings. Natural settings are rarely still, which challenges animals that require precise body position control, like hummingbirds, which hover while feeding from flowers. Tactile feedback, available only once the hummingbird is docked at the flower, could provide additional information to help maintain its position at the flower. To investigate the role of tactile information for hovering control during feeding, we first asked whether hummingbirds physically interact with a feeder once docked. We quantified physical interactions between docked hummingbirds and a feeder placed in front of a stationary background pattern. Force sensors on the feeder measured a complex time course of loading that reflects the wingbeat frequency and bill movement of feeding hummingbirds, and suggests that they sometimes push against the feeder with their bill. Next, we asked whether the measured tactile interactions were used by feeding hummingbirds to maintain position relative to the feeder. We created two experimental scenarios-one in which the feeder was stationary and the visual background moved and the other where the feeder moved laterally in front of a white background. When the visual background pattern moved, docked hummingbirds pushed significantly harder in the direction of horizontal visual motion. When the feeder moved, and the background was stationary, hummingbirds generated aerodynamic force in the opposite direction of the feeder motion. These results suggest that docked hummingbirds are using visual information about the environment to maintain body position and orientation, and not actively tracking the motion of the feeder. The absence of flower tracking behavior in hummingbirds contrasts with the behavior of hawkmoths, and provides evidence that they rely primarily on the visual background rather than flower-based cues while feeding.
| S-EPMC5694540 | biostudies-literature
Project description:BackgroundEnvironmental sensitivity is commonly reported by people with fibromyalgia syndrome. People living with fibromyalgia syndrome frequently report hypersensitivity to noxious and non-noxious sensations. To date, there has been little empirical validation of sensory disturbance to non-noxious triggers. Environmental sensitivity is used as a diagnostic feature only in Bennet's alternative criteria for diagnosis of fibromyalgia, where it was ranked the second most important of the components for diagnosis, after number of pain sites. The aim of this study was to use a validated sensory measure to determine if people with fibromyalgia have greater sensory disturbances compared to people with other chronic pain conditions.MethodsThis study used the Sensory Perception Quotient (SPQ) 92 question survey in adults with chronic pain conditions. A fibromyalgia group (n = 135) and a non-fibromyalgia chronic pain control group (n = 45) were recruited. All participants completed the SPQ as a self-report measure of sensory processing. In addition to the original SPQ scoring method, the Revised Scoring of the Sensory Perception Quotient (SPQ-RS) method was used to investigate self-reported hypersensitivity and hyposensitivity and the vision, hearing, taste, touch, and smell subscales. Chi-squared tests were used for categorical variables and Mann Whitney U, or Kruskal-Wallis H test were used to compare groups.ResultsThe fibromyalgia group reported significantly more sensitivity compared to the control group (p = 0.030). The fibromyalgia group reported significantly greater hypersensitivity (p = 0.038), but not more hyposensitivity (p = 0.723) compared to controls. The average fibromyalgia SPQ score (92.64 ± 23.33) was similar to that previously reported for adults with autism (92.95 ± 26.61). However, whereas adults with autism had broad range hypersensitivity, the fibromyalgia group reported significantly more hypersensitivity compared to the control group, but the range was restricted to vision (p = 0.033), smell (p = 0.049) and touch (0.040).ConclusionsThese findings demonstrate greater sensory hypersensitivity in people with fibromyalgia compared to people with other chronic pain disorders. Greater hypersensitivity was restricted to touch, vision, and smell, all of which have previously been demonstrated to crosstalk with nociception.
| S-EPMC9294149 | biostudies-literature