Dataset Information

Learning and navigating digitally rendered haptic spatial layouts.

ABSTRACT: Learning spatial layouts and navigating through them rely not simply on sight but rather on multisensory processes, including touch. Digital haptics based on ultrasounds are effective for creating and manipulating mental images of individual objects in sighted and visually impaired participants. Here, we tested if this extends to scenes and navigation within them. Using only tactile stimuli conveyed via ultrasonic feedback on a digital touchscreen (i.e., a digital interactive map), 25 sighted, blindfolded participants first learned the basic layout of an apartment based on digital haptics only and then one of two trajectories through it. While still blindfolded, participants successfully reconstructed the haptically learned 2D spaces and navigated these spaces. Digital haptics were thus an effective means to learn and translate, on the one hand, 2D images into 3D reconstructions of layouts and, on the other hand, navigate actions within real spaces. Digital haptics based on ultrasounds represent an alternative learning tool for complex scenes as well as for successful navigation in previously unfamiliar layouts, which can likely be further applied in the rehabilitation of spatial functions and mitigation of visual impairments.

SUBMITTER: Tivadar RI

PROVIDER: S-EPMC10724186 | biostudies-literature | 2023 Dec

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Learning and navigating digitally rendered haptic spatial layouts.

Tivadar Ruxandra I RI Franceschiello Benedetta B Minier Astrid A Murray Micah M MM

NPJ science of learning 20231216 1

Learning spatial layouts and navigating through them rely not simply on sight but rather on multisensory processes, including touch. Digital haptics based on ultrasounds are effective for creating and manipulating mental images of individual objects in sighted and visually impaired participants. Here, we tested if this extends to scenes and navigation within them. Using only tactile stimuli conveyed via ultrasonic feedback on a digital touchscreen (i.e., a digital interactive map), 25 sighted, b ...[more]

PMID: 38102127

Similar Datasets

Project description:In the event of visual impairment or blindness, information from other intact senses can be used as substitutes to retrain (and in extremis replace) visual functions. Abilities including reading, mental representation of objects and spatial navigation can be performed using tactile information. Current technologies can convey a restricted library of stimuli, either because they depend on real objects or renderings with low resolution layouts. Digital haptic technologies can overcome such limitations. The applicability of this technology was previously demonstrated in sighted participants. Here, we reasoned that visually-impaired and blind participants can create mental representations of letters presented haptically in normal and mirror-reversed form without the use of any visual information, and mentally manipulate such representations. Visually-impaired and blind volunteers were blindfolded and trained on the haptic tablet with two letters (either L and P or F and G). During testing, they haptically explored on any trial one of the four letters presented at 0°, 90°, 180°, or 270° rotation from upright and indicated if the letter was either in a normal or mirror-reversed form. Rotation angle impacted performance; greater deviation from 0° resulted in greater impairment for trained and untrained normal letters, consistent with mental rotation of these haptically-rendered objects. Performance was also generally less accurate with mirror-reversed stimuli, which was not affected by rotation angle. Our findings demonstrate, for the first time, the suitability of a digital haptic technology in the blind and visually-impaired. Classic devices remain limited in their accessibility and in the flexibility of their applications. We show that mental representations can be generated and manipulated using digital haptic technology. This technology may thus offer an innovative solution to the mitigation of impairments in the visually-impaired, and to the training of skills dependent on mental representations and their spatial manipulation.

Project description:Recent work with simulated reductions in visual acuity and contrast sensitivity has found decrements in survey spatial learning as well as increased attentional demands when navigating, compared to performance with normal vision. Given these findings, and previous work showing that peripheral field loss has been associated with impaired mobility and spatial memory for room-sized spaces, we investigated the role of peripheral vision during navigation using a large-scale spatial learning paradigm. First, we aimed to establish the magnitude of spatial memory errors at different levels of field restriction. Second, we tested the hypothesis that navigation under these different levels of restriction would use additional attentional resources. Normally sighted participants walked on novel real-world paths wearing goggles that restricted the field-of-view (FOV) to severe (15°, 10°, 4°, or 0°) or mild angles (60°) and then pointed to remembered target locations using a verbal reporting measure. They completed a concurrent auditory reaction time task throughout each path to measure cognitive load. Only the most severe restrictions (4° and blindfolded) showed impairment in pointing error compared to the mild restriction (within-subjects). The 10° and 4° conditions also showed an increase in reaction time on the secondary attention task, suggesting that navigating with these extreme peripheral field restrictions demands the use of limited cognitive resources. This comparison of different levels of field restriction suggests that although peripheral field loss requires the actor to use more attentional resources while navigating starting at a less extreme level (10°), spatial memory is not negatively affected until the restriction is very severe (4°). These results have implications for understanding of the mechanisms underlying spatial learning during navigation and the approaches that may be taken to develop assistance for navigation with visual impairment.

Project description:Cognitive demands for postural control increase with aging and cognitive-motor interference (CMI) exists for a number of walking situations, especially with visuo-spatial cognitive tasks. Such interference also influences spatial learning abilities among older adults; however, this is rarely considered in research on aging in spatial navigation. We posited that visually and physically exploring an unknown environment may be subject to CMI for older adults. We investigated potential indicators of postural control interfering with spatial learning. Given known associations between age-related alterations in gait and brain structure, we also examined potential neuroanatomical correlates of this interference. Fourteen young and 14 older adults had to find an invisible goal in an unfamiliar, real, ecological environment. We measured walking speed, trajectory efficiency (direct route over taken route) and goal fixations (proportion of visual fixations toward the goal area). We calculated the change in walking speed between the first and last trials and adaptation indices for all three variables to quantify their modulation across learning trials. All participants were screened with a battery of visuo-cognitive tests. Eighteen of our participants (10 young, 8 older) also underwent a magnetic resonance imaging (MRI) examination. Older adults reduced their walking speed considerably on the first, compared to the last trial. The adaptation index of walking speed correlated positively with those of trajectory efficiency and goal fixations, indicating a reduction in resource sharing between walking and encoding the environment. The change in walking speed correlated negatively with gray matter volume in superior parietal and occipital regions and the precuneus. We interpret older adults' change in walking speed as indicative of CMI, similar to dual task costs. This is supported by the correlations between the adaptation indices and between the change in walking speed and gray matter volume in brain regions that are important for navigation, given that they are involved in visual attention, sensory integration and encoding of space. These findings under ecological conditions in a natural spatial learning task question what constitutes dual tasking in older adults and they can lead future research to reconsider the actual cognitive burden of postural control in aging navigation research.

Dataset Information

Learning and navigating digitally rendered haptic spatial layouts.

Publications

Learning and navigating digitally rendered haptic spatial layouts.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets