Improving the Screen Exploration of Smartphones Using Haptic Icons for Visually Impaired Users.
Ontology highlight
ABSTRACT:
SUBMITTER: Gonzalez-Canete FJ
PROVIDER: S-EPMC8347385 | biostudies-literature | 2021 Jul
REPOSITORIES: biostudies-literature
Publications
Improving the Screen Exploration of Smartphones Using Haptic Icons for Visually Impaired Users.
González-Cañete Francisco Javier FJ López-Rodríguez José Luís JL Galdón Pedro María PM Diaz-Estrella Antonio A
Sensors (Basel, Switzerland) 20210724 15
We report the results of a study on the learnability of the locations of haptic icons on smartphones. The aim was to study the influence of the use of complex and different vibration patterns associated with haptic icons compared to the use of simple and equal vibrations on commercial location-assistance applications. We studied the performance of users with different visual capacities (visually impaired vs. sighted) in terms of the time taken to learn the icons' locations and the icon recogniti ...[more]
Similar Datasets
Project description:We report the results of a study on the learnability of haptic icons used as alerts or notifications in smartphones. The aim was to explore the feasibility of using haptic icons to create assistive technologies for people with visual impairments. We compared the performance and satisfaction of users with different visual capacities (visually impaired vs. sighted) and using different learning processes (with or without a reinforcement learning stage). The reinforcement learning stage improves the recognition rate in both types of users, although the improvement obtained by the visually impaired users is even better as their recognition rates become very similar to those obtained by the sighted users. Finally, it was observed that the better recognized haptic icons are those assigned to the most employed applications by the user.
| S-EPMC6844543 | biostudies-literature
Project description:In the event of visual impairment or blindness, information from other intact senses can be used as substitutes to retrain (and in extremis replace) visual functions. Abilities including reading, mental representation of objects and spatial navigation can be performed using tactile information. Current technologies can convey a restricted library of stimuli, either because they depend on real objects or renderings with low resolution layouts. Digital haptic technologies can overcome such limitations. The applicability of this technology was previously demonstrated in sighted participants. Here, we reasoned that visually-impaired and blind participants can create mental representations of letters presented haptically in normal and mirror-reversed form without the use of any visual information, and mentally manipulate such representations. Visually-impaired and blind volunteers were blindfolded and trained on the haptic tablet with two letters (either L and P or F and G). During testing, they haptically explored on any trial one of the four letters presented at 0°, 90°, 180°, or 270° rotation from upright and indicated if the letter was either in a normal or mirror-reversed form. Rotation angle impacted performance; greater deviation from 0° resulted in greater impairment for trained and untrained normal letters, consistent with mental rotation of these haptically-rendered objects. Performance was also generally less accurate with mirror-reversed stimuli, which was not affected by rotation angle. Our findings demonstrate, for the first time, the suitability of a digital haptic technology in the blind and visually-impaired. Classic devices remain limited in their accessibility and in the flexibility of their applications. We show that mental representations can be generated and manipulated using digital haptic technology. This technology may thus offer an innovative solution to the mitigation of impairments in the visually-impaired, and to the training of skills dependent on mental representations and their spatial manipulation.
| S-EPMC7099598 | biostudies-literature
Project description:SignificanceVisually impaired participants were surprisingly fast in learning a new sensory substitution device, which allows them to detect obstacles within a 3.5-m radius and to find the optimal path in between. Within a few hours of training, participants successfully performed complex navigation as well as with the white cane.PurposeGlobally, millions of people live with vision impairment, yet effective assistive devices to increase their independence remain scarce. A promising method is the use of sensory substitution devices, which are human-machine interfaces transforming visual into auditory or tactile information. The Sound of Vision (SoV) system continuously encodes visual elements of the environment into audio-haptic signals. Here, we evaluated the SoV system in complex navigation tasks, to compare performance with the SoV system with the white cane, quantify training effects, and collect user feedback.MethodsSix visually impaired participants received eight hours of training with the SoV system, completed a usability questionnaire, and repeatedly performed assessments, for which they navigated through standardized scenes. In each assessment, participants had to avoid collisions with obstacles, using the SoV system, the white cane, or both assistive devices.ResultsThe results show rapid and substantial learning with the SoV system, with less collisions and higher obstacle awareness. After four hours of training, visually impaired people were able to successfully avoid collisions in a difficult navigation task as well as when using the cane, although they still needed more time. Overall, participants rated the SoV system's usability favorably.ConclusionsContrary to the cane, the SoV system enables users to detect the best free space between objects within a 3.5-m (up to 10-m) radius and, importantly, elevated and dynamic obstacles. All in all, we consider that visually impaired people can learn to adapt to the haptic-auditory representation and achieve expertise in usage through well-defined training within acceptable time.
| S-EPMC6133230 | biostudies-literature
Project description:Novel stimuli elicit behaviors that are collectively known as specific exploration. These behaviors allow the animal to become more familiar with the novel objects within its environment. Specific exploration is frequently suppressed by defensive reactions to predator cues. Herein, we examine if this suppression occurs in Drosophila melanogaster by measuring the response of these flies to wild harvested predators. The flies used in our experiments have been cultured and had not lived under predator threat for multiple decades. In a circular arena with centrally-caged predators, wild type Drosophila actively avoided the pantropical jumping spider, Plexippus paykulli, and the Texas unicorn mantis, Phyllovates chlorophaena, indicating an innate defensive reaction to these predators. Interestingly, wild type Drosophila males also avoided a centrally-caged mock spider, and the avoidance of the mock spider became exaggerated when it was made to move within the cage. Visually impaired Drosophila failed to detect and avoid the Plexippus paykulli and the moving mock spider, while the broadly anosmic orco2 mutants were fully capable of detecting and avoiding Plexippus paykulli, indicating that these flies principally relied upon vison to perceive the predator stimuli. During early exploration of the arena, exploratory activity increased in the presence of Plexippus paykulli and the moving mock spider. The elevated activity induced by Plexippus paykulli disappeared after the fly had finished exploring, suggesting the flies were capable of habituating the predator cues. Taken together, these results indicate that despite being isolated from predators for decades Drosophila will visually detect these predators, retain innate defensive behaviors, respond by increasing exploratory activity in the arena rather than suppressing activity, and may habituate to normal predator cues.
| S-EPMC5528251 | biostudies-literature
Project description:In a haptic search task, one has to detect the presence of a target among distractors using the sense of touch. A salient target can be detected faster than a non-salient target. However, little is known about the exploration strategies that are used, especially in 3D search tasks where items are held in the hand. In this study, we investigated which parts of the hand were used to contact the target and which strategies were performed. Blindfolded participants performed search tasks in four conditions, where the targets differed in relevant property and saliency. The positions of the target and the hand were tracked during exploration. It was found that target saliency had a large effect on the use of the hand parts and the strategies. In the non-salient target conditions, the fingers, especially the thumb, contacted the target more often than in the salient target conditions. This could also be seen in the strategies, where the thumb was used to explore the items in a serial way by moving them in the hand or touching them individually. In the salient target conditions, more parallel strategies like grasping or shuffling of the items in the hand were used.
| S-EPMC4152757 | biostudies-literature
Project description:Congenitally blind infants are not only deprived of visual input but also of visual influences on the intact senses. The important role that vision plays in the early development of multisensory spatial perception1-7 (e.g., in crossmodal calibration8-10 and in the formation of multisensory spatial representations of the body and the world1,2) raises the possibility that impairments in spatial perception are at the heart of the wide range of difficulties that visually impaired infants show across spatial,8-12 motor,13-17 and social domains.8,18,19 But investigations of early development are needed to clarify how visually impaired infants' spatial hearing and touch support their emerging ability to make sense of their body and the outside world. We compared sighted (S) and severely visually impaired (SVI) infants' responses to auditory and tactile stimuli presented on their hands. No statistically reliable differences in the direction or latency of responses to auditory stimuli emerged, but significant group differences emerged in responses to tactile and audiotactile stimuli. The visually impaired infants showed attenuated audiotactile spatial integration and interference, weighted more tactile than auditory cues when the two were presented in conflict, and showed a more limited influence of representations of the external layout of the body on tactile spatial perception.20 These findings uncover a distinct phenotype of multisensory spatial perception in early postnatal visual deprivation. Importantly, evidence of audiotactile spatial integration in visually impaired infants, albeit to a lesser degree than in sighted infants, signals the potential of multisensory rehabilitation methods in early development. VIDEO ABSTRACT.
| S-EPMC8612739 | biostudies-literature
Project description:PurposeTo assess patient-reported quality of life outcome improvements in severely visually impaired (SVI) individuals using the Aira system over a 1-year follow-up period.MethodsAira is an on-demand assistive technology designed for SVI. Aira subscribers were recruited and administered the validated 28-item Impact of Vision Impairment-Very Low Vision Questionnaire by phone before starting Aira with follow-ups at 3 months and 1 year. Total score and validated subset scores of activities of daily living, mobility, and safety (ADLMS) and emotional well-being (EWB) were assessed. Pearson correlation analyses and paired t-tests were used to examine the data.ResultsFifty participants (mean, age, 52.5 years; 25 males, 25 females) were recruited with a mean of 401 ± 66.3 days to follow-up. The initial total score (mean, 53.1 ± 18.9) significantly improved at 1 year (mean, 63.1 ± 16.2; P = 0.0002). The initial ADLMS score (mean, 30.7 ± 11.3) significantly improved at 1 year (mean, 37.2 ± 10.7; P = 0.001). The initial EWB score (mean, 22.5 ± 8.5) significantly improved at 1 year (mean, 25.9 ± 8.0; P = 0.0001). There was no significant difference between the 3-month and 1-year total (P = 0.972), ADLMS (P = 0.897), and EWB scores (P = 0.700). There was a significant correlation between minutes used and improvement in total (r = 0.371; P = 0.009), ADLMS (r = 0.302; P = 0.035), and EWB (r = 0.439; P = 0.002) scores.ConclusionsAira use significantly improves Impact of Vision Impairment-Very Low Vision total, ADLMS, and EWB scores for SVI individuals at 3 months. This improvement is sustained at the 1-year follow-up and correlated with total minutes used.Translational relevanceAira technology may provide sustained improvement in quality of life for SVI, and further study to evaluate the usefulness of this technology to assist SVI may be beneficial.
| S-EPMC7396172 | biostudies-literature
Project description:BackgroundLaparoscopy has reduced tactile and visual feedback compared to open surgery. There is increasing evidence that visual and haptic information converge to form a more robust mental representation of an object. We investigated whether tactile exploration of an object prior to executing a laparoscopic action on it improves performance.MethodsA prospective cohort study with 20 medical students randomized in two different groups was conducted. A silicone ileocecal model, on which a laparoscopic action had to be performed, was used inside an outside a ForceSense box trainer. During the pre-test, students either did a combined manual and visual exploration or only visual exploration of the caecum model. To track performance during the trials of the study we used force, motion and time parameters as representatives of technical skills development. The final trial data were used for statistical comparison between groups.ResultsAll included time and motion parameters did not show any clear differences between groups. However, the force parameters Mean force non-zero (p = 004), Maximal force (p = 0.01) Maximal impulse (p = 0.02), Force volume (p = 0.02) and SD force (p = 0.01) showed significant lower values in favour of the tactile exploration group for the final trials.ConclusionsBy adding haptic sensation to the existing visual information during training of laparoscopic tasks on life-like models, tissue manipulation skills improve during training.
| S-EPMC8263408 | biostudies-literature
Project description:For haptic interaction, a user in a virtual environment needs to interact with proxies attached to a robot. The device must be at the exact location defined in the virtual environment in time. However, due to device limitations, delays are always unavoidable. One of the solutions to improve the device response is to infer human intended motion and move the robot at the earliest time possible to the desired goal. This paper presents an experimental study to improve the prediction time and reduce the robot time taken to reach the desired position. We developed motion strategies based on the hand motion and eye-gaze direction to determine the point of user interaction in a virtual environment. To assess the performance of the strategies, we conducted a subject-based experiment using an exergame for reach and grab tasks designed for upper limb rehabilitation training. The experimental results in this study revealed that eye-gaze-based prediction significantly improved the detection time by 37% and the robot time taken to reach the target by 27%. Further analysis provided more insight on the effect of the eye-gaze window and the hand threshold on the device response for the experimental task.
| S-EPMC8914947 | biostudies-literature
Project description:How humans visually select where to grasp objects is determined by the physical object properties (e.g., size, shape, weight), the degrees of freedom of the arm and hand, as well as the task to be performed. We recently demonstrated that human grasps are near-optimal with respect to a weighted combination of different cost functions that make grasps uncomfortable, unstable, or impossible, e.g., due to unnatural grasp apertures or large torques. Here, we ask whether humans can consciously access these rules. We test if humans can explicitly judge grasp quality derived from rules regarding grasp size, orientation, torque, and visibility. More specifically, we test if grasp quality can be inferred (i) by using visual cues and motor imagery alone, (ii) from watching grasps executed by others, and (iii) through performing grasps, i.e., receiving visual, proprioceptive and haptic feedback. Stimuli were novel objects made of 10 cubes of brass and wood (side length 2.5 cm) in various configurations. On each object, one near-optimal and one sub-optimal grasp were selected based on one cost function (e.g., torque), while the other constraints (grasp size, orientation, and visibility) were kept approximately constant or counterbalanced. Participants were visually cued to the location of the selected grasps on each object and verbally reported which of the two grasps was best. Across three experiments, participants were required to either (i) passively view the static objects and imagine executing the two competing grasps, (ii) passively view videos of other participants grasping the objects, or (iii) actively grasp the objects themselves. Our results show that, for a majority of tested objects, participants could already judge grasp optimality from simply viewing the objects and imagining to grasp them, but were significantly better in the video and grasping session. These findings suggest that humans can determine grasp quality even without performing the grasp-perhaps through motor imagery-and can further refine their understanding of how to correctly grasp an object through sensorimotor feedback but also by passively viewing others grasp objects.
| S-EPMC7835720 | biostudies-literature