An immersive multisensory virtual reality approach to the study of human-built environment interactions: Technical workflows.
Ontology highlight
ABSTRACT:
SUBMITTER: Lyu K
PROVIDER: S-EPMC10371809 | biostudies-literature | 2023 Dec
REPOSITORIES: biostudies-literature
Publications
An immersive multisensory virtual reality approach to the study of human-built environment interactions: Technical workflows.
Lyu Kun K Globa Anastasia A Brambilla Arianna A de Dear Richard R
MethodsX 20230712
Virtual Reality technology has gained increased attention due to its capacity to provide immersive and interactive experiences to its users. Although increasing evidence has suggested that incorporating multisensory components in VR can promote the sense of presence and improve user performance, most of the current VR applications are limited to visual and auditory senses. In this article, a novel method of integrating thermal-related devices (heat lamps and fans) into Virtual Reality was develo ...[more]
Similar Datasets
Project description:Children must often endure painful procedures as part of their treatment for various medical conditions. Those with chronic pain endure frequent or constant discomfort in their daily lives, sometimes severely limiting their physical capacities. With the advent of affordable consumer-grade equipment, clinicians have access to a promising and engaging intervention for pediatric pain, both acute and chronic. In addition to providing relief from acute and procedural pain, virtual reality (VR) may also help to provide a corrective psychological and physiological environment to facilitate rehabilitation for pediatric patients suffering from chronic pain. The special qualities of VR such as presence, interactivity, customization, social interaction, and embodiment allow it to be accepted by children and adolescents and incorporated successfully into their existing medical therapies. However, the powerful and transformative nature of many VR experiences may also pose some risks and should be utilized with caution. In this paper, we review recent literature in pediatric virtual reality for procedural pain and anxiety, acute and chronic pain, and some rehabilitation applications. We also discuss the practical considerations of using VR in pediatric care, and offer specific suggestions and information for clinicians wishing to adopt these engaging therapies into their daily clinical practice.
| S-EPMC5532544 | biostudies-other
Project description:Spatial navigation is influenced by landmarks, which are prominent visual features in the environment. Although previous research has focused on finding advantages of landmarks on wayfinding via experimentation; however, less attention has been given to identifying the key attributes of landmarks that facilitate wayfinding, including the study of neural correlates (involving electroencephalogram, EEG analyses). In this paper, we combine behavioral measures, virtual environment, and EEG signal-processing to provide a holistic investigation about the influence of landmarks on performance during navigation in a maze-like environment. In an experiment, participants were randomly divided into two conditions, Landmark-enriched (LM+; N = 17) and Landmark-devoid (LM-; N = 18), and asked to navigate from an initial location to a goal location in a maze. In the LM+ condition, there were landmarks placed at certain locations, which participants could use for wayfinding in the maze. However, in the LM- condition, such landmarks were not present. Beyond behavioral analyses of data, analyses were carried out of the EEG data collected using a 64-channel device. Results revealed that participants took less time and committed fewer errors in navigating the maze in the LM+ condition compared to the LM- condition. EEG analyses of the data revealed that the left-hemispheric activation was more prominent in the LM+ condition compared to the LM- condition. The event-related desynchronization/synchronization (ERD/ERS) of the theta frequency band, revealed activation in the left posterior inferior and superior regions in the LM+ condition compared to the LM- condition, suggesting an occurrence of an object-location binding in the LM+ condition along with spatial transformation between representations. Moreover, directed transfer function method, which measures information flow between two regions, showed a higher number of active channels in the LM- condition compared to the LM+ condition, exhibiting additional wiring cost associated with the cognitive demands when no landmark was available. These findings reveal pivotal role of the left-hemispheric region (especially, parietal cortex), which indicates the integration of available sensory cues and current memory requirements to encode contextual information of landmarks. Overall, this research helps to understand the role of brain regions and processes that are utilized when people use landmarks in navigating maze-like environments.
| S-EPMC5517459 | biostudies-other
Project description:Individuals are increasingly relying on GPS devices to orient and find their way in their environment and research has pointed to a negative impact of navigational systems on spatial memory. We used immersive virtual reality to examine whether an audio-visual navigational aid can counteract the negative impact of visual only or auditory only GPS systems. We also examined the effect of spatial representation preferences and abilities when using different GPS systems. Thirty-four participants completed an IVR driving game including 4 GPS conditions (No GPS; audio GPS; visual GPS; audio-visual GPS). After driving one of the routes in one of the 4 GPS conditions, participants were asked to drive to a target landmark they had previously encountered. The audio-visual GPS condition returned more accurate performance than the visual and no GPS condition. General orientation ability predicted the distance to the target landmark for the visual and the audio-visual GPS conditions, while landmark preference predicted performance in the audio GPS condition. Finally, the variability in end distance to the target landmark was significantly reduced in the audio-visual GPS condition when compared to the visual and audio GPS conditions. These findings support theories of spatial cognition and inform the optimisation of GPS designs.
| S-EPMC9072375 | biostudies-literature
Project description:BackgroundBody change illusions have been of great interest in recent years for the understanding of how the brain represents the body. Appropriate multisensory stimulation can induce an illusion of ownership over a rubber or virtual arm, simple types of out-of-the-body experiences, and even ownership with respect to an alternate whole body. Here we use immersive virtual reality to investigate whether the illusion of a dramatic increase in belly size can be induced in males through (a) first person perspective position (b) synchronous visual-motor correlation between real and virtual arm movements, and (c) self-induced synchronous visual-tactile stimulation in the stomach area.MethodologyTwenty two participants entered into a virtual reality (VR) delivered through a stereo head-tracked wide field-of-view head-mounted display. They saw from a first person perspective a virtual body substituting their own that had an inflated belly. For four minutes they repeatedly prodded their real belly with a rod that had a virtual counterpart that they saw in the VR. There was a synchronous condition where their prodding movements were synchronous with what they felt and saw and an asynchronous condition where this was not the case. The experiment was repeated twice for each participant in counter-balanced order. Responses were measured by questionnaire, and also a comparison of before and after self-estimates of belly size produced by direct visual manipulation of the virtual body seen from the first person perspective.ConclusionsThe results show that first person perspective of a virtual body that substitutes for the own body in virtual reality, together with synchronous multisensory stimulation can temporarily produce changes in body representation towards the larger belly size. This was demonstrated by (a) questionnaire results, (b) the difference between the self-estimated belly size, judged from a first person perspective, after and before the experimental manipulation, and (c) significant positive correlations between these two measures. We discuss this result in the general context of body ownership illusions, and suggest applications including treatment for body size distortion illnesses.
| S-EPMC3023777 | biostudies-literature
Project description:The subjective experience of emotions is linked to the contextualized perception and appraisal of changes in bodily (e.g., heart) activity. Increased emotional arousal has been related to attenuated high-frequency heart rate variability (HF-HRV), lower EEG parieto-occipital alpha power, and higher heartbeat-evoked potential (HEP) amplitudes. We studied emotional arousal-related brain-heart interactions using immersive virtual reality (VR) for naturalistic yet controlled emotion induction. Twenty-nine healthy adults (13 women, age: 26 ± 3) completed a VR experience that included rollercoasters while EEG and ECG were recorded. Continuous emotional arousal ratings were collected during a video replay immediately after. We analyzed emotional arousal-related changes in HF-HRV as well as in BHIs using HEPs. Additionally, we used the oscillatory information in the ECG and the EEG to model the directional information flows between the brain and heart activity. We found that higher emotional arousal was associated with lower HEP amplitudes in a left fronto-central electrode cluster. While parasympathetic modulation of the heart (HF-HRV) and parieto-occipital EEG alpha power were reduced during higher emotional arousal, there was no evidence for the hypothesized emotional arousal-related changes in bidirectional information flow between them. Whole-brain exploratory analyses in additional EEG (delta, theta, alpha, beta and gamma) and HRV (low-frequency, LF, and HF) frequency bands revealed a temporo-occipital cluster, in which higher emotional arousal was linked to decreased brain-to-heart (i.e., gamma→HF-HRV) and increased heart-to-brain (i.e., LF-HRV → gamma) information flow. Our results confirm previous findings from less naturalistic experiments and suggest a link between emotional arousal and brain-heart interactions in temporo-occipital gamma power.
| S-EPMC11579222 | biostudies-literature
Project description:Given the decline of cadavers as anatomy teaching tools, immersive virtual reality (VR) technology has gained popularity as a potential alternative. To better understand how to maximize the educational potential of VR, this scoping review aimed to identify potential determinants of learning anatomy in an immersive VR environment. A literature search yielded 4523 studies, 25 of which were included after screening. Six common factors were derived from secondary outcomes in these papers: cognitive load, cybersickness, student perceptions, stereopsis, spatial understanding, and interactivity. Further objective research investigating the impact of these factors on anatomy examination performance is required.Supplementary informationThe online version contains supplementary material available at 10.1007/s40670-022-01701-y.
| S-EPMC9774061 | biostudies-literature
Project description:When we move, the visual direction of objects in the environment can change substantially. Compared with our understanding of depth perception, the problem the visual system faces in computing this change is relatively poorly understood. Here, we tested the extent to which participants' judgments of visual direction could be predicted by standard cue combination rules. Participants were tested in virtual reality using a head-mounted display. In a simulated room, they judged the position of an object at one location, before walking to another location in the room and judging, in a second interval, whether an object was at the expected visual direction of the first. By manipulating the scale of the room across intervals, which was subjectively invisible to observers, we put two classes of cue into conflict, one that depends only on visual information and one that uses proprioceptive information to scale any reconstruction of the scene. We find that the sensitivity to changes in one class of cue while keeping the other constant provides a good prediction of performance when both cues vary, consistent with the standard cue combination framework. Nevertheless, by comparing judgments of visual direction with those of distance, we show that judgments of visual direction and distance are mutually inconsistent. We discuss why there is no need for any contradiction between these two conclusions.
| S-EPMC8083085 | biostudies-literature
Project description:BackgroundNeuropsychological tests of executive function have limited real-world predictive and functional relevance. An emerging solution for this limitation is to adapt the tests for implementation in virtual reality (VR). We thus developed two VR-based versions of the classic Color-Trails Test (CTT), a well-validated pencil-and-paper executive function test assessing sustained (Trails A) and divided (Trails B) attention-one for a large-scale VR system (DOME-CTT) and the other for a portable head-mount display VR system (HMD-CTT). We then evaluated construct validity, test-retest reliability, and age-related discriminant validity of the VR-based versions and explored effects on motor function.MethodsHealthy adults (n = 147) in three age groups (young: n = 50; middle-aged: n = 80; older: n = 17) participated. All participants were administered the original CTT, some completing the DOME-CTT (14 young, 29 middle-aged) and the rest completing the HMD-CTT. Primary outcomes were Trails A and B completion times (tA, tB). Spatiotemporal characteristics of upper-limb reaching movements during VR test performance were reconstructed from motion capture data. Statistics included correlations and repeated measures analysis of variance.ResultsConstruct validity was substantiated by moderate correlations between the'gold standard' pencil-and-paper CTT and the VR adaptations (DOME-CTT: tA 0.58, tB 0.71; HMD-CTT: tA 0.62, tB 0.69). VR versions showed relatively high test-retest reliability (intraclass correlation; VR: tA 0.60-0.75, tB 0.59-0.89; original: tA 0.75-0.85, tB 0.77-0.80) and discriminant validity (area under the curve; VR: tA 0.70-0.92, tB 0.71-0.92; original: tA 0.73-0.95, tB 0.77-0.95). VR completion times were longer than for the original pencil-and-paper test; completion times were longer with advanced age. Compared with Trails A, Trails B target-to-target VR hand trajectories were characterized by delayed, more erratic acceleration and deceleration, consistent with the greater executive function demands of divided vs. sustained attention; acceleration onset later for older participants.ConclusionsThe present study demonstrates the feasibility and validity of converting a neuropsychological test from two-dimensional pencil-and-paper to three-dimensional VR-based format while preserving core neuropsychological task features. Findings on the spatiotemporal morphology of motor planning/execution during the cognitive tasks may lead to multimodal analysis methods that enrich the ecological validity of VR-based neuropsychological testing, representing a novel paradigm for studying cognitive-motor interactions.
| S-EPMC8127186 | biostudies-literature
Project description:IntroductionThe use of immersive virtual reality simulated learning environments (VR SLEs) for improving clinical communication can offer desirable qualities including repetition and determinism in a safe environment. The aim of this study was to establish whether the mode of delivery, VR SLE versus clinical role-play, could have a measurable effect on clinical empathic communication skills for MRI scenarios.MethodsA split-cohort study was performed with trainee practitioners (n = 70) and qualified practitioners (n = 9). Participants were randomly assigned to four groups: clinician VR (CVR), clinician role-play (CRP), trainee VR (TVR), and trainee RP (TRP). Clinical communication skills were assessed using two methods: firstly, a self-reported measure - the SE-12 communication questionnaire and, secondly, a training and assessment tool developed by a panel of experts.ResultsParticipants in the VR trainee (TVR) and clinician (CVR) groups reported 11% (P < 0.05) and 7.2% (P < 0.05) improvements in communication confidence post training, whereas trainees assigned to the role-play (TRP) intervention reported a 4.3% (P < 0.05) improvement. Empirical assessment of communication training scores assessing a participant's ability to select empathic statements showed the TVR group performed 5% better on average than their role-play counterparts (P < 0.05).ConclusionThe accuracy of participant's selection of appropriate empathic responses was shown to differ significantly following the training intervention designed to improve interactions with patients that present for an MRI scan. The results may demonstrate the capacity for immersion into an emotional narrative in a VR environment to increase the user's susceptibility for recalling and selecting empathic terminology.
| S-EPMC8892424 | biostudies-literature
Project description:Assessing levels of aggression-specifically reactive violence-has been a challenge in the past, since individuals might be reluctant to self-report aggressive tendencies. Furthermore, experimental studies often lack ecological validity. Immersive Virtual Reality (IVR) offers a reliable, ethically safe environment, and is the most realistic virtual simulation method currently available. It allows researchers to test participants' aggressive responses to realistic provocations from virtual humans. In the current study, 116 participants completed our IVR aggression task, in which they encountered avatars who would either approach them in a friendly or provocative fashion. Participants had the option either to shake hands or hit the virtual human, in congruent and incongruent trials. In congruent trials, the response required of the participant matched the approach with the avatar (e.g., hitting the avatar after provocation). In incongruent trials there was a mismatch between the avatars approach and the participants required response. Congruent trials were designed to measure the immediate reaction towards the virtual human, and incongruent trials to assess response inhibition. Additionally, participants also completed traditional questionnaire-based measures of aggression, as well as reporting their past violent behaviour. We found that the immediate aggressive responses in the IVR task correlated with the established questionnaire measures (convergent validity), and we found that the IVR task was a stronger predictor of past violent behaviour than traditional measures (discriminant validity). This suggests that IVR might be an effective way to assess aggressive behaviour in a more indirect, but realistic manner, than current questionnaire assessment.
| S-EPMC9075670 | biostudies-literature