Dataset Information

Data-driven analysis of facial thermal responses and multimodal physiological consistency among subjects.

ABSTRACT: Facial infra-red imaging (IRI) is a contact-free technique complimenting the traditional psychophysiological measures to characterize physiological profile. However, its full potential in affective research is arguably unmet due to the analytical challenges it poses. Here we acquired facial IRI data, facial expressions and traditional physiological recordings (heart rate and skin conductance) from healthy human subjects whilst they viewed a 20-min-long unedited emotional movie. We present a novel application of motion correction and the results of spatial independent component analysis of the thermal data. Three distinct spatial components are recovered associated with the nose, the cheeks and respiration. We first benchmark this methodology against a traditional nose-tip region-of-interest based technique showing an expected similarity of signals extracted by these methods. We then show significant correlation of all the physiological responses across subjects, including the thermal signals, suggesting common dynamic shifts in emotional state induced by the movie. In sum, this study introduces an innovative approach to analyse facial IRI data and highlights the potential of thermal imaging to robustly capture emotion-related changes induced by ecological stimuli.

SUBMITTER: Sonkusare S

PROVIDER: S-EPMC8187483 | biostudies-literature | 2021 Jun

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Data-driven analysis of facial thermal responses and multimodal physiological consistency among subjects.

Sonkusare Saurabh S Breakspear Michael M Pang Tianji T Nguyen Vinh Thai VT Frydman Sascha S Guo Christine Cong CC Aburn Matthew J MJ

Scientific reports 20210608 1

Facial infra-red imaging (IRI) is a contact-free technique complimenting the traditional psychophysiological measures to characterize physiological profile. However, its full potential in affective research is arguably unmet due to the analytical challenges it poses. Here we acquired facial IRI data, facial expressions and traditional physiological recordings (heart rate and skin conductance) from healthy human subjects whilst they viewed a 20-min-long unedited emotional movie. We present a nove ...[more]

PMID: 34103607

Similar Datasets

Project description:BackgroundExisting research indicates that the personality traits of miners influence their emotional regulation strategies, and these strategies in turn affect their performance in work fatigue. However, whether there is an intermediary or moderating role among these factors remains unclear. Additionally, while some studies suggest an increased likelihood of unsafe behavior among miners following fatigue, physiological data concerning their cognition remains incomplete and requires further exploration. This study aims to explore the mediating and moderating effects of emotional regulation strategies among miners regarding their personality traits and work fatigue, and to expand understanding of the cognitive and physiological data related to miners' risk decision-making following fatigue.MethodFifty adult miners (Mage = 25, aged 18-40, 100% male) were selected as participants. Emotional regulation tendency, significant levels of personality traits based on the Big Five Personality Traits questionnaire, and the three-dimensional levels of work fatigue were measured using emotional regulation strategy scale, Big Five Personality Traits questionnaire, and work fatigue scale, respectively. The eye-brain consistency hypothesis posits that eye movement trajectories and fixation points reflect the brain's cognitive processes and focus. Therefore, combining eye-tracking experiments, miners' preferences in risk decision-making were further measured.ResultsExpressive suppression strategies mediated between conscientiousness and depersonalization; expressive suppression strategies moderated between agreeableness and emotional exhaustion. In eye-tracking physiological experiments, significant differences were found in eye movement data among miners with varying levels of emotional exhaustion.ConclusionPreferences in emotional regulation strategies play mediating and moderating roles between miners' Big Five Personality Traits and work fatigue. The levels and dimensions of work fatigue are influenced not only by personality traits but also by individual tendencies in emotional regulation strategies, which significantly affect performance in risk decision-making. The findings of this study can further enrich theories related to work fatigue among miners and provide insights for personalized safety management in mining.

Project description:The impact of temperature on reptile physiology has been examined through two main parameters: locomotor performance and metabolic rates. Among reptiles, different species may respond to environmental temperatures in distinct ways, depending on their thermal sensitivity. Such variation can be linked to the ecological lifestyle of the species and needs to be taken into consideration when assessing the thermal influence on physiology. This is particularly relevant for snakes, which are a very functionally diverse group. In this study, our aim was to analyze the thermal sensitivity of locomotor performance and resting metabolic rate (RMR) in three snake species from central Mexico (Crotalus polystictus, Conopsis lineata, and Thamnophis melanogaster), highlighting how it is influenced by their distinctive behavioral and ecological traits. We tested both physiological parameters in five thermal treatments: 15 °C, 25 °C, 30 °C, 33 °C, and 36 °C. Using the performance data, we developed thermal performance curves (TPCs) for each species and analyzed the RMR data using generalized linear mixed models. The optimal temperature for locomotion of C. polystictus falls near its critical thermal maximum, suggesting that it can maintain performance at high temperatures but with a narrow thermal safety margin. T. melanogaster exhibited the fastest swimming speeds and the highest mass-adjusted RMR. This aligns with our expectations since it is an active forager, a high energy demand mode. The three species have a wide performance breadth, which suggests that they are thermal generalists that can maintain performance over a wide interval of temperatures. This can be beneficial to C. lineata in its cold habitat, since such a characteristic has been found to allow some species to maintain adequate performance levels in suboptimal temperatures. RMR increased along with temperature, but the proportional surge was not uniform since thermal sensitivity measured through Q10 increased at the low and high thermal treatments. High Q10 at low temperatures could be an adaptation to maintain favorable performance in suboptimal temperatures, whereas high Q10 at high temperatures could facilitate physiological responses to heat stress. Overall, our results show different physiological adaptations of the three species to the environments they inhabit. Their different activity patterns and foraging habits are closely linked to these adaptations. Further studies of other populations with different climatic conditions would provide valuable information to complement our current understanding of the effect of environmental properties on snake physiology.

Project description:Differences in expressing facial emotions are broadly observed in people with cognitive impairment. However, these differences have been difficult to objectively quantify and systematically evaluate among people with cognitive impairment across disease etiologies and severity. Therefore, a computer vision-based deep learning model for facial emotion recognition trained on 400.000 faces was utilized to analyze facial emotions expressed during a passive viewing memory test. In addition, this study was conducted on a large number of individuals (n = 493), including healthy controls and individuals with cognitive impairment due to diverse underlying etiologies and across different disease stages. Diagnoses included subjective cognitive impairment, Mild Cognitive Impairment (MCI) due to AD, MCI due to other etiologies, dementia due to Alzheimer's diseases (AD), and dementia due to other etiologies (e.g., Vascular Dementia, Frontotemporal Dementia, Lewy Body Dementia, etc.). The Montreal Cognitive Assessment (MoCA) was used to evaluate cognitive performance across all participants. A participant with a score of less than or equal to 24 was considered cognitively impaired (CI). Compared to cognitively unimpaired (CU) participants, CI participants expressed significantly less positive emotions, more negative emotions, and higher facial expressiveness during the test. In addition, classification analysis revealed that facial emotions expressed during the test allowed effective differentiation of CI from CU participants, largely independent of sex, race, age, education level, mood, and eye movements (derived from an eye-tracking-based digital biomarker for cognitive impairment). No screening methods reliably differentiated the underlying etiology of the cognitive impairment. The findings provide quantitative and comprehensive evidence that the expression of facial emotions is significantly different in people with cognitive impairment, and suggests this may be a useful tool for passive screening of cognitive impairment.

Project description:IntroductionThis study aimed to identify research areas that demand attention in multimodal data-driven surgery for improving data management in minimally invasive surgery.BackgroundNew surgical procedures, high-tech equipment, and digital tools are increasingly being introduced, potentially benefiting patients and surgical teams. These innovations have resulted in operating rooms evolving into data-rich environments, which, in turn, requires a thorough understanding of the data pipeline for improved and more intelligent real-time data usage. As this new domain is vast, it is necessary to identify where efforts should be focused on developing seamless and practical data usage.MethodsA modified electronic Delphi approach was used; 53 investigators were divided into the following groups: a research group (n=9) for problem identification and a narrative literature review, a medical and technical expert group (n=14) for validation, and an invited panel (n=30) for two electronic survey rounds. Round 1 focused on a consensus regarding bottlenecks in surgical data science areas and research gaps, while round 2 prioritized the statements from round 1, and a roadmap was created based on the identified essential and very important research gaps.ResultsConsensus panelists have identified key research areas, including digitizing operating room (OR) activities, improving data streaming through advanced technologies, uniform protocols for handling multimodal data, and integrating AI for efficiency and safety. The roadmap prioritizes standardizing OR data formats, integrating OR data with patient information, ensuring regulatory compliance, standardizing surgical AI models, and securing data transfers in the next generation of wireless networks.ConclusionsThis work is an international expert consensus regarding the current issues and key research targets in the promising field of data-driven surgery, highlighting the research needs of many operating room stakeholders with the aim of facilitating the implementation of novel patient care strategies in minimally invasive surgery.

Dataset Information

Data-driven analysis of facial thermal responses and multimodal physiological consistency among subjects.

Publications

Data-driven analysis of facial thermal responses and multimodal physiological consistency among subjects.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets