Dataset Information

The Unique and Interactive Effects of Faces, Postures, and Scenes on Emotion Categorization.

ABSTRACT: There is ongoing debate as to whether emotion perception is determined by facial expressions or context (i.e., non-facial cues). The present investigation examined the independent and interactive effects of six emotions (anger, disgust, fear, joy, sadness, neutral) conveyed by combinations of facial expressions, bodily postures, and background scenes in a fully crossed design. Participants viewed each face-posture-scene (FPS) combination for 5 s and were then asked to categorize the emotion depicted in the image. Four key findings emerged from the analyses: (1) For fully incongruent FPS combinations, participants categorized images using the face in 61% of instances and the posture and scene in 18% and 11% of instances, respectively; (2) postures (with neutral scenes) and scenes (with neutral postures) exerted differential influences on emotion categorizations when combined with incongruent facial expressions; (3) contextual asymmetries were observed for some incongruent face-posture pairings and their inverse (e.g., anger-fear vs. fear-anger), but not for face-scene pairings; (4) finally, scenes exhibited a boosting effect of posture when combined with a congruent posture and attenuated the effect of posture when combined with a congruent face. Overall, these findings highlight independent and interactional roles of posture and scene in emotion face perception. Theoretical implications for the study of emotions in context are discussed.

Supplementary information

The online version contains supplementary material available at 10.1007/s42761-021-00061-x.

SUBMITTER: Reschke PJ

PROVIDER: S-EPMC9382938 | biostudies-literature | 2021 Dec

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

The Unique and Interactive Effects of Faces, Postures, and Scenes on Emotion Categorization.

Reschke Peter J PJ Walle Eric A EA

Affective science 20210924 4

There is ongoing debate as to whether emotion perception is determined by facial expressions or context (i.e., non-facial cues). The present investigation examined the independent and interactive effects of six emotions (anger, disgust, fear, joy, sadness, neutral) conveyed by combinations of facial expressions, bodily postures, and background scenes in a fully crossed design. Participants viewed each face-posture-scene (FPS) combination for 5 s and were then asked to categorize the emotion depi ...[more]

PMID: 36046211

Similar Datasets

Project description:As with faces, participants are better at discriminating upright bodies than inverted bodies. This inversion effect is reliable for whole figures, namely, bodies with heads, but it is less reliable for headless bodies. This suggests that removal of the head disrupts typical processing of human figures, and raises questions about the role of faces in efficient body discrimination. In most studies, faces are occluded, but the aim here was to exclude faces in a more ecologically valid way by presenting photographic images of human figures from behind (about-facing), as well as measuring gaze to different parts of the figures. Participants determined whether pairs of sequentially presented body postures were the same or different for whole and headless figures. Presenting about-facing figures (heads seen from behind) and forward-facing figures with faces enabled a comparison of the effect of the presence or absence of faces. Replicating previous findings, there were inversion effects for forward-facing whole figures, but less reliable effects for headless images. There were also inversion effects for about-facing whole figures, but not about-facing headless figures. Accuracy was higher in the forward- compared to the about-facing conditions, but proportional dwell time was greater to bodies in about-facing images. Likewise, despite better discrimination of forward-facing upright compared to inverted whole figures, participants focused more on the heads and less on the bodies in upright compared to inverted images. However, there was no clear relationship between performance and dwell time proportions to heads. Body inversion effects (BIEs) were found with about-facing whole figures and headless forward-facing figures, despite the absence of faces. With inverted whole figures, there was a significant relationship between performance and greater looking at bodies, and less at heads suggesting that in more difficult conditions a focus on bodies is associated with better discrimination. Overall, the findings suggest that the visual system has greater sensitivity to bodies in their most experienced form, which is typically upright and with a head. Otherwise, the more a face is implied by the context, as in whole figures or forward- rather than about-facing headless bodies, the better the performance as holistic/configural processing is likely stronger.

Project description:Seamlessly extracting emotional information from voices is crucial for efficient interpersonal communication. However, it remains unclear how the brain categorizes vocal expressions of emotion beyond the processing of their acoustic features. In our study, we developed a new approach combining electroencephalographic recordings (EEG) in humans with a frequency-tagging paradigm to 'tag' automatic neural responses to specific categories of emotion expressions. Participants were presented with a periodic stream of heterogeneous non-verbal emotional vocalizations belonging to five emotion categories: anger, disgust, fear, happiness and sadness at 2.5 Hz (stimuli length of 350 ms with a 50 ms silent gap between stimuli). Importantly, unknown to the participant, a specific emotion category appeared at a target presentation rate of 0.83 Hz that would elicit an additional response in the EEG spectrum only if the brain discriminates the target emotion category from other emotion categories and generalizes across heterogeneous exemplars of the target emotion category. Stimuli were matched across emotion categories for harmonicity-to-noise ratio, spectral center of gravity and pitch. Additionally, participants were presented with a scrambled version of the stimuli with identical spectral content and periodicity but disrupted intelligibility. Both types of sequences had comparable envelopes and early auditory peripheral processing computed via the simulation of the cochlear response. We observed that in addition to the responses at the general presentation frequency (2.5 Hz) in both intact and scrambled sequences, a greater peak in the EEG spectrum at the target emotion presentation rate (0.83 Hz) and its harmonics emerged in the intact sequence in comparison to the scrambled sequence. The greater response at the target frequency in the intact sequence, together with our stimuli matching procedure, suggest that the categorical brain response elicited by a specific emotion is at least partially independent from the low-level acoustic features of the sounds. Moreover, responses at the fearful and happy vocalizations presentation rates elicited different topographies and different temporal dynamics, suggesting that different discrete emotions are represented differently in the brain. Our paradigm revealed the brain's ability to automatically categorize non-verbal vocal emotion expressions objectively (at a predefined frequency of interest), behavior-free, rapidly (in few minutes of recording time) and robustly (with a high signal-to-noise ratio), making it a useful tool to study vocal emotion processing and auditory categorization in general and in populations where behavioral assessments are more challenging.

Dataset Information

The Unique and Interactive Effects of Faces, Postures, and Scenes on Emotion Categorization.

Supplementary information

Publications

The Unique and Interactive Effects of Faces, Postures, and Scenes on Emotion Categorization.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets