Dataset Information

Perception and deception: Exploring individual responses to deepfakes across different modalities.

ABSTRACT: This study is one of the first to investigate the relationship between modalities and individuals' tendencies to believe and share different forms of deepfakes (also deep fakes). Using an online survey experiment conducted in the US, participants were randomly assigned to one of three disinformation conditions: video deepfakes, audio deepfakes, and cheap fakes to test the effect of single modality against multimodality and how it affects individuals' perceived claim accuracy and sharing intentions. In addition, the impact of cognitive ability on perceived claim accuracy and sharing intentions between conditions are also examined. The results suggest that individuals are likelier to perceive video deepfakes as more accurate than cheap fakes, but not audio deepfakes. Yet, individuals are more likely to share video deepfakes than cheap and audio deepfakes. We also found that individuals with high cognitive ability are less likely to perceive deepfakes as accurate or share them across formats. The findings emphasize that deepfakes are not monolithic, and associated modalities should be considered when studying user engagement with deepfakes.

SUBMITTER: Ahmed S

PROVIDER: S-EPMC10556585 | biostudies-literature | 2023 Oct

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Perception and deception: Exploring individual responses to deepfakes across different modalities.

Ahmed Saifuddin S Chua Hui Wen HW

Heliyon 20230921 10

This study is one of the first to investigate the relationship between modalities and individuals' tendencies to believe and share different forms of deepfakes (also deep fakes). Using an online survey experiment conducted in the US, participants were randomly assigned to one of three disinformation conditions: video deepfakes, audio deepfakes, and cheap fakes to test the effect of single modality against multimodality and how it affects individuals' perceived claim accuracy and sharing intentio ...[more]

PMID: 37810833

Similar Datasets

Project description:Extensive research documents the existence of egocentric biases in the perception and application of justice norms. The origin of these biases remains poorly understood. We investigated both inter- and intra-individual differences in egocentric justice biases. Participants played an ultimatum game presumably with different anonymous players (simulated by a computer) in which they contributed differentially to the joint production of the initial endowment. We examined how contributions (low vs. high) affect proposers' offers and responders' acceptance decisions, as well as their fairness judgments and their emotional reactions to different types of offers (equal, equitable, unfair, and hyperfair). An egocentric bias in proposers' offers (indicating more flexible preferences) was found only in individualists and not in prosocials, suggesting differences in the motivations (or cognitions) underlying their choice of justice norms. Responders also showed egocentric biases in their judgments of fairness and in their emotional reactions to equal and equitable offers, but not in their acceptance decisions. Such dissociation might suggest that some form of emotion regulation occurred. Responders may evaluate offers on valence dimensions (e.g., goal conduciveness/outcome favorability and norm compatibility/justice) that are multiply interacting and potentially conflicting. The individual's acceptance/rejection decision reflects the relative weight attributed to competing appraisals. For this overt behavioral decision, the (personal) appraisal of outcome favorability that drives (analytical) acceptance of goal-conducive outcome seems to be stronger than the (social) appraisal of outcome fairness, which may trigger covert (emotional) rejection of offers that are incompatible with justice norms. Our data show that the emotional reaction patterns provide a more fine-grained readout of the overall evaluation of the proposer's action, the underlying emotional dynamics of which may, in real life, strongly determine future interactions with specific partners. Further research on the relationship between emotion and behavior in economic games is needed to explore potential dissociations and long-term effects.

Project description:A deepfake is content or material that is synthetically generated or manipulated using artificial intelligence (AI) methods, to be passed off as real and can include audio, video, image, and text synthesis. The key difference between manual editing and deepfakes is that deepfakes are AI generated or AI manipulated and closely resemble authentic artifacts. In some cases, deepfakes can be fabricated using AI-generated content in its entirety. Deepfakes have started to have a major impact on society with more generation mechanisms emerging everyday. This article makes a contribution in understanding the landscape of deepfakes, and their detection and generation methods. We evaluate various categories of deepfakes especially in audio. The purpose of this survey is to provide readers with a deeper understanding of (1) different deepfake categories; (2) how they could be created and detected; (3) more specifically, how audio deepfakes are created and detected in more detail, which is the main focus of this paper. We found that generative adversarial networks (GANs), convolutional neural networks (CNNs), and deep neural networks (DNNs) are common ways of creating and detecting deepfakes. In our evaluation of over 150 methods, we found that the majority of the focus is on video deepfakes, and, in particular, the generation of video deepfakes. We found that for text deepfakes, there are more generation methods but very few robust methods for detection, including fake news detection, which has become a controversial area of research because of the potential heavy overlaps with human generation of fake content. Our study reveals a clear need to research audio deepfakes and particularly detection of audio deepfakes. This survey has been conducted with a different perspective, compared to existing survey papers that mostly focus on just video and image deepfakes. This survey mainly focuses on audio deepfakes that are overlooked in most of the existing surveys. This article's most important contribution is to critically analyze and provide a unique source of audio deepfake research, mostly ranging from 2016 to 2021. To the best of our knowledge, this is the first survey focusing on audio deepfakes generation and detection in English.

Project description:Slowed gait in patients with Parkinson's disease (PD) can be improved when patients synchronize footsteps to isochronous metronome cues, but limited retention of such improvements suggest that permanent cueing regimes are needed for long-term improvements. If so, music might make permanent cueing regimes more pleasant, improving adherence; however, music cueing requires patients to synchronize movements to the "beat," which might be difficult for patients with PD who tend to show weak beat perception. One solution may be to use high-groove music, which has high beat salience that may facilitate synchronization, and affective properties, which may improve motivation to move. As a first step to understanding how beat perception affects gait in complex neurological disorders, we examined how beat perception ability affected gait in neurotypical adults. Synchronization performance and gait parameters were assessed as healthy young adults with strong or weak beat perception synchronized to low-groove music, high-groove music, and metronome cues. High-groove music was predicted to elicit better synchronization than low-groove music, due to its higher beat salience. Two musical tempi, or rates, were used: (1) preferred tempo: beat rate matched to preferred step rate and (2) faster tempo: beat rate adjusted to 22.5% faster than preferred step rate. For both strong and weak beat-perceivers, synchronization performance was best with metronome cues, followed by high-groove music, and worst with low-groove music. In addition, high-groove music elicited longer and faster steps than low-groove music, both at preferred tempo and at faster tempo. Low-groove music was particularly detrimental to gait in weak beat-perceivers, who showed slower and shorter steps compared to uncued walking. The findings show that individual differences in beat perception affect gait when synchronizing footsteps to music, and have implications for using music in gait rehabilitation.

Dataset Information

Perception and deception: Exploring individual responses to deepfakes across different modalities.

Publications

Perception and deception: Exploring individual responses to deepfakes across different modalities.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets