Browse
Submit Data
Databases
API
Help

Dataset Information

0 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

You Know What I Know: Interviewer Knowledge Effects in Subjective Expectation Elicitation.

ABSTRACT: Directly eliciting individuals' subjective beliefs via surveys is increasingly popular in social science research, but doing so via face-to-face surveys has an important downside: the interviewer's knowledge of the topic may spill over onto the respondent's recorded beliefs. Using a randomized experiment that used interviewers to implement an information treatment, we show that reported beliefs are significantly shifted by interviewer knowledge. Trained interviewers primed respondents to use the exact numbers used in the training, nudging them away from higher answers; recorded responses decreased by about 0.3 standard deviations of the initial belief distribution. Furthermore, respondents with stronger prior beliefs were less affected by interviewer knowledge. We suggest corrections for this issue from the perspectives of interviewer recruitment, survey design, and experiment setup.

SUBMITTER: Kerwin JT

PROVIDER: S-EPMC8041053 | biostudies-literature | 2021 Feb

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Publications

You Know What I Know: Interviewer Knowledge Effects in Subjective Expectation Elicitation.

Kerwin Jason T JT Ordaz Reynoso Natalia N

Demography 20210201 1

Directly eliciting individuals' subjective beliefs via surveys is increasingly popular in social science research, but doing so via face-to-face surveys has an important downside: the interviewer's knowledge of the topic may spill over onto the respondent's recorded beliefs. Using a randomized experiment that used interviewers to implement an information treatment, we show that reported beliefs are significantly shifted by interviewer knowledge. Trained interviewers primed respondents to use the ...[more]

PMID: 33834250

Similar Datasets

Experimental Investigation on the Elicitation of Subjective Distributions.

Project description:Elicitation methods aim to build participants' distributions about a parameter of interest. In most elicitation studies this parameter is rarely known in advance and hinders an objective comparison between elicitation methods. In two experiments, participants were first presented with a fixed random sequence of images and numbers and subsequently their subjective distributions of percentages of one of those numbers was elicited. Importantly, the true percentage was set in advance. The first experiment tested whether receiving instructions as to the elicitation method would assist in estimating a true value more accurately than receiving no instructions and whether accuracy was determined by the numerical skills of the participants. The second experiment sought to compare the elicitation method used in the first experiment with a variation of a graphical elicitation method. The results indicate that (i) receiving instructions as to the elicitation method does assist in producing estimates closer to a true percentage value, (ii) the level of numerical skills does not play a part in the accuracy of the estimation (Experiment 1), and (iii) although the average estimates of the betting and graphical method are not significantly different, the betting method leads to more precise estimations than the graphical method (Experiment 2). Both studies featured statistical procedures (functional data analysis and a novel clustering technique) not considered in past research on the elicitation of subjective distributions. The implications of these results are discussed in relation to a recent key study.

| S-EPMC6489894 | biostudies-other

Interviewer effects in food acquisition surveys.

Project description:ObjectiveTo understand the effects of interviewers on the responses they collect for measures of food security, income and selected survey quality measures (i.e. discrepancy between reported Supplemental Nutrition Assistance Program (SNAP) status and administrative data, length of time between initial and final interview, and missing income data) in the US Department of Agriculture's National Household Food Acquisition and Purchase Survey (FoodAPS).DesignUsing data from FoodAPS, multilevel models with random interviewer effects were fitted to estimate the variance in each outcome measure arising from effects of the interviewers. Covariates describing each household's socio-economic status, demographics and experience in taking the survey, and interviewer-level experience were included as fixed effects. The variance components in the outcomes due to interviewers were estimated. Outlier interviewers were profiled.SettingNon-institutionalized households in the continental USA (April 2012-January 2013).SubjectsIndividuals (n 14 317) in 4826 households who responded to FoodAPS.ResultsThere was a substantial amount of variability in the distributions of the outcomes examined (i.e. time between initial and final interview, reported values for food security, individual income, missing income) among the FoodAPS interviewers, even after accounting for the fixed effects of the household- and interviewer-level covariates and removing extreme outlier interviewers.ConclusionsInterviewers may introduce error in food acquisition survey data when they are asked to interact with the respondents. Managers of future surveys with similarly complex data collection procedures could consider using multilevel models to adaptively identify and retrain interviewers who have extreme effects on data collection outcomes.

| S-EPMC10261034 | biostudies-literature

Mode and Interviewer Effects in Egocentric Network Research.

Project description:Surveys of egocentric networks are especially vulnerable to methods effects. This study combines a true experiment-random assignment of respondents to receive essentially identical questions from either an in-person interviewer or an online survey--with audio recordings of the in-person interviews. We asked over 850 respondents from a general population several different name-eliciting questions. Face-to-face interviews yielded more cooperation and higher quality data but fewer names than did the web surveys. Exploring several explanations, we determine that interviewer differences account for the mode difference: Interviewers who consistently prompted respondents elicited as many alters as did the web survey and substantially more than did less active interviewers. Although both methods effects substantially influenced the volume of alters listed, they did not substantially modify associations of other variables with volume.

| S-EPMC6748643 | biostudies-literature

Corticoinsular circuits encode subjective value expectation and violation for effortful goal-directed behavior.

Project description:We are presented with choices each day about how to invest our effort to achieve our goals. Critically, these decisions must frequently be made under conditions of incomplete information, where either the effort required or possible reward to be gained is uncertain. Such choices therefore require the development of potential value estimates to guide effortful goal-directed behavior. To date, however, the neural mechanisms for this expectation process are unknown. Here, we used computational fMRI during an effort-based decision-making task where trial-wise information about effort costs and reward magnitudes was presented separately over time, thereby allowing us to model distinct effort/reward computations as choice-relevant information unfolded. We found that ventromedial prefrontal cortex (vmPFC) encoded expected subjective value. Further, activity in dorsal anterior cingulate (dACC) and anterior insula (aI) reflected both effort discounting as well as a subjective value prediction error signal derived from trial history. While prior studies have identified these regions as being involved in effort-based decision making, these data demonstrate their specific role in the formation and maintenance of subjective value estimates as relevant information becomes available.

| S-EPMC5984520 | biostudies-literature

Interviewer Effects in Live Video and Prerecorded Video Interviewing

Project description:Abstract Live video (LV) communication tools (e.g., Zoom) have the potential to provide survey researchers with many of the benefits of in-person interviewing, while also greatly reducing data collection costs, given that interviewers do not need to travel and make in-person visits to sampled households. The COVID-19 pandemic has exposed the vulnerability of in-person data collection to public health crises, forcing survey researchers to explore remote data collection modes—such as LV interviewing—that seem likely to yield high-quality data without in-person interaction. Given the potential benefits of these technologies, the operational and methodological aspects of video interviewing have started to receive research attention from survey methodologists. Although it is remote, video interviewing still involves respondent–interviewer interaction that introduces the possibility of interviewer effects. No research to date has evaluated this potential threat to the quality of the data collected in video interviews. This research note presents an evaluation of interviewer effects in a recent experimental study of alternative approaches to video interviewing including both LV interviewing and the use of prerecorded videos of the same interviewers asking questions embedded in a web survey (“prerecorded video” interviewing). We find little evidence of significant interviewer effects when using these two approaches, which is a promising result. We also find that when interviewer effects were present, they tended to be slightly larger in the LV approach as would be expected in light of its being an interactive approach. We conclude with a discussion of the implications of these findings for future research using video interviewing.

| S-EPMC8690284 | biostudies-literature

Expectation effects in working memory training.

Project description:There is a growing body of research focused on developing and evaluating behavioral training paradigms meant to induce enhancements in cognitive function. It has recently been proposed that one mechanism through which such performance gains could be induced involves participants' expectations of improvement. However, no work to date has evaluated whether it is possible to cause changes in cognitive function in a long-term behavioral training study by manipulating expectations. In this study, positive or negative expectations about cognitive training were both explicitly and associatively induced before either a working memory training intervention or a control intervention. Consistent with previous work, a main effect of the training condition was found, with individuals trained on the working memory task showing larger gains in cognitive function than those trained on the control task. Interestingly, a main effect of expectation was also found, with individuals given positive expectations showing larger cognitive gains than those who were given negative expectations (regardless of training condition). No interaction effect between training and expectations was found. Exploratory analyses suggest that certain individual characteristics (e.g., personality, motivation) moderate the size of the expectation effect. These results highlight aspects of methodology that can inform future behavioral interventions and suggest that participant expectations could be capitalized on to maximize training outcomes.

| S-EPMC9477404 | biostudies-literature

Examining interviewer bias in medical school admissions: The interplay between applicant and interviewer gender and its effects on interview outcomes.

Project description:Selection interviews have long been integral to medical school admissions, yet their limited predictive validity and susceptibility to bias raise concerns. This study delves into potential interviewer bias within the dynamics of interviewee and interviewer gender. We analyze a dataset of 5,200 applicants and over 370 selection committees engaged in semi-structured interviews from 2006 to 2019 at a large German medical school with multiple linear and non-linear regression analyses. Our findings reveal that all-female committees tended to award male candidates, on average, one point more than their female counterparts, significantly enhancing the chances of submission for male applicants despite lower academic grades, which constituted 51% of the selection process points. All-male and mixed-gender committees exhibited similar ratings for both genders. The role of valuing voluntary services emerged prominently: all-male and mixed committees acknowledged women's volunteer work but not men's, while all-female committees demonstrated the opposite pattern. Our results attribute variations in interview outcomes to the absence of standardization, such as insufficient interviewer training, divergent rating strategies, variations in interviewer experience, and imbalances in candidate allocation to selection committees, rather than to a "gender bias", for example by favoritism of males because of their gender.

| S-EPMC11346660 | biostudies-literature

Relationship Between Medical Students' Empathy and Occupation Expectation: Mediating Roles of Resilience and Subjective Well-Being.

Project description:Background: The occupation expectation of medical students can predict the possibility of their future employment in the medical industry, and empathy is the special ability of medical students in their study and career, which affects the development of their occupation expectation. Objective: To explore the relationship between resilience and subjective well-being between medical students' empathy and occupation expectation and their internal mechanisms. Design: Data were collected from October 2020 to March 2021 using a paper questionnaire survey. Subjective: 586 medical students at a key medical university in Yunnan Province were invited to complete the survey. Main Measures: The Basic Empathy Scale, Connor-Davidson Resilience Scale, Subjective Well-Being Questionnaire, and Occupation Expectation Scale. Key Results: The empathy is intended to affect the occupation expectation of medical students through four paths. The direct path effect value is 0.073 (95% CI: 0.007∼0.217), the indirect path 1 effect value is 0.078 (95% CI: 0.022∼0.134), indirect path 2 effect value is 0.010 (95% CI: 0.005∼0.022), indirect path 3 effect value is 0.022 (95% CI: 0.0604∼0.039), all the confidence intervals do not contain 0, and the mediated effect ratio is 60.109%. Conclusion: Empathy has an impact on occupation expectation of medical students through the sequential mediating effects of resilience and subjective well-being. Medical colleges should fully consider the role of protective factors when cultivating and enhancing the occupation expectation of clinical medical students. Strengthening the intervention of emotional factors (empathy), self-regulating ability (psychological toughness) and cognitive factors (subjective well-being) is an important way to effectively establish professional values, improve occupation expectation of medical students and reduce the turnover rate of medical students.

| S-EPMC8503271 | biostudies-literature

Know Thyself! Predicting Subjective Well-Being from personality estimation discrepancy and self-insight.

Project description:Discrepancies in views of the Self are suggested to be negatively related to well-being (Higgins, 1987). In the present study, we used a novel concept, Personality Estimation Discrepancy (PED), to test this classic idea. PED is defined as the computed difference between how one view oneself (Self-Perceived Personality) and a standard Big Five test (IPIP-NEO-30). In a pre-registered (osf.io) UK online study (N = 297; Mage = 37, SD = 14) we analyzed: (1) whether PED would predict Subjective Well-Being (SWB; Harmony in Life, Satisfaction with Life, Positive affect, Negative Affect) and Self-Insight, and (2) whether Self-Insight would mediate the relationship between PED and SWB. The results showed that underestimation of Extraversion, Conscientiousness, and Emotional Stability indeed is associated with both high SWB and high Self-Insight. However, these effects mostly disappeared when controlling for the Big Five test scores. Furthermore, Self-Insight largely (42.9%) mediated the relationship between the mis-estimation and SWB. We interpret these finding such that the relationship of mis-estimating one's personality with SWB and Self-Insight are mostly explained by the Big Five factors, yet the discrepancy is a dependent feature of scoring particularly high or low on certain personality traits.Supplementary informationThe online version contains supplementary material available at 10.1007/s12144-022-03396-1.

| S-EPMC9361999 | biostudies-literature

Boundary effects of expectation in human pain perception.

Project description:Perception of sensory stimulation is influenced by numerous psychological variables. One example is placebo analgesia, where expecting low pain causes a painful stimulus to feel less painful. Yet, because pain evolved to signal threats to survival, it should be maladaptive for highly-erroneous expectations to yield unrealistic pain experiences. Therefore, we hypothesised that a cue followed by a highly discrepant stimulus intensity, which generates a large prediction error, will have a weaker influence on the perception of that stimulus. To test this hypothesis we collected two independent pain-cueing datasets. The second dataset and the analysis plan were preregistered ( https://osf.io/5r6z7/ ). Regression modelling revealed that reported pain intensities were best explained by a quartic polynomial model of the prediction error. The results indicated that the influence of cues on perceived pain decreased when stimulus intensity was very different from expectations, suggesting that prediction error size has an immediate functional role in pain perception.

| S-EPMC6602973 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data