Dataset Information

Post Hoc Bias in Treatment Decisions.

ABSTRACT:

Importance

A goal of health care is to reduce symptoms and improve health status, whereas continuing dubious treatments can contribute to complacency, discourage the search for alternatives, and lead to shortfalls in care.

Objective

To test a potential bias in intuitive reasoning following a marginal improvement in symptoms after a dubious treatment (post hoc bias).

Design, setting, and participants

Surveys eliciting treatment recommendations for hypothetical patients were sent to community members throughout North America recruited via an online survey platform in the early winter months of 2023 and 2024 and presented to health care professionals (pharmacists who were approached in person using a secret shopper technique) in the summer months of 2023.

Exposure

Respondents received randomized versions of surveys that differed according to whether vague symptoms improved or remained unchanged after a dubious treatment.

Main outcomes and measures

The primary outcome was a recommendation to continue treatment.

Results

In total, 1497 community members (mean [SD] age, 38.1 [12.5] years; 663 female [55.3%]) and 100 health care professionals were contacted. The first scenario described a patient with a sore throat who took unprescribed antibiotics; respondents were more likely to continue antibiotics after initial treatment if there was a marginal improvement in symptoms vs when symptoms remained unchanged (67 of 150 respondents [45%] vs 25 of respondents [17%]; odds ratio [OR], 3.98 [95% CI, 2.33-6.78]; P < .001). Another scenario described a patient with wrist pain who wore a copper bracelet; respondents were more likely to continue wearing the copper bracelet after initial care was followed by a marginal improvement in symptoms vs when symptoms remained unchanged (78 of 100 respondents [78%] vs 25 of 99 respondents [25%]; OR, 16.19 [95% CI, 5.32-19.52]; P < .001). A third scenario described a patient with fatigue who took unprescribed vitamin B12; respondents were more likely to continue taking vitamin B12 when initial treatment was followed by a marginal improvement in symptoms vs when symptoms remained unchanged (80 of 100 respondents [80%] vs 33 of 100 respondents [33%]; OR, 7.91 [95% CI, 4.18-14.97]; P < .001). Four further scenarios involving dubious treatments found similar results, including when tested on health care professionals.

Conclusions and relevance

In this study of clinical scenarios, a marginal improvement in symptoms led patients to continue a dubious and sometimes costly treatment, suggesting that clinicians should caution patients against post hoc bias.

SUBMITTER: Redelmeier DA

PROVIDER: S-EPMC11375477 | biostudies-literature | 2024 Sep

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Post Hoc Bias in Treatment Decisions.

Redelmeier Donald A DA Shafir Eldar E

JAMA network open 20240903 9

<h4>Importance</h4>A goal of health care is to reduce symptoms and improve health status, whereas continuing dubious treatments can contribute to complacency, discourage the search for alternatives, and lead to shortfalls in care.<h4>Objective</h4>To test a potential bias in intuitive reasoning following a marginal improvement in symptoms after a dubious treatment (post hoc bias).<h4>Design, setting, and participants</h4>Surveys eliciting treatment recommendations for hypothetical patients were ...[more]

PMID: 39230904

Similar Datasets

Project description:BackgroundPast studies have shown a commission bias for cancer treatment, a tendency to choose active treatment even when watchful waiting is less risky. This bias suggests motivations for action beyond mortality statistics, but recent evidence suggests that individuals differ in their emotional sensitivity to probabilities (ESP), the tendency to calibrate emotional reactions to probability. The current study aims to examine the role of ESP in the commission bias, specifically whether those higher in ESP are more likely to choose watchful waiting when risk probabilities align with that choice.MethodsParticipants (N = 1,055) read a scenario describing a hypothetical cancer diagnosis and chose between surgery and watchful waiting, with random assignment between versions where the mortality rate was either lower for surgery or for watchful waiting. We modeled choice using the Possibility Probability Questionnaire (PPQ), a measure of ESP, and several other individual differences in a logistic regression.ResultsWe observed a commission bias as in past studies with most participants choosing surgery both when surgery was optimal (71%) and when watchful waiting was optimal (58%). An ESP × Condition interaction indicated that the predictive role of ESP depended on condition. Those higher in ESP were more likely to choose surgery when probabilities favored surgery, β = 0.57, P < 0.001, but when probabilities favored watchful waiting, ESP had a near-zero relationship with choice, β = 0.05, P < 0.99.ConclusionsThe role of ESP in decision making is context specific. Higher levels of ESP predict choosing action when that action is warranted but do not predict a shift away from surgery when watchful waiting offers better chances of survival. ESP does not overcome the commission bias.HighlightsPast studies have identified a "commission bias," a tendency to choose active treatment over watchful waiting, even when mortality rate is lower for waiting.Evaluation of risk probabilities is related to individual differences in emotional sensitivity to probabilities (ESP) and has been shown to predict reactions to and decisions about health risk situations.ESP appears to be selectively factored into decision making. ESP was a robust predictor of choosing surgery when probability information supported surgery but did not predict decisions when probability information supported watchful waiting.Those who are most emotionally attuned to probabilities are just as susceptible to the commission bias as those who are less attuned.

Project description:BackgroundIn the REMoxTB study of 4-month treatment-shortening regimens containing moxifloxacin compared to the standard 6-month regimen for tuberculosis, the proportion of unfavourable outcomes for women was similar in all study arms, but men had more frequent unfavourable outcomes (bacteriologically or clinically defined failure or relapse within 18 months after randomisation) on the shortened moxifloxacin-containing regimens. The reason for this gender disparity in treatment outcome is poorly understood.MethodsThe gender differences in baseline variables were calculated, as was time to smear and culture conversion and Kaplan-Meier plots were constructed. In post hoc exploratory analyses, multivariable logistic regression modelling and an observed case analysis were used to explore factors associated with both gender and unfavourable treatment outcome.ResultsThe per-protocol population included 472/1548 (30%) women. Women were younger and had lower rates of cavitation, smoking and weight (all p < 0.05) and higher prevalence of HIV (10% vs 6%, p = 0.001). They received higher doses (mg/kg) than men of rifampicin, isoniazid, pyrazinamide and moxifloxacin (p ≤ 0.005). There was no difference in baseline smear grading or mycobacterial growth indicator tube (MGIT) time to positivity. Women converted to negative cultures more quickly than men on Lowenstein-Jensen (HR 1.14, p = 0.008) and MGIT media (HR 1.19, p < 0.001). In men, the presence of cavitation, positive HIV status, higher age, lower BMI and 'ever smoked' were independently associated with unfavourable treatment outcome. In women, only 'ever smoked' was independently associated with unfavourable treatment outcome. Only for cavitation was there a gender difference in treatment outcomes by regimen; their outcome in the 4-month arms was significantly poorer compared to the 6-month treatment arm (p < 0.001). Women, with or without cavities, and men without cavities had a similar outcome on all treatment arms (p = 0.218, 0.224 and 0.689 respectively). For all other covariate subgroups, there were no differences in treatment effects for men or women.ConclusionsGender differences in TB treatment responses for the shorter regimens in the REMoxTB study may be explained by poor outcomes in men with cavitation on the moxifloxacin-containing regimens. We observed that women with cavities, or without, on the 4-month moxifloxacin regimens had similar outcomes to all patients on the standard 6-month treatment. The biological reasons for this difference are poorly understood and require further exploration.

Dataset Information

Post Hoc Bias in Treatment Decisions.

Importance

Objective

Design, setting, and participants

Exposure

Main outcomes and measures

Results

Conclusions and relevance

Publications

Post Hoc Bias in Treatment Decisions.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets