Dataset Information

Statistical Decision-Making Accuracies for Some Overlap- and Distance-based Measures for Single-Case Experimental Designs.

ABSTRACT: Selecting a quantitative measure to guide decision making in single-case experimental designs (SCEDs) is complicated. Many measures exist and all have been rightly criticized. The two general classes of measure are overlap-based (e.g., percentage nonoverlapping data) and distance-based (e.g., Cohen's d). We compare several measures from each category for Type I error rate and power across a range of designs using equal numbers of observations (i.e., 3-10) in each phase. Results showed that Tau and the distance-based measures (i.e., RD and g) provided the highest decision accuracies. Other overlap-based measures (e.g., PND, dual-criterion method) did not perform as well. It is recommended that Tau be used to guide decision making about the presence/absence of a treatment effect, and RD or g be used to quantify the magnitude of the treatment effect.

Supplementary information

The online version contains supplementary material available at 10.1007/s40614-021-00317-8.

SUBMITTER: Carlin MT

PROVIDER: S-EPMC8894531 | biostudies-literature | 2022 Mar

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Statistical Decision-Making Accuracies for Some Overlap- and Distance-based Measures for Single-Case Experimental Designs.

Carlin Michael T MT Costello Mack S MS

Perspectives on behavior science 20211122 1

Selecting a quantitative measure to guide decision making in single-case experimental designs (SCEDs) is complicated. Many measures exist and all have been rightly criticized. The two general classes of measure are overlap-based (e.g., percentage nonoverlapping data) and distance-based (e.g., Cohen's <i>d</i>). We compare several measures from each category for Type I error rate and power across a range of designs using equal numbers of observations (i.e., 3-10) in each phase. Results showed tha ...[more]

PMID: 35342864

Similar Datasets

Project description:Engaging patients (parents/families) in treatment decisions is increasingly recognised as important and beneficial. Yet where the evidence base for treatment options is limited, as with intermittent distance exotropia (X(T)), this presents a challenge for families and clinicians. The purpose of this study was to explore how decisions are made in the management and treatment of X(T) and what can be done to support decision-making for clinicians, parents and children.This was a qualitative study using face to face interviews with consultant ophthalmologists and orthoptists, and parents of children with X(T). Interview data were analysed using the constant comparative method.The drivers for clinicians in treatment decision-making for X(T) were the proportion of time the strabismus is manifest and parents' views. For parents, decisions were influenced by: fear of bullying and, to a lesser degree, concerns around the impact of the strabismus on their child's vision. Uncertainty around the effectiveness of treatment options caused difficulties for some clinicians when communicating with parents. Parental understanding of the nature of X(T) and rationale for treatment often differed from that of the clinicians, and this affected their involvement in decision-making. Though there were good examples of shared decision-making and parent and child engagement some parents said the process felt rushed and they felt excluded. Parents reported that clinicians provided sufficient information in consultations but they had difficulties in retaining verbal information to convey to other family members.Overall parents were happy with the care their child received but there is scope for better parent and (where appropriate) child engagement in decision-making. There was an expressed need for written information about X(T) to reinforce what was given verbally in consultations and to share with other family members. Access could be via the hospital website, along with videos or blogs from parents and children who have undergone the various management options. A method of assisting clinicians to explain the treatment options, together with the uncertainties, in a clear and concise way could be of particular benefit to orthoptists who have the most regular contact with parents and children, and are more likely to suggest conservative treatments such as occlusion and minus lenses.

Project description:Background/objectivesRestricted mean survival time (RMST) summarizes treatment effect in terms of a gain or loss in the event-free days. It remains uncertain whether communicating treatment benefit and harm using RMST-based summary is more effective than conventional summary based on absolute and relative risk reduction. We compared the effect of RMST-based approach and conventional approach on decisional conflict using an example of intensive versus standard blood pressure-lowering strategies.DesignOn-line survey.SettingA convenience sample of patients in the United States.ParticipantsTwo hundred adults aged 65 and older with hypertension requiring anti-hypertensive treatment (response rate 85.5%).InterventionsParticipants were randomly assigned to either RMST-based summary or conventional summary about the benefit and harm of blood pressure-lowering strategies.MeasurementsDecisional Conflict Scale (DCS), ranging from 0 (no conflict) to 100 (high conflict), and preference for intensive blood pressure-lowering strategy.ResultsParticipants assigned to RMST-based approach (n = 100) and conventional approach (n = 100) had similar age (mean [standard deviation, SD]: 72.3 [5.6] vs 72.8 [5.5] years) and proportions of female (50 [50.0%] vs 61 [61.0%]) and white race (92 [92.0%] vs 92 [92.0%]). The mean (SD) DCS score was 25.2 (15.0) for RMST-based approach and 25.6 (14.1) for conventional approach (p = 0.84). The number (%) of participants who preferred intensive strategy was 10 (10.0%) for RMST-based approach and 14 (14.0%) for conventional approach (p = 0.52). The results were consistent in subgroups defined by age, sex, education level, cardiovascular disease status, and predicted mortality risk categories.ConclusionIn a sample of relatively healthy older adults with hypertension, RMST-based approach was as effective as conventional approach on decisional conflict about choosing a blood pressure-lowering strategy. This study provides proof-of-concept evidence that RMST-based approach can be used in conjunction with absolute and relative risk reduction for communicating treatment benefit and harm in a decision aid.

Dataset Information

Statistical Decision-Making Accuracies for Some Overlap- and Distance-based Measures for Single-Case Experimental Designs.

Supplementary information

Publications

Statistical Decision-Making Accuracies for Some Overlap- and Distance-based Measures for Single-Case Experimental Designs.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets