Dataset Information

Real-world effectiveness of a social-psychological intervention translated from controlled trials to classrooms.

ABSTRACT: Social-psychological interventions have raised the learning and performance of students in rigorous efficacy trials. Yet, after they are distributed "in the wild" for students to self-administer, there has been little research following up on their translational effectiveness. We used cutting-edge educational technology to tailor, scale up, and track a previously-validated Strategic Resource Use intervention among 12,065 college students in 14 STEM and Economics classes. Students who self-administered this "Exam Playbook" benefitted by an average of 2.17 percentage points (i.e., a standardized effect size of 0.18), compared to non-users. This effect size was 1.65 percentage points when controlling for college entrance exam scores and 1.75 [-1.88] for adding [dropping] the Exam Playbook in stratified matching analyses. Average benefits differed in magnitude by the conduciveness of the class climate (including peer norms and incentives), gender, first-generation status, as well as how often and how early they used the intervention. These findings on how, when, and who naturally adopts these resources address a need to improve prediction, translation, and scalability of social-psychological intervention benefits.

SUBMITTER: Chen P

PROVIDER: S-EPMC9424297 | biostudies-literature | 2022 Aug

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Real-world effectiveness of a social-psychological intervention translated from controlled trials to classrooms.

Chen Patricia P Teo Dennis W H DWH Foo Daniel X Y DXY Derry Holly A HA Hayward Benjamin T BT Schulz Kyle W KW Hayward Caitlin C McKay Timothy A TA Ong Desmond C DC

NPJ science of learning 20220829 1

Social-psychological interventions have raised the learning and performance of students in rigorous efficacy trials. Yet, after they are distributed "in the wild" for students to self-administer, there has been little research following up on their translational effectiveness. We used cutting-edge educational technology to tailor, scale up, and track a previously-validated Strategic Resource Use intervention among 12,065 college students in 14 STEM and Economics classes. Students who self-admini ...[more]

PMID: 36038565

Similar Datasets

Project description:IntroductionResearch shows that cognitive performance and emotional well-being can be significantly strengthened. A high-performance brain training protocol, Strategic Memory Advanced Reasoning Training (SMART), was developed by cognitive neuroscientists at The University of Texas at Dallas Center for BrainHealth based on 25-plus years of scientific study. Randomized controlled trials with various populations have shown that training and use of nine "SMART" strategies for processing information can improve cognitive performance and psychological health. However, the multi-week intensive training used in the laboratory is not practical for widespread use outside the laboratory. This article examines the efficacy of SMART when translated outside the laboratory to two populations (military/veterans and law enforcement) that received SMART in condensed time frames.Materials and methodsIn two translation studies with healthy military personnel and veterans, 425 participants received between 6 and 10 hours of SMART over 2 days. In a third translation study, 74 healthy police officers received 9 hours of SMART over 3 days. Training was conducted by clinicians who taught the nine "SMART" strategies related to three core areas-strategic attention, integrated reasoning, and innovation-to groups of up to 25 participants. In all three translation studies, cognitive performance and psychological health data were collected before and immediately following the training. In one of the military/veteran studies, psychological health data were also collected 1 and 4 months following the training.ResultsIn both translations to military personnel and veterans, there were improvements in the complex cognitive domains of integrated reasoning (P < .0001) and innovation (P < .0001) immediately after undergoing SMART. In the translation to police officers, there were improvements in the cognitive domains of innovation (P = .02) and strategic attention (P = .005). Participants in all three translations saw statistically significant improvements in self-reported symptoms of psychological health. The improvements continued among a subset of participants who responded to the later requests for information.ConclusionsThe results of translating to these two populations provide evidence supporting the efficacy of SMART delivered in an abbreviated time frame. The improvements in two major domains of cognitive function demonstrate that strategies can be taught and immediately applied by those receiving the training. The immediate psychological health improvements may be transient; however, the continued improvements in psychological health observed in a subset of the participants suggest that benefits may be sustainable even at later intervals.

Project description:Rapid and robust strategies to evaluate the efficacy and effectiveness of novel and existing pharmacotherapeutic interventions (repurposed treatments) in future pandemics are required. Observational "real-world studies" (RWS) can report more quickly than randomized controlled trials (RCTs) and would have value were they to yield reliable results. Both RCTs and RWS were deployed during the coronavirus disease 2019 (COVID-19) pandemic. Comparing results between them offers a unique opportunity to determine the potential value and contribution of each. A learning review of these parallel evidence channels in COVID-19, based on quantitative modeling, can help improve speed and reliability in the evaluation of repurposed therapeutics in a future pandemic. Analysis of all-cause mortality data from 249 observational RWS and RCTs across eight treatment regimens for COVID-19 showed that RWS yield more heterogeneous results, and generally overestimate the effect size subsequently seen in RCTs. This is explained in part by a few study factors: the presence of RWS that are imbalanced for age, gender, and disease severity, and those reporting mortality at 2 weeks or less. Smaller studies of either type contributed negligibly. Analysis of evidence generated sequentially during the pandemic indicated that larger RCTs drive our ability to make conclusive decisions regarding clinical benefit of each treatment, with limited inference drawn from RWS. These results suggest that when evaluating therapies in future pandemics, (1) large RCTs, especially platform studies, be deployed early; (2) any RWS should be large and should have adequate matching of known confounders and long follow-up; (3) reporting standards and data standards for primary endpoints, explanatory factors, and key subgroups should be improved; in addition, (4) appropriate incentives should be in place to enable access to patient-level data; and (5) an overall aggregate view of all available results should be available at any given time.

Project description:BackgroundSocial anxiety is both harmful and prevalent. It also currently remains among the most undertreated major mental disorders, due, in part, to socially anxious individuals' concerns about the stigma and expense of seeking help. The privacy and affordability of computer-aided psychotherapy interventions may render them particularly helpful in addressing these concerns, and they are also highly scalable, but most tend to be only somewhat effective without therapist support. However, a recent evaluation of a new self-guided, 7-module internet-delivered cognitive behavioral therapy intervention called Overcome Social Anxiety found that it was highly effective.ObjectiveThe initial evaluation of Overcome Social Anxiety revealed that it led to significant reductions in symptom severity among university undergraduates. The aim of this study was to extend the results of the initial study and investigate their generalizability by directly evaluating the intervention's effectiveness among a general community sample.MethodsWhile signing up for Overcome Social Anxiety, users consented to the usage of their anonymized outcome data for research purposes. Before and after completing the intervention, users completed the Fear of Negative Evaluation Scale (FNE), which we employed as the primary outcome measure. Secondary outcome measures included the Depression Anxiety Stress Scales (DASS) and 2 bespoke questionnaires measuring socially anxious thoughts (Thoughts Questionnaire) and avoidance behaviors (Avoidance Questionnaire).ResultsParticipants who completed the intervention (102/369, 27.7%) experienced significant reductions in the severity of their symptoms on all measures employed, including FNE (P<.001; Cohen d=1.76), the depression subscale of DASS (P<.001; Cohen d=0.70), the anxiety subscale of DASS (P<.001; Cohen d=0.74), the stress subscale of DASS (P<.001; Cohen d=0.80), the Thoughts Questionnaire (P<.001; Cohen d=1.46), and the Avoidance Questionnaire (P<.001; Cohen d=1.42).ConclusionsOur results provide further evidence that Overcome Social Anxiety reduces the severity of social anxiety symptoms among those who complete it and suggest that its effectiveness extends to the general community. The completion rate is the highest documented for a fully automated intervention for anxiety, depression, or low mood in a real community sample. In addition, our results indicate that Overcome Social Anxiety reduces the severity of symptoms of depression, physiological symptoms of anxiety, and stress in addition to symptoms of social anxiety.

Dataset Information

Real-world effectiveness of a social-psychological intervention translated from controlled trials to classrooms.

Publications

Real-world effectiveness of a social-psychological intervention translated from controlled trials to classrooms.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets