Dataset Information

A Novel, Expert-Endorsed, Neurocognitive Digital Assessment Tool for Addictive Disorders: Development and Validation Study.

ABSTRACT:

Background

Many people with harmful addictive behaviors may not meet formal diagnostic thresholds for a disorder. A dimensional approach, by contrast, including clinical and community samples, is potentially key to early detection, prevention, and intervention. Importantly, while neurocognitive dysfunction underpins addictive behaviors, established assessment tools for neurocognitive assessment are lengthy and unengaging, difficult to administer at scale, and not suited to clinical or community needs. The BrainPark Assessment of Cognition (BrainPAC) Project sought to develop and validate an engaging and user-friendly digital assessment tool purpose-built to comprehensively assess the main consensus-driven constructs underpinning addictive behaviors.

Objective

The purpose of this study was to psychometrically validate a gamified battery of consensus-based neurocognitive tasks against standard laboratory paradigms, ascertain test-retest reliability, and determine their sensitivity to addictive behaviors (eg, alcohol use) and other risk factors (eg, trait impulsivity).

Methods

Gold standard laboratory paradigms were selected to measure key neurocognitive constructs (Balloon Analogue Risk Task [BART], Stop Signal Task [SST], Delay Discounting Task [DDT], Value-Modulated Attentional Capture [VMAC] Task, and Sequential Decision-Making Task [SDT]), as endorsed by an international panel of addiction experts; namely, response selection and inhibition, reward valuation, action selection, reward learning, expectancy and reward prediction error, habit, and compulsivity. Working with game developers, BrainPAC tasks were developed and validated in 3 successive cohorts (total N=600) and a separate test-retest cohort (N=50) via Mechanical Turk using a cross-sectional design.

Results

BrainPAC tasks were significantly correlated with the original laboratory paradigms on most metrics (r=0.18-0.63, P<.05). With the exception of the DDT k function and VMAC total points, all other task metrics across the 5 tasks did not differ between the gamified and nongamified versions (P>.05). Out of 5 tasks, 4 demonstrated adequate to excellent test-retest reliability (intraclass correlation coefficient 0.72-0.91, P<.001; except SDT). Gamified metrics were significantly associated with addictive behaviors on behavioral inventories, though largely independent of trait-based scales known to predict addiction risk.

Conclusions

A purpose-built battery of digitally gamified tasks is sufficiently valid for the scalable assessment of key neurocognitive processes underpinning addictive behaviors. This validation provides evidence that a novel approach, purported to enhance task engagement, in the assessment of addiction-related neurocognition is feasible and empirically defensible. These findings have significant implications for risk detection and the successful deployment of next-generation assessment tools for substance use or misuse and other mental disorders characterized by neurocognitive anomalies related to motivation and self-regulation. Future development and validation of the BrainPAC tool should consider further enhancing convergence with established measures as well as collecting population-representative data to use clinically as normative comparisons.

SUBMITTER: Lee RSC

PROVIDER: S-EPMC7615064 | biostudies-literature | 2023 Aug

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

A Novel, Expert-Endorsed, Neurocognitive Digital Assessment Tool for Addictive Disorders: Development and Validation Study.

Lee Rico S C RSC Albertella Lucy L Christensen Erynn E Suo Chao C Segrave Rebecca A RA Brydevall Maja M Kirkham Rebecca R Liu Chang C Fontenelle Leonardo F LF Chamberlain Samuel R SR Rotaru Kristian K Yücel Murat M

Journal of medical Internet research 20230825

<h4>Background</h4>Many people with harmful addictive behaviors may not meet formal diagnostic thresholds for a disorder. A dimensional approach, by contrast, including clinical and community samples, is potentially key to early detection, prevention, and intervention. Importantly, while neurocognitive dysfunction underpins addictive behaviors, established assessment tools for neurocognitive assessment are lengthy and unengaging, difficult to administer at scale, and not suited to clinical or co ...[more]

PMID: 37624635

Similar Datasets

Project description:BackgroundEating disorders are amongst the deadliest of all mental disorders, however detection and early intervention rates remain extremely low. Current standardised screening questionnaires can be arduous or confronting and are ill-validated for online use, despite a universal shift to digital healthcare. The present study describes the development and pilot validation of a novel digital screening tool (the InsideOut Institute-Screener) for high risk and early stage eating disorders to drive early intervention and reduced morbidity.MethodsWe utilised a mixed cross-sectional and repeated measures longitudinal survey research design to assess symptom severity and recognised parameters of statistical validity. Participants were recruited through social media and traditional advertising, and through MTurk. An Eating Disorders Examination Questionnaire (EDE-Q) global score of 2.3 and assessment of eating disorder behaviours was used to determine probable ED. 1346 participants aged 14-74 (mean [SE] age 26.60 [11.14] years; 73.8% female, 22.6% male) completed the survey battery. 19% were randomised to two-week follow-up for reliability analysis.ResultsStrong positive correlations between the IOI-S and both the EDE-Q global (rs = .88) and SCOFF (rs = .75) total score were found, providing support for the concurrent validity of the scale. Inter-item correlations were moderate to strong (rs = .46-.73). Correlations between the IOI-S and two measures of social desirability diverged, providing support for the discriminant validity of the scale. The IOI-S demonstrated high internal consistency (α = .908, ω = .910) and excellent two-week test-retest reliability (.968, 95% CI 0.959-0.975; p ≤ 0.1). The IOI-S accurately distinguished probable eating disorders (sensitivity = 82.8%, specificity = 89.7% [AUC = .944], LR+ = 8.04, LR- = 0.19) and two stepped levels of risk.Conclusions and relevanceThe present study provides excellent initial support for the psychometric validity of the InsideOut Institute digital screening tool, which has the potential to streamline early intervention in the hopes of reducing current high morbidity and mortality. Further validation should be undertaken in known clinical populations. Eating disorders are amongst the deadliest of all mental disorders, however detection and early intervention rates remain extremely low. The present study describes the initial psychometric validation of a novel digital screening tool (the InsideOut Institute Screener) for high risk and early stage eating disorders, for self-referral and/or use in primary care. 1346 participants aged 14-74 of all genders completed a survey battery designed to assess common parameters of statistical validity. Strong support was found for the screener's ability to accurately measure eating disorder risk and symptomatology. The screener was highly positively correlated with a well known and extensively validated long form self-report questionnaire for eating disorder symptomatology. This study is a pilot validation and the genesis of a project that aims ultimately to drive early intervention leading to reduced morbidity and mortality rates in this illness group.

Project description:BackgroundAlbinism comprises a group of autosomal recessive diseases that are characterized by poor vision and a variable hypopigmentation phenotype. A comprehensive literature review showed that no tool can assess the burden experienced by individuals who present with albinism, although such a tool is needed and would be beneficial for clinicians and patients alike.MethodThe questionnaire was devised using standardized methodology for developing and validating questionnaires on the quality of life of subjects according to the following chronological structure: conceptual phase, development phase, and then validation phase. A multidisciplinary working group was assembled, including experts on questionnaire design and development, dermatologists specializing in care for patients with albinism, and representatives of the Genespoir association.ResultsBased on an initial verbatim report, the workgroup compiled a list of items that were transcribed and reformulated into questions. During the validation phase, principal component analysis (PCA) was conducted on the 24 items, which allowed the questionnaire to be reduced to 20 questions [Q]. The standardized regression coefficients were all greater than 0.5 for their corresponding factors. Based on their normalized regression coefficients, each group of questions was linked to one of the following four dimensions, with each dimension consisting of at least three questions: "Live with" (8 Q), "Daily life" (3 Q), "Resignation" (3 Q), and "Fear of the future" (6 Q). All dimensions correlated well with the overall BoA score. Cronbach's α was 0.92 for the entire BoA scale, confirming excellent internal coherence. Intradimensional coherences all demonstrated excellent reliability (α > 0.65). The BoA questionnaire was highly correlated with the SF12, RSES and DLQI validated questionnaires. This outcome confirmed the external validity.ConclusionThis questionnaire represents the first specific assessment tool for evaluating the burden of albinism. It is easy to use and relatively quick to complete, which will allow the burden to be evaluated over time with a reproducible questionnaire. To ensure that this questionnaire can be used by as many people as possible, cultural and linguistic validation in US English was conducted with the original French version.

Dataset Information

A Novel, Expert-Endorsed, Neurocognitive Digital Assessment Tool for Addictive Disorders: Development and Validation Study.

Background

Objective

Methods

Results

Conclusions

Publications

A Novel, Expert-Endorsed, Neurocognitive Digital Assessment Tool for Addictive Disorders: Development and Validation Study.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets