Dataset Information

What are we optimizing for in autism screening? Examination of algorithmic changes in the M-CHAT.

ABSTRACT: The present study objectives were to examine the performance of the new M-CHAT-R algorithm to the original M-CHAT algorithm. The main purpose was to examine if the algorithmic changes increase identification of children later diagnosed with ASD, and to examine if there is a trade-off when changing algorithms. We included 54,463 screened cases from the Norwegian Mother and Child Cohort Study. Children were screened using the 23 items of the M-CHAT at 18 months. Further, the performance of the M-CHAT-R algorithm was compared to the M-CHAT algorithm on the 23-items. In total, 337 individuals were later diagnosed with ASD. Using M-CHAT-R algorithm decreased the number of correctly identified ASD children by 12 compared to M-CHAT, with no children with ASD screening negative on the M-CHAT criteria subsequently screening positive utilizing the M-CHAT-R algorithm. A nonparametric McNemar's test determined a statistically significant difference in identifying ASD utilizing the M-CHAT-R algorithm. The present study examined the application of 20-item MCHAT-R scoring criterion to the 23-item MCHAT. We found that this resulted in decreased sensitivity and increased specificity for identifying children with ASD, which is a trade-off that needs further investigation in terms of cost-effectiveness. However, further research is needed to optimize screening for ASD in the early developmental period to increase identification of false negatives.

SUBMITTER: Schjolberg S

PROVIDER: S-EPMC8821132 | biostudies-literature | 2022 Feb

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

What are we optimizing for in autism screening? Examination of algorithmic changes in the M-CHAT.

Schjølberg Synnve S Shic Frederick F Volkmar Fred R FR Nordahl-Hansen Anders A Stenberg Nina N Torske Tonje T Larsen Kenneth K Riley Katherine K Sukhodolsky Denis G DG Leckman James F JF Chawarska Katarzyna K Øien Roald A RA

Autism research : official journal of the International Society for Autism Research 20211126 2

The present study objectives were to examine the performance of the new M-CHAT-R algorithm to the original M-CHAT algorithm. The main purpose was to examine if the algorithmic changes increase identification of children later diagnosed with ASD, and to examine if there is a trade-off when changing algorithms. We included 54,463 screened cases from the Norwegian Mother and Child Cohort Study. Children were screened using the 23 items of the M-CHAT at 18 months. Further, the performance of the M-C ...[more]

PMID: 34837355

Similar Datasets

Project description:BackgroundAutism screening is recommended at 18- and 24-month pediatric well visits. The Modified Checklist for Autism in Toddlers-Revised (M-CHAT-R) authors recommend a follow-up interview (M-CHAT-R/F) when positive. M-CHAT-R/F may be less accurate for 18-month-olds than 24-month-olds and accuracy for identification prior to two years is not known in samples that include children screening negative. Since autism symptoms may emerge gradually, ordinally scoring items based on the full range of response options, such as in the 10-item version of the Quantitative Checklist for Autism in Toddlers (Q-CHAT-10), might better capture autism signs than the dichotomous (i.e., yes/no) items in M-CHAT-R or the pass/fail scoring of Q-CHAT-10 items. The aims of this study were to determine and compare the accuracy of the M-CHAT-R/F and the Q-CHAT-10 and to describe the accuracy of the ordinally scored Q-CHAT-10 (Q-CHAT-10-O) for predicting autism in a sample of children who were screened at 18 months.MethodsThis is a community pediatrics validation study with screen positive (n = 167) and age- and practice-matched screen negative children (n = 241) recruited for diagnostic evaluations completed prior to 2 years old. Clinical diagnosis of autism was based on results of in-person diagnostic autism evaluations by research reliable testers blind to screening results and using the Autism Diagnostic Observation Schedule-Second Edition (ADOS-2) Toddler Module and Mullen Scales of Early Learning (MSEL) per standard guidelines.ResultsWhile the M-CHAT-R/F had higher specificity and PPV compared to M-CHAT-R, Q-CHAT-10-O showed higher sensitivity than M-CHAT-R/F and Q-CHAT-10.LimitationsMany parents declined participation and the sample is over-represented by higher educated parents. Results cannot be extended to older ages.ConclusionsLimitations of the currently recommended two-stage M-CHAT-R/F at the 18-month visit include low sensitivity with minimal balancing benefit of improved PPV from the follow-up interview. Ordinal, rather than dichotomous, scoring of autism screening items appears to be beneficial at this age. The Q-CHAT-10-O with ordinal scoring shows advantages to M-CHAT-R/F with half the number of items, no requirement for a follow-up interview, and improved sensitivity. Yet, Q-CHAT-10-O sensitivity is less than M-CHAT-R (without follow-up) and specificity is less than the two-stage procedure. Such limitations are consistent with recognition that screening needs to recur beyond this age.

Project description:ObjectiveThis is a prospective population screening study for autism in toddlers aged 18-30 months old using the Quantitative Checklist for Autism in Toddlers (Q-CHAT), with follow-up at age 4.DesignObservational study.SettingLuton, Bedfordshire and Cambridgeshire in the UK.Participants13 070 toddlers registered on the Child Health Surveillance Database between March 2008 and April 2009, with follow-up at age 4; 3770 (29%) were screened for autism at 18-30 months using the Q-CHAT and the Childhood Autism Spectrum Test (CAST) at follow-up at age 4.InterventionsA stratified sample across the Q-CHAT score distribution was invited for diagnostic assessment (phase 1). The 4-year follow-up included the CAST and the Checklist for Referral (CFR). All with CAST ≥15, phase 1 diagnostic assessment or with developmental concerns on the CFR were invited for diagnostic assessment (phase 2). Standardised diagnostic assessment at both time-points was conducted to establish the test accuracy of the Q-CHAT.Main outcome measuresConsensus diagnostic outcome at phase 1 and phase 2.ResultsAt phase 1, 3770 Q-CHATs were returned (29% response) and 121 undertook diagnostic assessment, of whom 11 met the criteria for autism. All 11 screened positive on the Q-CHAT. The positive predictive value (PPV) at a cut-point of 39 was 17% (95% CI 8% to 31%). At phase 2, 2005 of 3472 CASTs and CFRs were returned (58% response). 159 underwent diagnostic assessment, including 82 assessed in phase 1. All children meeting the criteria for autism identified via the Q-CHAT at phase 1 also met the criteria at phase 2. The PPV was 28% (95% CI 15% to 46%) after phase 1 and phase 2.ConclusionsThe Q-CHAT can be used at 18-30 months to identify autism and enable accelerated referral for diagnostic assessment. The low PPV suggests that for every true positive there would, however, be ~4-5 false positives. At follow-up, new cases were identified, illustrating the need for continued surveillance and rescreening at multiple time-points using developmentally sensitive instruments. Not all children who later receive a diagnosis of autism are detectable during the toddler period.

Project description:Study questionAre toddlers conceived by fertility treatment at higher risk of failing a screening tool for autism spectrum disorders (ASD) than toddlers not conceived by treatment?Summary answerCompared with children not conceived by infertility treatment, children conceived by any infertility treatment, ovulation induction with or without intrauterine insemination (OI/IUI), or assisted reproductive technologies (ART) appeared to have had higher odds of failing an ASD screening; however, results were inconclusive and need replication.What is known alreadyAlthough most of the studies which have examined risk of ASD after ART show no association, the results are mixed. Thus, further studies are needed to clarify this association.Study design size, durationThe Upstate KIDS Study is a population-based, prospective cohort study of children born in New York State between 2008 and 2010. Children were screened for ASD using the Modified Checklist for Autism in Toddlers (M-CHAT) at ages 18 and 24 months.Participants/materials, setting, and methodsThe New York State live-birth registry was used to identify newborns conceived with and without fertility treatment with a 1:3 ratio, frequency matched on region of birth. At 18 and 24 months, 3183 and 3063 mothers, respectively, completed the M-CHAT questionnaire. The current analysis included 2586 singletons and 1296 twins with M-CHAT information at 18 and/or 24 months. Multivariable logistic regression with generalized estimating equations (GEE) was used to estimate odds ratios (aOR) and 95% confidence intervals (CI) after adjustment for covariates such as maternal age, education and plurality.Main results and the role of chanceWe found that 200 (5.2%) and 115 (3.0%) children failed the M-CHAT at 18 and 24 months, respectively. The associations between use of infertility treatment and failing the M-CHAT at 18 and/or 24 months were positive but inconclusive as they failed to exclude no association (18 months aOR 1.71, 95% CI: 0.81-3.61; 24 months aOR 1.78, 95% CI: 0.66-4.81; and both 18 and 24 months aOR 1.53, 95% CI: 0.78-2.99). The relationships between OI/IUI and ART with M-CHAT failure at 18 and/or 24 months were similar to those of using any fertility treatment. In vitro fertilization with intracytoplasmic sperm injection was not consistently positively or inversely associated with M-CHAT failure at each time point (18 months aOR 1.20, 95% CI: 0.51-2.83; 24 months aOR 0.93, 95% CI: 0.37-2.31; and both 18 and 24 months aOR 1.09, 95% CI: 0.50-2.60).Limitations reasons for cautionThe M-CHAT is a screening tool used for ASD risk assessment, and therefore, M-CHAT failure does not indicate ASD diagnosis. In addition, we did not have power to detect associations of small magnitude. Finally, non-response to follow-up may bias the results.Wider implications of the findingsDespite lack of precision, the positive associations between ART and M-CHAT failure suggest that larger population-based studies with longer follow-up are needed.Study funding/competing interest(s)Supported by the Intramural Research Program of the Eunice Kennedy Shriver National Institute of Child Health and Human Development (NICHD; contracts HHSN275201200005C, HHSN267200700019C). The sponsor played no role in the study design, data collection, data analysis or interpretation, writing of the manuscript or decision to submit the article for publication. There are no conflicts of interest to declare.Trial registration numberNot applicable.

Dataset Information

What are we optimizing for in autism screening? Examination of algorithmic changes in the M-CHAT.

Publications

What are we optimizing for in autism screening? Examination of algorithmic changes in the M-CHAT.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets