Dataset Information

Telemedicine retinopathy of prematurity severity score (TeleROP-SS) versus modified activity score (mROP-ActS) retrospective comparison in SUNDROP cohort.

ABSTRACT: Identifying and planning treatment for retinopathy of prematurity (ROP) using telemedicine is becoming increasingly ubiquitous, necessitating a grading system to help caretakers of at-risk infants gauge disease severity. The modified ROP Activity Scale (mROP-ActS) factors zone, stage, and plus disease into its scoring system, addressing the need for assessing ROP's totality of binocular burden via indirect ophthalmoscopy. However, there is an unmet need for an alternative score which could facilitate ROP identification and gauge disease improvement or deterioration specifically on photographic telemedicine exams. Here, we propose such a system (Telemedicine ROP Severity Score [TeleROP-SS]), which we have compared against the mROP-ActS. In our statistical analysis of 1568 exams, we saw that TeleROP-SS was able to return a score in all instances based on the gradings available from the retrospective SUNDROP cohort, while mROP-ActS obtained a score of 80.8% in right eyes and 81.1% in left eyes. For treatment-warranted ROP (TW-ROP), TeleROP-SS obtained a score of 100% and 95% in the right and left eyes respectively, while mROP-ActS obtained a score of 70% and 63% respectively. The TeleROP-SS score can identify disease improvement or deterioration on telemedicine exams, distinguish timepoints at which treatments can be given, and it has the adaptability to be modified as needed.

SUBMITTER: Xu CL

PROVIDER: S-EPMC10502047 | biostudies-literature | 2023 Sep

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Telemedicine retinopathy of prematurity severity score (TeleROP-SS) versus modified activity score (mROP-ActS) retrospective comparison in SUNDROP cohort.

Xu Christine L CL Adu-Brimpong Joel J Moshfeghi Henry P HP Rosenblatt Tatiana R TR Yu Michael D MD Ji Marco H MH Wang Sean K SK Zaidi Moosa M Ghoraba Hashem H Michalak Suzanne S Callaway Natalia F NF Kumm Jochen J Nudleman Eric E Wood Edward H EH Patel Nimesh A NA Stahl Andreas A Lepore Domenico D Moshfeghi Darius M DM

Scientific reports 20230914 1

Identifying and planning treatment for retinopathy of prematurity (ROP) using telemedicine is becoming increasingly ubiquitous, necessitating a grading system to help caretakers of at-risk infants gauge disease severity. The modified ROP Activity Scale (mROP-ActS) factors zone, stage, and plus disease into its scoring system, addressing the need for assessing ROP's totality of binocular burden via indirect ophthalmoscopy. However, there is an unmet need for an alternative score which could facil ...[more]

PMID: 37709791

Similar Datasets

Project description:PurposeTo describe the clinical characteristics of intraocular hemorrhages (IOHs) in infants in the Telemedicine Approaches to Evaluating Acute-Phase Retinopathy of Prematurity (e-ROP) Study and to evaluate their potential use for prediction of disease severity.DesignSecondary data analysis from a prospective study.ParticipantsPreterm infants with birth weight (BW) ≤1250 g.MethodsInfants underwent serial digital retinal imaging in both eyes starting at 32 weeks' postmenstrual age. Nonphysician trained readers (TRs) evaluated all image sets from eyes that ever had IOHs documented on image evaluation or eye examination for the presence, location, type, area, and relation of the IOH to the junction between vascularized and avascular retina. Associations of IOH with demographic and neonatal factors, and with the presence and severity of retinopathy of prematurity (ROP) were investigated by univariate and multivariate analyses. Sensitivity and specificity of the telemedicine system for detecting referral-warranted ROP (RW-ROP) were calculated with and without incorporating hemorrhage into the standardized grading protocol.Main outcome measuresRetinal and vitreous hemorrhage.ResultsAmong 1239 infants (mean [standard deviation] BW = 864 [212] g; gestational age [GA] = 27 [2.2] weeks) who underwent an average of 3.2 imaging sessions, 22% had an IOH in an eye on at least 1 of the e-ROP visits. Classification of IOH was preretinal (57%), blot (57%), dot (38%), flame-shaped (16%), and vitreous (8%); most IOHs were unilateral (70%). The IOH resolved in 35% of eyes by the next imaging session and in the majority (76%) of cases by 8 weeks after initial detection. Presence of IOH was inversely associated with BW and GA and significantly associated (P < 0.0001) with the presence and severity of ROP (BW and GA adjusted odds ratios [ORs] of 2.46 for any ROP, 2.88 for stage 3, and 3.19 for RW-ROP). Incorporating IOH into the grading protocol minimally altered the sensitivity of the system (94% vs. 95%).ConclusionsApproximately 1 in 5 preterm infants examined had IOHs, generally unilateral. The presence of hemorrhage was directly correlated with both presence and severity of ROP and inversely correlated with BW and GA, although including hemorrhage in the grading algorithm only minimally improved the sensitivity of the telemedicine system to detect RW-ROP.

Project description:ImportanceOne of the biggest challenges when using anti-vascular endothelial growth factor (VEGF) agents to treat retinopathy of prematurity (ROP) is the need to perform long-term follow-up examinations to identify eyes at risk of ROP reactivation requiring retreatment.ObjectiveTo evaluate whether an artificial intelligence (AI)-based vascular severity score (VSS) can be used to analyze ROP regression and reactivation after anti-VEGF treatment and potentially identify eyes at risk of ROP reactivation requiring retreatment.Design, setting, and participantsThis prognostic study was a secondary analysis of posterior pole fundus images collected during the multicenter, double-blind, investigator-initiated Comparing Alternative Ranibizumab Dosages for Safety and Efficacy in Retinopathy of Prematurity (CARE-ROP) randomized clinical trial, which compared 2 different doses of ranibizumab (0.12 mg vs 0.20 mg) for the treatment of ROP. The CARE-ROP trial screened and enrolled infants between September 5, 2014, and July 14, 2016. A total of 1046 wide-angle fundus images obtained from 19 infants at predefined study time points were analyzed. The analyses of VSS were performed between January 20, 2021, and November 18, 2022.InterventionsAn AI-based algorithm assigned a VSS between 1 (normal) and 9 (most severe) to fundus images.Main outcomes and measuresAnalysis of VSS in infants with ROP over time and VSS comparisons between the 2 treatment groups (0.12 mg vs 0.20 mg of ranibizumab) and between infants who did and did not receive retreatment for ROP reactivation.ResultsAmong 19 infants with ROP in the CARE-ROP randomized clinical trial, the median (range) postmenstrual age at first treatment was 36.4 (34.7-39.7) weeks; 10 infants (52.6%) were male, and 18 (94.7%) were White. The mean (SD) VSS was 6.7 (1.9) at baseline and significantly decreased to 2.7 (1.9) at week 1 (P < .001) and 2.9 (1.3) at week 4 (P < .001). The mean (SD) VSS of infants with ROP reactivation requiring retreatment was 6.5 (1.9) at the time of retreatment, which was significantly higher than the VSS at week 4 (P < .001). No significant difference was found in VSS between the 2 treatment groups, but the change in VSS between baseline and week 1 was higher for infants who later required retreatment (mean [SD], 7.8 [1.3] at baseline vs 1.7 [0.7] at week 1) vs infants who did not (mean [SD], 6.4 [1.9] at baseline vs 3.0 [2.0] at week 1). In eyes requiring retreatment, higher baseline VSS was correlated with earlier time of retreatment (Pearson r = -0.9997; P < .001).Conclusions and relevanceIn this study, VSS decreased after ranibizumab treatment, consistent with clinical disease regression. In cases of ROP reactivation requiring retreatment, VSS increased again to values comparable with baseline values. In addition, a greater change in VSS during the first week after initial treatment was found to be associated with a higher risk of later ROP reactivation, and high baseline VSS was correlated with earlier retreatment. These findings may have implications for monitoring ROP regression and reactivation after anti-VEGF treatment.

Project description:ImportanceMeasurable competence derived from comprehensive and advanced training in grading digital images is critical in studies using a reading center to evaluate retinal fundus images from infants at risk for retinopathy of prematurity (ROP). Details of certification for nonphysician trained readers (TRs) have not yet been described.ObjectiveTo describe a centralized system for grading ROP digital images by TRs in the Telemedicine Approaches to Evaluating Acute-Phase Retinopathy of Prematurity (e-ROP) Study.Design, setting, and participantsMulticenter observational cohort study conducted from July 1, 2010, to June 30, 2014. The TRs were trained by experienced ROP specialists and certified to detect ROP morphology in digital retinal images under supervision of an ophthalmologist reading center director. An ROP reading center was developed with standard hardware, secure Internet access, and customized image viewing software with an electronic grading form. A detailed protocol for grading was developed. Based on results of TR gradings, a computerized algorithm determined whether referral-warranted ROP (RW-ROP; defined as presence of plus disease, zone I ROP, and stage 3 or worse ROP) was present in digital images from infants with birth weight less than 1251 g enrolled from May 25, 2011, through October 31, 2013. Independent double grading was done by the TRs with adjudication of discrepant fields performed by the reading center director.ExposureDigital retinal images.Main outcomes and measuresIntragrader and intergrader variability and monitoring for temporal drift.ResultsFour TRs underwent rigorous training and certification. A total of 5520 image sets were double graded, with 24.5% requiring adjudication for at least 1 component of RW-ROP. For individual RW-ROP components, the adjudication rate was 3.9% for plus disease, 12.4% for zone I ROP, and 16.9% for stage 3 or worse ROP. The weighted κ for intergrader agreement (n = 80 image sets) was 0.72 (95% CI, 0.52-0.93) for RW-ROP, 0.57 (95% CI, 0.37-0.77) for plus disease, 0.43 (95% CI, 0.24-0.63) for zone I ROP, and 0.67 (95% CI, 0.47-0.88) for stage 3 or worse ROP. The weighted κ for grade-regrade agreement was 0.77 (95% CI, 0.57-0.97) for RW-ROP, 0.87 (95% CI, 0.67-1.00) for plus disease, 0.70 (95% CI, 0.51-0.90) for zone I ROP, and 0.77 (95% CI, 0.57-0.97) for stage 3 or worse ROP.Conclusions and relevanceThese data suggest that the e-ROP system for training and certifying nonphysicians to grade ROP images under the supervision of a reading center director reliably detects potentially serious ROP with good intragrader and intergrader consistency and minimal temporal drift.

Project description:PurposeTo develop a risk score for predicting treatment-requiring retinopathy of prematurity (TR-ROP) in the Telemedicine Approaches to Evaluating Acute-Phase Retinopathy of Prematurity (e-ROP) study.DesignSecond analyses of an observational cohort study.ParticipantsInfants with birth weight (BW) <1251 g who had ≥1 imaging session by 34 weeks of postmenstrual age (PMA) and ≥1 subsequent retinopathy of prematurity (ROP) examination for determining TR-ROP by study-certified ophthalmologists.MethodsNonphysician trained readers evaluated wide-field retinal image sets for characteristics of ROP, pre-plus/plus disease, and retinal hemorrhage. Risk score points for predicting TR-ROP were derived from the regression coefficients of significant predictors in a multivariate logistic regression model.Main outcome measuresTR-ROP.ResultsEighty-five of 771 infants (11.0%) developed TR-ROP. In a multivariate model, significant predictors for TR-ROP were gestational age (GA) (odds ratio [OR], 5.7; 95% confidence interval [CI], 1.7-18.9 for ≤25 vs. ≥28 weeks), need for respiratory support (OR, 7.0; 95% CI, 1.3-37.1 for high-frequency oscillatory ventilation vs. no respiratory support), slow weight gain (OR, 2.4; 95% CI, 1.2-4.6 for weight gain ≤12 g/day vs. >15 g/day), and image findings at the first image session including number of quadrants with pre-plus (OR, 3.8; 95% CI, 1.5-9.7 for 4 pre-plus quadrants vs. no pre-plus), stage and zone of ROP (OR, 4.7; 95% CI, 2.1-11.8 for stage 1-2 zone I, OR, 5.9; 95% CI, 2.1-16.6 for stage 3 zone I vs. no ROP), and presence of blot hemorrhage (OR, 3.1; 95% CI, 1.4-6.7). Image findings predicted TR-ROP better than GA (area under receiver operating characteristic curve [AUC] = 0.82 vs. 0.75, P = 0.03). The risk of TR-ROP steadily increased with higher risk score and predicted TR-ROP well (AUC = 0.88; 95% CI, 0.85-0.92). Risk score ≥3 points for predicting TR-ROP had a sensitivity of 98.8%, specificity of 40.1%, and positive and negative predictive values of 17.0% and 99.6%, respectively.ConclusionsImage characteristics at 34 PMA weeks or earlier independently predict TR-ROP. If externally validated in other infants, risk score, calculated from image findings, GA, weight gain, and respiratory support, enables early identification of infants in need of increased surveillance for TR-ROP.

Project description:ImportanceDetection of treatment-requiring retinopathy of prematurity (ROP) involves serial eye examinations. An ROP prediction model using predictive factors could identify high-risk infants and reduce required eye examinations.ObjectiveTo determine predictive factors for the development of referral-warranted (RW) ROP.Design, setting, and participantsThis multicenter observational cohort study included secondary analysis of data from the Telemedicine Approaches to Evaluating Acute-Phase Retinopathy of Prematurity Study. Infants included in the study had a birth weight (BW) of less than 1251 g.ExposuresSerial ROP examinations of premature infants who had 2 or more ROP examinations.Main outcomes and measuresIncidence of RW-ROP (defined as the presence of plus disease, zone I ROP, or ROP stage 3 or greater in either eye) and associations with predictive factors.ResultsAmong 979 infants without RW-ROP at first study-related eye examination (median postmenstrual age, 33 weeks; range, 29-40 weeks) who underwent at least 2 eye examinations, 149 (15.2%) developed RW-ROP. In a multivariate model, significant predictors for RW-ROP were male sex (odds ratio [OR], 1.80; 95% CI, 1.13-2.86 vs female), nonblack race (OR, 2.76; 95% CI, 1.50-5.08 for white vs black race and OR, 4.81; 95% CI, 2.19-10.6 for other vs black race), low BW (OR, 5.16; 95% CI, 1.12-7.20 for ≤500 g vs >1100 g), younger gestational age (OR, 9.79; 95% CI, 3.49-27.5 for ≤24 weeks vs ≥28 weeks), number of quadrants with preplus disease (OR, 7.12; 95% CI, 2.53-20.1 for 1-2 quadrants and OR, 18.4; 95% CI, 4.28-79.4 for 3-4 quadrants vs no preplus disease), stage 2 ROP (OR, 4.13; 95% CI, 2.13-8.00 vs no ROP), the presence of retinal hemorrhage (OR, 4.36; 95% CI, 1.57-12.1 vs absence), the need for respiratory support (OR, 4.99; 95% CI, 1.89-13.2 for the need for controlled mechanical ventilator; OR, 11.0; 95% CI, 2.26-53.8 for the need for high-frequency oscillatory ventilation vs no respiratory support), and slow weight gain (OR, 2.44; 95% CI, 1.22-4.89 for weight gain ≤12 g/d vs >18 g/d). These characteristics predicted the development of RW-ROP significantly better than BW and gestational age (area under receiver operating characteristic curve, 0.88 vs 0.78; P < .001).Conclusions and relevanceWhen controlling for very low BW and prematurity, the presence of preplus disease, stage 2 ROP, retinal hemorrhage, and the need for ventilation at time of first study-related eye examination were strong independent predictors for RW-ROP. These predictors may help identify infants in need of timely eye examinations.

Project description:ImportanceThe present strategy to identify infants needing treatment for retinopathy of prematurity (ROP) requires repeated examinations of at-risk infants by physicians. However, less than 10% ultimately require treatment. Retinal imaging by nonphysicians with remote image interpretation by nonphysicians may provide a more efficient strategy.ObjectiveTo evaluate the validity of a telemedicine system to identify infants who have sufficiently severe ROP to require evaluation by an ophthalmologist.Design, setting, and participantsAn observational study of premature infants starting at 32 weeks' postmenstrual age was conducted. This study involved 1257 infants with birth weight less than 1251 g in neonatal intensive care units in 13 North American centers enrolled from May 25, 2011, through October 31, 2013.InterventionsInfants underwent regularly scheduled diagnostic examinations by an ophthalmologist and digital imaging by nonphysician staff using a wide-field digital camera. Ophthalmologists documented findings consistent with referral-warranted (RW) ROP (ie, zone I ROP, stage 3 ROP or worse, or plus disease). A standard 6-image set per eye was sent to a central server and graded by 2 trained, masked, nonphysician readers. A reading supervisor adjudicated disagreements.Main outcomes and measuresThe validity of grading retinal image sets was based on the sensitivity and specificity for detecting RW-ROP compared with the criterion standard diagnostic examination.ResultsA total of 1257 infants (mean birth weight, 864 g; mean gestational age, 27 weeks) underwent a median of 3 sessions of examinations and imaging. Diagnostic examination identified characteristics of RW-ROP in 18.2% of eyes (19.4% of infants). Remote grading of images of an eye at a single session had sensitivity of 81.9% (95% CI, 77.4-85.6) and specificity of 90.1% (95% CI, 87.9-91.8). When both eyes were considered for the presence of RW-ROP, as would routinely be done in a screening, the sensitivity was 90.0% (95% CI, 85.4-93.5), with specificity of 87.0% (95% CI, 84.0-89.5), negative predictive value of 97.3%, and positive predictive value of 62.5% at the observed RW-ROP rate of 19.4%.Conclusions and relevanceWhen compared with the criterion standard diagnostic examination, these results provide strong support for the validity of remote evaluation by trained nonphysician readers of digital retinal images taken by trained nonphysician imagers from infants at risk for RW-ROP.Trial registrationclinicaltrials.gov Identifier:NCT01264276.

Dataset Information

Telemedicine retinopathy of prematurity severity score (TeleROP-SS) versus modified activity score (mROP-ActS) retrospective comparison in SUNDROP cohort.

Publications

Telemedicine retinopathy of prematurity severity score (TeleROP-SS) versus modified activity score (mROP-ActS) retrospective comparison in SUNDROP cohort.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets