Dataset Information

IRECIST-based versus non-standardized free text reporting of CT scans for monitoring metastatic renal cell carcinoma: a retrospective comparison.

ABSTRACT:

Purpose

Therapy decision for patients with metastatic renal cell carcinoma (mRCC) is highly dependent on disease monitoring based on radiological reports. The purpose of the study was to compare non-standardized, common practice free text reporting (FTR) on disease response with reporting based on response evaluation criteria in solid tumors modified for immune-based therapeutics (iRECIST).

Methods

Fifty patients with advanced mRCC were included in the retrospective, single-center study. CT scans had been evaluated and FTR prepared in accordance with center's routine practice. For study purposes, reports were re-evaluated using a dedicated computer program that applied iRECIST. Patients were followed up over a period of 22.8 ± 7.9 months in intervals of 2.7 ± 1.8 months. Weighted kappa statistics was run to assess strength of agreement. Logistic regression was used to identify predictors for different rating.

Results

Agreement between FTR and iRECIST-based reporting was moderate (kappa 0.38 [95% CI 0.2-0.6] to 0.70 [95% CI 0.5-0.9]). Tumor response or progression according to FTR were not confirmed with iRECIST in 19 (38%) or 11 (22%) patients, respectively, in at least one follow-up examination. With FTR, new lesions were frequently not recognized if they were already identified in the recent prior follow-up examination (odds ratio for too favorable rating of disease response compared to iRECIST: 5.4 [95% CI 2.9-10.1].

Conclusions

Moderate agreement between disease response according to FTR or iRECIST in patients with mRCC suggests the need of standardized quantitative radiological assessment in daily clinical practice.

SUBMITTER: Schomburg L

PROVIDER: S-EPMC9294024 | biostudies-literature | 2022 Aug

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

iRECIST-based versus non-standardized free text reporting of CT scans for monitoring metastatic renal cell carcinoma: a retrospective comparison.

Schomburg Laura L Malouhi Amer A Grimm Marc-Oliver MO Ingwersen Maja M Foller Susan S Leucht Katharina K Teichgräber Ulf U

Journal of cancer research and clinical oncology 20220414 8

<h4>Purpose</h4>Therapy decision for patients with metastatic renal cell carcinoma (mRCC) is highly dependent on disease monitoring based on radiological reports. The purpose of the study was to compare non-standardized, common practice free text reporting (FTR) on disease response with reporting based on response evaluation criteria in solid tumors modified for immune-based therapeutics (iRECIST).<h4>Methods</h4>Fifty patients with advanced mRCC were included in the retrospective, single-center ...[more]

PMID: 35420348

Similar Datasets

Project description:Objective The aim of this study was to assess efficacy of large language models (LLMs) for converting free-text computed tomography (CT) scan reports of head and neck cancer (HNCa) patients into a structured format using a predefined template. Materials and Methods A retrospective study was conducted using 150 CT reports of HNCa patients. A comprehensive structured reporting template for HNCa CT scans was developed, and the Generative Pre-trained Transformer 4 (GPT-4) was initially used to convert 50 CT reports into a structured format using this template. The generated structured reports were then evaluated by a radiologist for instances of missing or misinterpreted information and any erroneous additional details added by GPT-4. Following this assessment, the template was refined for improved accuracy. This revised template was then used for conversion of 100 other HNCa CT reports into structured format using GPT-4. These reports were then reevaluated in the same manner. Results Initially, GPT-4 successfully converted all 50 free-text reports into structured reports. However, there were 10 places with missing information: tracheostomy tube ( n = 3), noninclusion of involvement of sternocleidomastoid muscle ( n = 2), extranodal tumor extension ( n = 3), and contiguous involvement of the neck structures by nodal mass rather than the primary ( n = 2). Few instances of nonsuspicious lung nodules were misinterpreted as metastases ( n = 2). GPT-4 did not indicate any erroneous additional findings. Using the revised reporting template, GPT-4 converted all the 100 CT reports into a structured format with no repeated or additional mistakes. Conclusion LLMs can be used for structuring free-text radiology reports using plain language prompts and a simple yet comprehensive reporting template. Key Points Structured radiology reports in oncological patients, although advantageous, are not used widely in practice due to perceived drawbacks like interference with routine radiology workflow and scan interpretation.We found that GPT-4 is highly efficient in converting conventional CT reports of HNCa patients to structured reports using a predefined template.This application of LLMs in radiology can help in enhancing the acceptability and clinical utility of structured radiology reports in oncological imaging. Summary Statement Large language models can successfully and accurately convert conventional radiology reports for oncology scans into a structured format using a comprehensive predefined template and thus can enhance the utility and integration of these reports in routine clinical practice.

Project description:Recently, a standardized framework system for interpreting somatostatin receptor (SSTR)-targeted PET/CT, termed the SSTR reporting and data system (RADS) 1.0, was introduced, providing reliable standards and criteria for SSTR-targeted imaging. We determined the interobserver reliability of SSTR-RADS for interpretation of 68Ga-DOTATOC PET/CT scans in a multicentric, randomized setting. Methods: A set of 51 randomized 68Ga-DOTATOC PET/CT scans was independently assessed by 4 masked readers with different levels of experience (2 experienced readers and 2 inexperienced readers) trained on the SSTR-RADS 1.0 criteria (based on a 5-point scale from 1 [definitively benign] to 5 [high certainty that neuroendocrine neoplasia is present]). For each scan, SSTR-RADS scores were assigned to a maximum of 5 target lesions (TLs). An overall scan impression based on SSTR-RADS was indicated, and interobserver agreement rates on a TL-based, on an organ-based, and on an overall SSTR-RADS score-based level were computed. The readers were also asked to decide whether peptide receptor radionuclide therapy (PRRT) should be considered on the basis of the assigned RADS scores. Results: Among the selected TLs, 153 were chosen by at least 2 readers (all 4 readers selected the same TLs in 58 of 153 [37.9%] instances). The interobserver agreement for SSTR-RADS scoring among identical TLs was good (intraclass correlation coefficient [ICC] ≥ 0.73 for 4, 3, and 2 identical TLs). For lymph node and liver lesions, excellent interobserver agreement rates were derived (ICC, 0.91 and 0.77, respectively). Moreover, the interobserver agreement for an overall scan impression based on SSTR-RADS was excellent (ICC, 0.88). The SSTR-RADS-based decision to use PRRT also demonstrated excellent agreement, with an ICC of 0.80. No significant differences between experienced and inexperienced readers for an overall scan impression and TL-based SSTR-RADS scoring were observed (P ≥ 0.18), thereby suggesting that SSTR-RADS seems to be readily applicable even for less experienced readers. Conclusion: SSTR-RADS-guided assessment demonstrated a high concordance rate, even among readers with different levels of experience, supporting the adoption of SSTR-RADS for trials, clinical routine, or outcome studies.

Project description:PurposeNo liquid biomarkers are approved in metastatic renal cell carcinoma (mRCC) despite the need to predict and monitor response noninvasively to tailor treatment choices. Urine and plasma free glycosaminoglycan profiles (GAGomes) are promising metabolic biomarkers in mRCC. The objective of this study was to explore if GAGomes could predict and monitor response in mRCC.Patients and methodsWe enrolled a single-center prospective cohort of patients with mRCC elected for first-line therapy (ClinicalTrials.gov identifier: NCT02732665) plus three retrospective cohorts (ClinicalTrials.gov identifiers: NCT00715442 and NCT00126594) for external validation. Response was dichotomized as progressive disease (PD) versus non-PD every 8-12 weeks. GAGomes were measured at treatment start, after 6-8 weeks, and every third month in a blinded laboratory. We correlated GAGomes with response and developed scores to classify PD versus non-PD, which were used to predict response at treatment start or after 6-8 weeks.ResultsFifty patients with mRCC were prospectively included, and all received tyrosine kinase inhibitors (TKIs). PD correlated with alterations in 40% of GAGome features. We developed plasma, urine, and combined glycosaminoglycan progression scores that monitored PD at each response evaluation visit with the area under the receiving operating characteristic curve (AUC) of 0.93, 0.97, and 0.98, respectively. For internal validation, the scores predicted PD at treatment start with the AUC of 0.66, 0.68, and 0.74 and after 6-8 weeks with the AUC of 0.76, 0.66, and 0.75. For external validation, 70 patients with mRCC were retrospectively included and all received TKI-containing regimens. The plasma score predicted PD at treatment start with the AUC of 0.90 and at 6-8 weeks with the AUC of 0.89. The pooled sensitivity and specificity were 58% and 79% at treatment start. Limitations include the exploratory study design.ConclusionGAGomes changed in association with mRCC response to TKIs and may provide biologic insights into mRCC mechanisms of response.