Dataset Information

Utility of pathologist panels for achieving consensus in NASH histologic scoring in clinical trials: Data from a phase 3 study.

ABSTRACT:

Background

Liver histopathologic assessment is the accepted surrogate endpoint in NASH trials; however, the scoring of NASH Clinical Research Network (CRN) histologic parameters is limited by intraobserver and interobserver variability. We designed a consensus panel approach to minimize variability when using this scoring system. We assessed agreement between readers, estimated linear weighted kappas between 2 panels, compared them with published pairwise kappa estimates, and addressed how agreement or disagreement might impact the precision and validity of the surrogate efficacy endpoint in NASH trials.

Methods

Two panels, each comprising 3 liver fellowship-trained pathologists who underwent NASH histology training, independently evaluated scanned whole slide images, scoring fibrosis, inflammation, hepatocyte ballooning, and steatosis from baseline and month 18 biopsies for 100 patients from the precirrhotic NASH study REGENERATE. The consensus score for each parameter was defined as agreement by ≥2 pathologists. If consensus was not reached, all 3 pathologists read the slide jointly to achieve a consensus score.

Results

Between the 2 panels, the consensus was 97%-99% for steatosis, 91%-93% for fibrosis, 88%-92% for hepatocyte ballooning, and 84%-91% for inflammation. Linear weighted kappa scores between panels were similar to published NASH CRN values.

Conclusions

A panel of 3 trained pathologists independently scoring 4 NASH CRN histology parameters produced high consensus rates. Interpanel kappa values were comparable to NASH CRN metrics, supporting the accuracy and reproducibility of this method. The high concordance for fibrosis scoring was reassuring, as fibrosis is predictive of liver-specific outcomes and all-cause mortality.

SUBMITTER: Sanyal AJ

PROVIDER: S-EPMC10749704 | biostudies-literature | 2024 Jan

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Utility of pathologist panels for achieving consensus in NASH histologic scoring in clinical trials: Data from a phase 3 study.

Sanyal Arun J AJ Loomba Rohit R Anstee Quentin M QM Ratziu Vlad V Kowdley Kris V KV Rinella Mary E ME Harrison Stephen A SA Resnick Murray B MB Capozza Thomas T Sawhney Sangeeta S Shelat Nirav N Younossi Zobair M ZM

Hepatology communications 20231222 1

<h4>Background</h4>Liver histopathologic assessment is the accepted surrogate endpoint in NASH trials; however, the scoring of NASH Clinical Research Network (CRN) histologic parameters is limited by intraobserver and interobserver variability. We designed a consensus panel approach to minimize variability when using this scoring system. We assessed agreement between readers, estimated linear weighted kappas between 2 panels, compared them with published pairwise kappa estimates, and addressed h ...[more]

PMID: 38126958

Similar Datasets

Project description:The HercepTest was approved 20+ years ago as the companion diagnostic test for trastuzumab in human epidermal growth factor 2 (HER2) or ERBB2 gene-amplified/overexpressing breast cancers. Subsequent HER2 immunohistochemistry (IHC) assays followed, including the now most common Ventana 4B5 assay. Although this IHC assay has become the clinical standard, its reliability, reproducibility, and accuracy have largely been approved and accepted on the basis of concordance among small numbers of pathologists without validation in a real-world setting. In this study, we evaluated the concordance and interrater reliability of scoring HER2 IHC in 170 breast cancer biopsies by 18 breast cancer-specialized pathologists from 15 institutions. We used the Observers Needed to Evaluate Subjective Tests method to determine the plateau of concordance and the minimum number of pathologists needed to estimate interrater agreement values for large numbers of raters, as seen in the real-world setting. We report substantial discordance within the intermediate categories (<1% agreement for 1+ and 3.6% agreement for 2+) in the 4-category HER2 IHC scoring system. The discordance within the IHC 0 cases is also substantial with an overall percent agreement (OPA) of only 25% and poor interrater reliability metrics (0.49 Fleiss' kappa, 0.55 intraclass correlation coefficient). This discordance can be partially reduced by using a 3-category system (28.8% vs 46.5% OPA for 4-category and 3-category scoring systems, respectively). Observers Needed to Evaluate Subjective Tests plots suggest that the OPA for the task of determining a HER2 IHC score 0 from not 0 plateaus statistically around 59.4% at 10 raters. Conversely, at the task of scoring HER2 IHC as 3+ or not 3+ pathologists' concordance was much higher with an OPA that plateaus at 87.1% with 6 raters. This suggests that legacy HER2 IHC remains valuable for finding the patients in whom the ERBB2 gene is amplified but unacceptably discordant in assigning HER2-low or HER2-negative status for the emerging HER2-low therapies.

Project description:Background and aimsEmerging data from a single-center study suggests that a 30% relative reduction in liver fat content as assessed by magnetic resonance imaging-proton density fat fraction (MRI-PDFF) from baseline may be associated with histologic improvement in nonalcoholic steatohepatitis (NASH). There are limited multicenter data comparing an active drug versus placebo on the association between the quantity of liver fat reduction assessed by MRI-PDFF and histologic response in NASH. This study aims to examine the association between 30% relative reduction in MRI-PDFF and histologic response in obeticholic acid (OCA) versus placebo-treated patients in the FLINT (farnesoid X receptor ligand obeticholic acid in NASH trial).Approach and resultsThis is a secondary analysis of the FLINT trial including 78 patients with MRI-PDFF measured before and after treatment along with paired liver histology assessment. Histologic response was defined as a 2-point improvement in nonalcoholic fatty liver disease activity score without worsening of fibrosis. OCA (25 mg orally once daily) was better than placebo in improving MRI-PDFF by an absolute difference of -3.4% (95% confidence interval [CI], -6.5 to -0.2%, P value = 0.04) and relative difference of -17% (95% CI, -34 to 0%, P value = 0.05). The optimal cutoff point for relative decline in MRI-PDFF for histologic response was 30% (using Youden's index). The rate of histologic response in those who achieved less than 30% decline in MRI-PDFF versus those who achieved a 30% or greater decline in MRI-PDFF (MRI-PDFF responders) relative to baseline was 19% versus 50%, respectively. Compared with MRI-PDFF nonresponders, MRI-PDFF responders demonstrated both a statistically and clinically significant higher odds 4.86 (95% CI, 1.4-12.8, P value < 0.009) of histologic response, including significant improvements in both steatosis and ballooning.ConclusionOCA was better than placebo in reducing liver fat. This multicenter trial provides data regarding the association between 30% decline in MRI-PDFF relative to baseline and histologic response in NASH.

Dataset Information

Utility of pathologist panels for achieving consensus in NASH histologic scoring in clinical trials: Data from a phase 3 study.

Background

Methods

Results

Conclusions

Publications

Utility of pathologist panels for achieving consensus in NASH histologic scoring in clinical trials: Data from a phase 3 study.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets