Assessing the net benefit of machine learning models in the presence of resource constraints.

ABSTRACT:

Objective

The objective of this study is to provide a method to calculate model performance measures in the presence of resource constraints, with a focus on net benefit (NB).

Materials and methods

To quantify a model's clinical utility, the Equator Network's TRIPOD guidelines recommend the calculation of the NB, which reflects whether the benefits conferred by intervening on true positives outweigh the harms conferred by intervening on false positives. We refer to the NB achievable in the presence of resource constraints as the realized net benefit (RNB), and provide formulae for calculating the RNB.

Results

Using 4 case studies, we demonstrate the degree to which an absolute constraint (eg, only 3 available intensive care unit [ICU] beds) diminishes the RNB of a hyp

SUBMITTER: Singh K 

PROVIDER: S-EPMC10018264 | biostudies-literature | 2023 Mar

REPOSITORIES: biostudies-literature