External validation of machine learning models-registered models and adaptive sample splitting.

ABSTRACT:

Background

Multivariate predictive models play a crucial role in enhancing our understanding of complex biological systems and in developing innovative, replicable tools for translational medical research. However, the complexity of machine learning methods and extensive data preprocessing and feature engineering pipelines can lead to overfitting and poor generalizability. An unbiased evaluation of predictive models necessitates external validation, which involves testing the finalized model on independent data. Despite its importance, external validation is often neglected in practice due to the associated costs.

Results

Here we propose that, for maximal credibility, model discovery and external validation should be separated by the public disclosure (e.g., preregistration)

SUBMITTER: Gallitto G 

PROVIDER: S-EPMC12077397 | biostudies-literature | 2025 Jan

REPOSITORIES: biostudies-literature