Confound-leakage: confound removal in machine learning leads to leakage.

ABSTRACT:

Background

Machine learning (ML) approaches are a crucial component of modern data analysis in many fields, including epidemiology and medicine. Nonlinear ML methods often achieve accurate predictions, for instance, in personalized medicine, as they are capable of modeling complex relationships between features and the target. Problematically, ML models and their predictions can be biased by confounding information present in the features. To remove this spurious signal, researchers often employ featurewise linear confound regression (CR). While this is considered a standard approach for dealing with confounding, possible pitfalls of using CR in ML pipelines are not fully understood.

Results

We provide new evidence that, contrary to general expectations, linear confound regr

SUBMITTER: Hamdan S 

PROVIDER: S-EPMC10541796 | biostudies-literature | 2022 Dec

REPOSITORIES: biostudies-literature