Statistical quantification of confounding bias in machine learning models.

ABSTRACT:

Background

The lack of nonparametric statistical tests for confounding bias significantly hampers the development of robust, valid, and generalizable predictive models in many fields of research. Here I propose the partial confounder test, which, for a given confounder variable, probes the null hypotheses of the model being unconfounded.

Results

The test provides a strict control for type I errors and high statistical power, even for nonnormally and nonlinearly dependent predictions, often seen in machine learning. Applying the proposed test on models trained on large-scale functional brain connectivity data (N= 1,865) (i) reveals previously unreported confounders and (ii) shows that state-of-the-art confound mitigation approaches may fail preventing confounder bias in sever

SUBMITTER: Spisak T 

PROVIDER: S-EPMC9412867 | biostudies-literature | 2022 Aug

REPOSITORIES: biostudies-literature