Relationship between prediction accuracy and feature importance reliability: An empirical and theoretical study.

ABSTRACT: There is significant interest in using neuroimaging data to predict behavior. The predictive models are often interpreted by the computation of feature importance, which quantifies the predictive relevance of an imaging feature. Tian and Zalesky (2021) suggest that feature importance estimates exhibit low split-half reliability, as well as a trade-off between prediction accuracy and feature importance reliability across parcellation resolutions. However, it is unclear whether the trade-off between prediction accuracy and feature importance reliability is universal. Here, we demonstrate that, with a sufficient sample size, feature importance (operationalized as Haufe-transformed weights) can achieve fair to excellent split-half reliability. With a sample size of 2600 participants, Haufe-tra

SUBMITTER: Chen J 

PROVIDER: S-EPMC10241563 | biostudies-literature | 2023 Jul

REPOSITORIES: biostudies-literature