Dataset Information

Augmentation by Counterfactual Explanation - Fixing an Overconfident Classifier.

ABSTRACT: A highly accurate but overconfident model is ill-suited for deployment in critical applications such as healthcare and autonomous driving. The classification outcome should reflect a high uncertainty on ambiguous in-distribution samples that lie close to the decision boundary. The model should also refrain from making overconfident decisions on samples that lie far outside its training distribution, far-out-of-distribution (far-OOD), or on unseen samples from novel classes that lie near its training distribution (near-OOD). This paper proposes an application of counterfactual explanations in fixing an over-confident classifier. Specifically, we propose to fine-tune a given pre-trained classifier using augmentations from a counterfactual explainer (ACE) to fix its uncertainty characteristics while retaining its predictive performance. We perform extensive experiments with detecting far-OOD, near-OOD, and ambiguous samples. Our empirical results show that the revised model have improved uncertainty measures, and its performance is competitive to the state-of-the-art methods.

SUBMITTER: Singla S

PROVIDER: S-EPMC10506513 | biostudies-literature | 2023 Jan

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Augmentation by Counterfactual Explanation - Fixing an Overconfident Classifier.

Singla Sumedha S Murali Nihal N Arabshahi Forough F Triantafyllou Sofia S Batmanghelich Kayhan K

IEEE Winter Conference on Applications of Computer Vision. IEEE Winter Conference on Applications of Computer Vision 20230101

A highly accurate but overconfident model is ill-suited for deployment in critical applications such as healthcare and autonomous driving. The classification outcome should reflect a high uncertainty on ambiguous in-distribution samples that lie close to the decision boundary. The model should also refrain from making overconfident decisions on samples that lie far outside its training distribution, far-out-of-distribution (far-OOD), or on unseen samples from novel classes that lie near its trai ...[more]

PMID: 37724183

Similar Datasets

Project description:Deep neural networks (DNNs) can accurately decode task-related information from brain activations. However, because of the non-linearity of DNNs, it is generally difficult to explain how and why they assign certain behavioral tasks to given brain activations, either correctly or incorrectly. One of the promising approaches for explaining such a black-box system is counterfactual explanation. In this framework, the behavior of a black-box system is explained by comparing real data and realistic synthetic data that are specifically generated such that the black-box system outputs an unreal outcome. The explanation of the system's decision can be explained by directly comparing the real and synthetic data. Recently, by taking advantage of advances in DNN-based image-to-image translation, several studies successfully applied counterfactual explanation to image domains. In principle, the same approach could be used in functional magnetic resonance imaging (fMRI) data. Because fMRI datasets often contain multiple classes (e.g., multiple behavioral tasks), the image-to-image transformation applicable to counterfactual explanation needs to learn mapping among multiple classes simultaneously. Recently, a new generative neural network (StarGAN) that enables image-to-image transformation among multiple classes has been developed. By adapting StarGAN with some modifications, here, we introduce a novel generative DNN (counterfactual activation generator, CAG) that can provide counterfactual explanations for DNN-based classifiers of brain activations. Importantly, CAG can simultaneously handle image transformation among all the seven classes in a publicly available fMRI dataset. Thus, CAG could provide a counterfactual explanation of DNN-based multiclass classifiers of brain activations. Furthermore, iterative applications of CAG were able to enhance and extract subtle spatial brain activity patterns that affected the classifier's decisions. Together, these results demonstrate that the counterfactual explanation based on image-to-image transformation would be a promising approach to understand and extend the current application of DNNs in fMRI analyses.

Project description:IntroductionPsychiatric comorbidities have a significant impact on the course of illness in patients with schizophrenia spectrum disorders. To accurately predict outcomes for individual patients using computerized prognostic models, it is essential to consider these comorbidities and their influence.MethodsIn our study, we utilized a multi-modal deep learning architecture to forecast symptomatic remission, focusing on a multicenter sample of patients with first-episode psychosis from the OPTiMiSE study. Additionally, we introduced a counterfactual model explanation technique to examine how scores on the Mini International Neuropsychiatric Interview (MINI) affected the likelihood of remission, both at the group level and for individual patients.ResultsOur findings at the group level revealed that most comorbidities had a negative association with remission. Among them, current and recurrent depressive disorders consistently exerted the greatest negative impact on the probability of remission across patients. However, we made an interesting observation: current suicidality within the past month and substance abuse within the past 12 months were associated with an increased chance of remission in patients. We found a high degree of variability among patients at the individual level. Through hierarchical clustering analysis, we identified two subgroups: one in which comorbidities had a relatively limited effect on remission (approximately 45% of patients), and another in which comorbidities more strongly influenced remission. By incorporating comorbidities into individualized prognostic prediction models, we determined which specific comorbidities had the greatest impact on remission at both the group level and for individual patients.DiscussionThese results highlight the importance of identifying and including relevant comorbidities in prediction models, providing valuable insights for improving the treatment and prognosis of patients with psychotic disorders. Furthermore, they open avenues for further research into the efficacy of treating these comorbidities to enhance overall patient outcomes.

Dataset Information

Augmentation by Counterfactual Explanation - Fixing an Overconfident Classifier.

Publications

Augmentation by Counterfactual Explanation - Fixing an Overconfident Classifier.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets