Improving explainable AI with patch perturbation-based evaluation pipeline: a COVID-19 X-ray image analysis case study.

ABSTRACT: Recent advances in artificial intelligence (AI) have sparked interest in developing explainable AI (XAI) methods for clinical decision support systems, especially in translational research. Although using XAI methods may enhance trust in black-box models, evaluating their effectiveness has been challenging, primarily due to the absence of human (expert) intervention, additional annotations, and automated strategies. In order to conduct a thorough assessment, we propose a patch perturbation-based approach to automatically evaluate the quality of explanations in medical imaging analysis. To eliminate the need for human efforts in conventional evaluation methods, our approach executes poisoning attacks during model retraining by generating both static and dynamic triggers. We then propose a c

SUBMITTER: Sun J 

PROVIDER: S-EPMC10636093 | biostudies-literature | 2023 Nov

REPOSITORIES: biostudies-literature