1. On generating trustworthy counterfactual explanations.
- Author
-
Del Ser, Javier, Barredo-Arrieta, Alejandro, Díaz-Rodríguez, Natalia, Herrera, Francisco, Saranti, Anna, and Holzinger, Andreas
- Subjects
- *
COUNTERFACTUALS (Logic) , *TRUST , *GENERATIVE adversarial networks , *IMAGE recognition (Computer vision) , *DEEP learning , *CHATGPT - Abstract
Deep learning models like chatGPT exemplify AI success but necessitate a deeper understanding of trust in critical sectors. Trust can be achieved using counterfactual explanations, which is how humans become familiar with unknown processes; by understanding the hypothetical input circumstances under which the output changes. We argue that the generation of counterfactual explanations requires several aspects of the generated counterfactual instances, not just their counterfactual ability. We present a framework for generating counterfactual explanations that formulate its goal as a multiobjective optimization problem balancing three objectives: plausibility; the intensity of changes; and adversarial power. We use a generative adversarial network to model the distribution of the input, along with a multiobjective counterfactual discovery solver balancing these objectives. We demonstrate the usefulness of six classification tasks with image and 3D data confirming with evidence the existence of a trade-off between the objectives, the consistency of the produced counterfactual explanations with human knowledge, and the capability of the framework to unveil the existence of concept-based biases and misrepresented attributes in the input domain of the audited model. Our pioneering effort shall inspire further work on the generation of plausible counterfactual explanations in real-world scenarios where attribute-/concept-based annotations are available for the domain under analysis. • Trustworthy counterfactuals: plausibility, change intensity, adversarial power. • Reliability: detecting bias and data misrepresentation in deep learning models. • Generating realistic counterfactual examples for improved trust in deep learning. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF