approved
GLocalX-From Local to Global Explanations of Black Box AI Models

Artificial Intelligence (AI) has come to prominence as one of the major components of our society, with applications in most aspects of our lives. In this field, complex and highly nonlinear machine learning models such as ensemble models, deep neural networks, and Support Vector Machines have consistently shown remarkable accuracy in solving complex tasks. Although accurate, AI models often are “black boxes” which we are not able to understand. Relying on these models has a multifaceted impact and raises significant concerns about their transparency. Applications in sensitive and critical domains are a strong motivational factor in trying to understand the behavior of black boxes. We propose to address this issue by providing an interpretable layer on top of black box models by aggregating “local” explanations. We present GLocalX, a “local-first” model agnostic explanation method. Starting from local explanations expressed in form of local decision rules, GLocalX iteratively generalizes them into global explanations by hierarchically aggregating them. Our goal is to learn accurate yet simple interpretable models to emulate the given black box, and, if possible, replace it entirely. We validate GLocalX in a set of experiments in standard and constrained settings with limited or no access to either data or local explanations. Experiments show that GLocalX is able to accurately emulate several models with simple and small models, reaching state-of-the-art performance against natively global solutions. Our findings show how it is often possible to achieve a high level of both accuracy and comprehensibility of classification models, even in complex domains with high-dimensional data, without necessarily trading one property for the other. This is a key requirement for a trustworthy AI, necessary for adoption in high-stakes decision making applications.

Tags
Data and Resources
To access the resources you must log in
Additional Info
Field Value
Creator Setzu, Mattia, mattia.setzu@phd.unipi.it
Creator Guidotti, Riccardo, riccardo.guidotti@unipi.it
Creator Monreale, Anna, anna.monreale@unipi.it
Creator Turini, Franco, franco.turini@unipi.it
Creator Pedreschi, Dino, dino.pedreschi@unipi.it
Creator Giannotti, Fosca, fosca.giannotti@isti.cnr.it
DOI 10.1016/j.artint.2021.103457
Group Social Impact of AI and explainable ML
Publisher Science Direct
Source Artificial Intelligence Volume 294, May 2021, 103457
Thematic Cluster Social Data [SD]
system:type JournalArticle
Management Info
Field Value
Author Wright Joanna
Maintainer Wright Joanna
Version 1
Last Updated 8 September 2023, 18:15 (CEST)
Created 18 March 2021, 15:12 (CET)