Layer-wise relevance propagation (LRP) heatmaps aim to provide graphical explanation for decisions of a classifier. This could be of great benefit to scientists for trusting complex black-box models and getting insights from their data. The LRP heatmaps tested on benchmark datasets are reported to correlate significantly with interpretable image features. In this work, we investigate these claims and propose to refine them.

doi.org/10.1109/eScience.2018.00107
IEEE International Conference on e-Science
Centrum Wiskunde & Informatica, Amsterdam (CWI), The Netherlands

Ranguelova, E., Pauwels, E., & Berkhout, J. (2018). Evaluating layer-wise relevance propagation explainability maps for artificial neural networks. In Proceedings - IEEE 14th International Conference on eScience, e-Science 2018 (pp. 377–378). doi:10.1109/eScience.2018.00107