Search

Recent advancement in deep-neural network performance led to the development of new state-of-the-art approaches in numerous areas. However, the black-box nature of neural networks often prohibits their use in areas where model explainability and model transparency are crucial. Over the years, researchers proposed many algorithms to aid neural network understanding and provide additional information to the human expert. One of the most popular methods being Layer-Wise Relevance Propagation (LRP). This method assigns local relevance based on the pixel-wise decomposition of nonlinear classifiers. With the rise of attribution method research, there has emerged a pressing need to assess and evaluate their performance. Numerous metrics have been proposed, each assessing an individual property of attribution methods such as faithfulness, robustness or localization. Unfortunately, no single metric is deemed optimal for every case, and researchers often use several metrics to test the quality of the attribution maps. In this work, we address the shortcomings of the current LRP formulations and introduce a novel method for determining the relevance of input neurons through layer-wise relevance propagation. Furthermore, we apply this approach to the recently developed Vision Transformer architecture and evaluate its performance against existing methods on two image classification datasets, namely ImageNet and PascalVOC. Our results clearly demonstrate the advantage of our proposed method. Furthermore, we discuss the insufficiencies of current evaluation metrics for attribution-based explainability and propose a new evaluation metric that combines the notions of faithfulness, robustness and contrastiveness. We utilize this new metric to evaluate the performance of various attribution-based methods. Our code is available at: https://github.com/davor10105/relative-absolute-magnitude-propagation, Comment: 30 pages, 16 figures, 13 tables, ACM Transactions on Intelligence Systems and Technology

The paper discusses the challenges of faceted vocabulary organization in universal classifications which treat the universe of knowledge as a coherent whole and in which the concepts and subjects in different disciplines are shared, related and combined. The authors illustrate the challenges of the facet analytical approach using, as an example, the revision of class 72 in UDC. The paper reports on the research undertaken in 2013 as preparation for the revision. This consisted of analysis of concept organization in the UDC schedules in comparison with the Art & Architecture Thesaurus and class W of the Bliss Bibliographic Classification. The paper illustrates how such research can contribute to a better understanding of the field and may lead to improvements in the facet structure of this segment of the UDC vocabulary., Comment: 8 pages, 3 figures