# Evaluating the performance of the LIME and Grad-CAM explanation methods on a LEGO multi-label image classification task

Source: [Evaluating the performance of the LIME and Grad-CAM explanation methods on a LEGO multi-label image classification task](<https://www.sota2.com/research/paper/68fa68181e209131cea1a2dc>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-25T22:29:00.055Z

Authors: David Cian, Jan van Gemert, Attila Lengyel

Published: 2020-08-04T14:27:13.000Z

## Abstract

In this paper, we run two methods of explanation, namely LIME and Grad-CAM, on a convolutional neural network trained to label images with the LEGO bricks that are visible in them. We evaluate them on two criteria, the improvement of the network's core performance and the trust they are able to generate for users of the system. We find that in general, Grad-CAM seems to outperform LIME on this specific task: it yields more detailed insight from the point of view of core performance and 80\\% of respondents asked to choose between them when it comes to the trust they inspire in the model choose Grad-CAM. However, we also posit that it is more useful to employ these two methods together, as the insights they yield are complementary.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2008.01584>)

[PDF](<https://arxiv.org/pdf/2008.01584.pdf>)
