# Knowing What You Cannot Explain: Learning to Reject Low-Quality Explanations

Source: [Knowing What You Cannot Explain: Learning to Reject Low-Quality Explanations](<https://www.sota2.com/research/paper/68fa7a181e209131cea811bd>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-03-20T05:00:04.947Z

Authors: Luca Stradiotti, Dario Pesenti, Stefano Teso, Jesse Davis

Published: 2025-07-17T08:40:28.000Z

## Abstract

Learning to Reject (LtR) frameworks allow ML models to abstain from uncertain predictions and promote user trust. However, since current LtR strategies focus solely on predictive performance, they completely neglect explanation quality. Low-quality explanations -- whether they inaccurately reflect the model's reasoning or fail to satisfy users -- can severely compromise trust assessments and induce over-reliance on incorrect predictions. We argue that models should abstain from making a prediction when they cannot offer a satisfactory explanation for it and introduce a framework for learning to reject low-quality explanations (LtX) in which predictors are equipped with a rejector that evaluates the explanation quality. Focusing on popular attribution techniques, we propose REX (REjector of low-quality eXplanations), which learns a rejector from explanation quality labels combining machine-side judgments with explicit human annotations to assess explanation quality. Our empirical evaluation demonstrates that \\method outperforms popular LtR strategies and baselines relying on isolated explanation metrics. Finally, to support future research, we publicly release a novel, larger-scale dataset of 1050 human-annotated machine explanations.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Explanation Quality Assessment on Soccer xG Explanations (User Study)](<https://www.sota2.com/research/sota/explanation-quality-assessment-on-soccer-xg-explanations-user-study.md>): Explanation Quality Assessment; Soccer xG Explanations (User Study); AUROC: 0.64.

- [Explanation quality rejection on iknl](<https://www.sota2.com/research/sota/explanation-quality-rejection-on-iknl.md>): Explanation quality rejection; iknl; AUROC: 67.

- [Explanation Quality Rejection on sleepstage](<https://www.sota2.com/research/sota/explanation-quality-rejection-on-sleepstage.md>): Explanation quality rejection; sleepstage; AUROC: 77.

- [Explanation quality rejection on celeba](<https://www.sota2.com/research/sota/explanation-quality-rejection-on-celeba.md>): Explanation quality rejection; CelebA; AUROC: 0.9.

- [Explanation quality rejection on adult](<https://www.sota2.com/research/sota/explanation-quality-rejection-on-adult.md>): Explanation quality rejection; Adult; AUROC: 0.94.

- [Explanation Quality Rejection on Compas (AUROC)](<https://www.sota2.com/research/sota/explanation-quality-rejection-on-compas-auroc.md>): Explanation quality rejection; COMPAS; AUROC: 0.99.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2507.12900>)

[PDF](<https://arxiv.org/pdf/2507.12900.pdf>)
