# QADiver: Interactive Framework for Diagnosing QA Models

Source: [QADiver: Interactive Framework for Diagnosing QA Models](<https://www.sota2.com/research/paper/68fa651a1e209131cea08551>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-25T21:18:52.954Z

Authors: Gyeongbok Lee, Sungdong Kim, Seung-won Hwang

Published: 2018-12-01T06:43:55.000Z

## Abstract

Question answering (QA) extracting answers from text to the given question in natural language, has been actively studied and existing models have shown a promise of outperforming human performance when trained and evaluated with SQuAD dataset. However, such performance may not be replicated in the actual setting, for which we need to diagnose the cause, which is non-trivial due to the complexity of model. We thus propose a web-based UI that provides how each model contributes to QA performances, by integrating visualization and analysis tools for model explanation. We expect this framework can help QA model researchers to refine and improve their models.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/1812.00161>)

[PDF](<https://arxiv.org/pdf/1812.00161.pdf>)
