# Question Answering on ARC-E (Accuracy $\\Delta$)

Source: [Question Answering on ARC-E (Accuracy $\\Delta$)](<https://www.sota2.com/research/sota/question-answering-on-arc-e-accuracy-delta>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-04-07T10:38:41.528Z

Evaluation of Question Answering performance on the Abstract Reasoning Corpus Easy split (ARC-E), specifically measured using the Accuracy Delta metric.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Question Answering |
| Dataset (including any stated split) | ARC-E |
| Metric | Accuracy Delta |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 9 of 9 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Accuracy Delta](<https://www.sota2.com/research/sota/question-answering-on-arc-e-accuracy-delta.md?metric=Accuracy%20Delta>): Higher is better; unit: SCALAR.

## Recorded results

| Method | Accuracy Delta | Result date | Report paper |
| --- | --- | --- | --- |
| LoRA | 1.3 | Not recorded | 69d48fb47d0172140ec744ce |
| LoRA | 0.9 | Not recorded | 69d48fb47d0172140ec744ce |
| LoRA | 0.7 | Not recorded | 69d48fb47d0172140ec744ce |
| LoRA | 0.6 | Not recorded | 69d48fb47d0172140ec744ce |
| LoRA | 0.6 | Not recorded | 69d48fb47d0172140ec744ce |
| LoRA | 0.4 | Not recorded | 69d48fb47d0172140ec744ce |
| GAIN | 0.3 | Not recorded | 69d48fb47d0172140ec744ce |
| GAIN | 0.1 | Not recorded | 69d48fb47d0172140ec744ce |
| GAIN | 0 | Not recorded | 69d48fb47d0172140ec744ce |

### LoRA

Accuracy Delta: 1.3. Result ID: 69d4deac47f34ce924bd61d0.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fb47d0172140ec744ce.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74e81e209131cea649cb.md>)

Recorded evaluation configuration: {"Model":"Llama-2-13B","Params":"410K","Learning Rate":"10−3"}. This record does not assert independent reproduction.

### LoRA

Accuracy Delta: 0.9. Result ID: 69d4deac47f34ce924bd61d3.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fb47d0172140ec744ce.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74e81e209131cea649cb.md>)

Recorded evaluation configuration: {"Model":"Llama-2-70B","Params":"1.3M","Learning Rate":"10−3"}. This record does not assert independent reproduction.

### LoRA

Accuracy Delta: 0.7. Result ID: 69d4deac47f34ce924bd61d1.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fb47d0172140ec744ce.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74e81e209131cea649cb.md>)

Recorded evaluation configuration: {"Model":"Llama-2-13B","Params":"410K","Learning Rate":"3×10−4"}. This record does not assert independent reproduction.

### LoRA

Accuracy Delta: 0.6. Result ID: 69d4deac47f34ce924bd61cd.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fb47d0172140ec744ce.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74e81e209131cea649cb.md>)

Recorded evaluation configuration: {"Model":"Mistral-7B","Params":"262K","Learning Rate":"10−3"}. This record does not assert independent reproduction.

### LoRA

Accuracy Delta: 0.6. Result ID: 69d4deac47f34ce924bd61d4.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fb47d0172140ec744ce.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74e81e209131cea649cb.md>)

Recorded evaluation configuration: {"Model":"Llama-2-70B","Params":"1.3M","Learning Rate":"3×10−4"}. This record does not assert independent reproduction.

### LoRA

Accuracy Delta: 0.4. Result ID: 69d4deac47f34ce924bd61ce.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fb47d0172140ec744ce.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74e81e209131cea649cb.md>)

Recorded evaluation configuration: {"Model":"Mistral-7B","Params":"262K","Learning Rate":"3×10−4"}. This record does not assert independent reproduction.

### GAIN

Accuracy Delta: 0.3. Result ID: 69d4deac47f34ce924bd61cc.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fb47d0172140ec744ce.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69d48fb47d0172140ec744ce.md>)

Recorded evaluation configuration: {"Model":"Mistral-7B","Params":"131K"}. This record does not assert independent reproduction.

### GAIN

Accuracy Delta: 0.1. Result ID: 69d4deac47f34ce924bd61cf.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fb47d0172140ec744ce.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69d48fb47d0172140ec744ce.md>)

Recorded evaluation configuration: {"Model":"Llama-2-13B","Params":"205K"}. This record does not assert independent reproduction.

### GAIN

Accuracy Delta: 0. Result ID: 69d4deac47f34ce924bd61d2.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fb47d0172140ec744ce.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69d48fb47d0172140ec744ce.md>)

Recorded evaluation configuration: {"Model":"Llama-2-70B","Params":"655K"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.