# Multiple-choice science question answering on OBQA In-Distribution 64

Source: [Multiple-choice science question answering on OBQA In-Distribution 64](<https://www.sota2.com/research/sota/multiple-choice-science-question-answering-on-obqa-in-distribution-64>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:30:16.831Z

Evaluation of model performance on the In-Distribution 64 subset of the OpenBookQA (OBQA) dataset for multiple-choice science question answering, typically measured by Accuracy (ACC), Expected Calibration Error (ECE), and Negative Log-Likelihood (NLL).

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Multiple-choice science question answering |
| Dataset (including any stated split) | OBQA In-Distribution 64 |
| Metric | Accuracy |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 9 of 9 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Accuracy](<https://www.sota2.com/research/sota/multiple-choice-science-question-answering-on-obqa-in-distribution-64.md?metric=Accuracy>): Higher is better; unit: PERCENT.

- [ECE](<https://www.sota2.com/research/sota/multiple-choice-science-question-answering-on-obqa-in-distribution-64.md?metric=ECE>): Lower is better; unit: PERCENT.

- [NLL](<https://www.sota2.com/research/sota/multiple-choice-science-question-answering-on-obqa-in-distribution-64.md?metric=NLL>): Lower is better; unit: SCALAR.

## Recorded results

| Method | Accuracy | Result date | Report paper |
| --- | --- | --- | --- |
| BLoB | 82.73 | Not recorded | 68fa76b91e209131cea6ebb3 |
| LAP | 82.12 | Not recorded | 68fa76b91e209131cea6ebb3 |
| BBB | 82.06 | Not recorded | 68fa76b91e209131cea6ebb3 |
| BLoB | 81.79 | Not recorded | 68fa76b91e209131cea6ebb3 |
| MCD | 81.72 | Not recorded | 68fa76b91e209131cea6ebb3 |
| MLE | 81.52 | Not recorded | 68fa76b91e209131cea6ebb3 |
| BLoB | 81.52 | Not recorded | 68fa76b91e209131cea6ebb3 |
| MAP | 81.38 | Not recorded | 68fa76b91e209131cea6ebb3 |
| ENS | 81.38 | Not recorded | 68fa76b91e209131cea6ebb3 |

### BLoB

Accuracy: 82.73. Result ID: 69944c093a6c3148491c5502.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76b91e209131cea6ebb3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76b91e209131cea6ebb3.md>)

Recorded evaluation configuration: {"Backbone":"Llama2-7B","PEFT Method":"LoRA","Number of samples (N)":0}. This record does not assert independent reproduction.

### LAP

Accuracy: 82.12. Result ID: 69944c093a6c3148491c5501.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76b91e209131cea6ebb3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72111e209131cea54493.md>)

Recorded evaluation configuration: {"Backbone":"Llama2-7B","PEFT Method":"LoRA"}. This record does not assert independent reproduction.

### BBB

Accuracy: 82.06. Result ID: 69944c093a6c3148491c5500.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76b91e209131cea6ebb3.md>)

Recorded evaluation configuration: {"Backbone":"Llama2-7B","PEFT Method":"LoRA"}. This record does not assert independent reproduction.

### BLoB

Accuracy: 81.79. Result ID: 69944c093a6c3148491c5503.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76b91e209131cea6ebb3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76b91e209131cea6ebb3.md>)

Recorded evaluation configuration: {"Backbone":"Llama2-7B","PEFT Method":"LoRA","Number of samples (N)":5}. This record does not assert independent reproduction.

### MCD

Accuracy: 81.72. Result ID: 69944c093a6c3148491c54fe.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76b91e209131cea6ebb3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa62d31e209131ce9fb5ff.md>)

Recorded evaluation configuration: {"Backbone":"Llama2-7B","PEFT Method":"LoRA"}. This record does not assert independent reproduction.

### MLE

Accuracy: 81.52. Result ID: 69944c093a6c3148491c54fc.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76b91e209131cea6ebb3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6b121e209131cea2bf59.md>)

[Implementation](<https://github.com/microsoft/LoRA>)

Recorded evaluation configuration: {"Backbone":"Llama2-7B","PEFT Method":"LoRA"}. This record does not assert independent reproduction.

### BLoB

Accuracy: 81.52. Result ID: 69944c093a6c3148491c5504.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76b91e209131cea6ebb3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76b91e209131cea6ebb3.md>)

Recorded evaluation configuration: {"Backbone":"Llama2-7B","PEFT Method":"LoRA","Number of samples (N)":10}. This record does not assert independent reproduction.

### MAP

Accuracy: 81.38. Result ID: 69944c093a6c3148491c54fd.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76b91e209131cea6ebb3.md>)

Recorded evaluation configuration: {"Backbone":"Llama2-7B","PEFT Method":"LoRA"}. This record does not assert independent reproduction.

### ENS

Accuracy: 81.38. Result ID: 69944c093a6c3148491c54ff.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76b91e209131cea6ebb3.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa63bc1e209131cea0084f.md>)

Recorded evaluation configuration: {"Backbone":"Llama2-7B","PEFT Method":"LoRA"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.