# Common-sense Reasoning on WinoGrande S In-Distribution Llama-3.1-8B (train test)

Source: [Common-sense Reasoning on WinoGrande S In-Distribution Llama-3.1-8B (train test)](<https://www.sota2.com/research/sota/common-sense-reasoning-on-winogrande-s-in-distribution-llama-3-1-8b-train-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-04-07T07:48:40.710Z

Evaluation of Common-sense Reasoning performance on the WinoGrande S In-Distribution subset, including metrics like Accuracy (ACC), Expected Calibration Error (ECE), and Negative Log-Likelihood (NLL).

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Common-sense Reasoning |
| Dataset (including any stated split) | WinoGrande S In-Distribution Llama-3.1-8B (train test) |
| Metric | Accuracy |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 15 of 15 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Accuracy](<https://www.sota2.com/research/sota/common-sense-reasoning-on-winogrande-s-in-distribution-llama-3-1-8b-train-test.md?metric=Accuracy>): Higher is better; unit: PERCENT.

- [Expected Calibration Error](<https://www.sota2.com/research/sota/common-sense-reasoning-on-winogrande-s-in-distribution-llama-3-1-8b-train-test.md?metric=Expected%20Calibration%20Error>): Lower is better; unit: PERCENT.

- [Negative Log-Likelihood](<https://www.sota2.com/research/sota/common-sense-reasoning-on-winogrande-s-in-distribution-llama-3-1-8b-train-test.md?metric=Negative%20Log-Likelihood>): Lower is better; unit: SCALAR.

## Recorded results

| Method | Accuracy | Result date | Report paper |
| --- | --- | --- | --- |
| PoLAR-MLE | 78.09 | Not recorded | 69d48f9d7d0172140ec74393 |
| PoLAR-LA | 78.09 | Not recorded | 69d48f9d7d0172140ec74393 |
| PoLAR-LA-LL | 78.09 | Not recorded | 69d48f9d7d0172140ec74393 |
| MLE | 77.92 | Not recorded | 69d48f9d7d0172140ec74393 |
| LA | 77.92 | Not recorded | 69d48f9d7d0172140ec74393 |
| MAP | 77.32 | Not recorded | 69d48f9d7d0172140ec74393 |
| PoLAR-VBLL (w/o LA) | 77.26 | Not recorded | 69d48f9d7d0172140ec74393 |
| PoLAR-VBLL | 77.26 | Not recorded | 69d48f9d7d0172140ec74393 |
| C-LoRA | 77.16 | Not recorded | 69d48f9d7d0172140ec74393 |
| ENS | 77 | Not recorded | 69d48f9d7d0172140ec74393 |
| MCD | 76.92 | Not recorded | 69d48f9d7d0172140ec74393 |
| PoLAR-BLoB | 76.49 | Not recorded | 69d48f9d7d0172140ec74393 |
| TFB-LL | 76.25 | Not recorded | 69d48f9d7d0172140ec74393 |
| TFB | 73.53 | Not recorded | 69d48f9d7d0172140ec74393 |
| BLoB | 72.36 | Not recorded | 69d48f9d7d0172140ec74393 |

### PoLAR-MLE

Accuracy: 78.09. Result ID: 69d4b6d747f34ce924bc4247.

[Reporting paper](<https://www.sota2.com/research/paper/69d48f9d7d0172140ec74393.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69d48f9d7d0172140ec74393.md>)

Recorded evaluation configuration: {"Backbone":"Llama-3.1-8B","Fine-tuning Steps":"5000"}. This record does not assert independent reproduction.

### PoLAR-LA

Accuracy: 78.09. Result ID: 69d4b6d747f34ce924bc4248.

[Reporting paper](<https://www.sota2.com/research/paper/69d48f9d7d0172140ec74393.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69d48f9d7d0172140ec74393.md>)

Recorded evaluation configuration: {"Backbone":"Llama-3.1-8B","Fine-tuning Steps":"5000"}. This record does not assert independent reproduction.

### PoLAR-LA-LL

Accuracy: 78.09. Result ID: 69d4b6d747f34ce924bc4249.

[Reporting paper](<https://www.sota2.com/research/paper/69d48f9d7d0172140ec74393.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69d48f9d7d0172140ec74393.md>)

Recorded evaluation configuration: {"Backbone":"Llama-3.1-8B","Fine-tuning Steps":"5000"}. This record does not assert independent reproduction.

### MLE

Accuracy: 77.92. Result ID: 69d4b6d747f34ce924bc4242.

[Reporting paper](<https://www.sota2.com/research/paper/69d48f9d7d0172140ec74393.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6b121e209131cea2bf59.md>)

[Implementation](<https://github.com/microsoft/LoRA>)

Recorded evaluation configuration: {"Backbone":"Llama-3.1-8B","Fine-tuning Steps":"5000"}. This record does not assert independent reproduction.

### LA

Accuracy: 77.92. Result ID: 69d4b6d747f34ce924bc4243.

[Reporting paper](<https://www.sota2.com/research/paper/69d48f9d7d0172140ec74393.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72111e209131cea54493.md>)

Recorded evaluation configuration: {"Backbone":"Llama-3.1-8B","Fine-tuning Steps":"5000"}. This record does not assert independent reproduction.

### MAP

Accuracy: 77.32. Result ID: 69d4b6d747f34ce924bc4244.

[Reporting paper](<https://www.sota2.com/research/paper/69d48f9d7d0172140ec74393.md>)

Recorded evaluation configuration: {"Backbone":"Llama-3.1-8B","Fine-tuning Steps":"5000"}. This record does not assert independent reproduction.

### PoLAR-VBLL (w/o LA)

Accuracy: 77.26. Result ID: 69d4b6d747f34ce924bc424f.

[Reporting paper](<https://www.sota2.com/research/paper/69d48f9d7d0172140ec74393.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69d48f9d7d0172140ec74393.md>)

Recorded evaluation configuration: {"Backbone":"Llama-3.1-8B","Fine-tuning Steps":"5000"}. This record does not assert independent reproduction.

### PoLAR-VBLL

Accuracy: 77.26. Result ID: 69d4b6d747f34ce924bc4250.

[Reporting paper](<https://www.sota2.com/research/paper/69d48f9d7d0172140ec74393.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69d48f9d7d0172140ec74393.md>)

Recorded evaluation configuration: {"Backbone":"Llama-3.1-8B","Fine-tuning Steps":"5000"}. This record does not assert independent reproduction.

### C-LoRA

Accuracy: 77.16. Result ID: 69d4b6d747f34ce924bc424c.

[Reporting paper](<https://www.sota2.com/research/paper/69d48f9d7d0172140ec74393.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78d51e209131cea7aa6e.md>)

Recorded evaluation configuration: {"Backbone":"Llama-3.1-8B","Fine-tuning Steps":"5000"}. This record does not assert independent reproduction.

### ENS

Accuracy: 77. Result ID: 69d4b6d747f34ce924bc4246.

[Reporting paper](<https://www.sota2.com/research/paper/69d48f9d7d0172140ec74393.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa63bc1e209131cea0084f.md>)

Recorded evaluation configuration: {"Backbone":"Llama-3.1-8B","Fine-tuning Steps":"5000"}. This record does not assert independent reproduction.

### MCD

Accuracy: 76.92. Result ID: 69d4b6d747f34ce924bc4245.

[Reporting paper](<https://www.sota2.com/research/paper/69d48f9d7d0172140ec74393.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa62d31e209131ce9fb5ff.md>)

Recorded evaluation configuration: {"Backbone":"Llama-3.1-8B","Fine-tuning Steps":"5000"}. This record does not assert independent reproduction.

### PoLAR-BLoB

Accuracy: 76.49. Result ID: 69d4b6d747f34ce924bc424e.

[Reporting paper](<https://www.sota2.com/research/paper/69d48f9d7d0172140ec74393.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69d48f9d7d0172140ec74393.md>)

Recorded evaluation configuration: {"Backbone":"Llama-3.1-8B","Fine-tuning Steps":"5000"}. This record does not assert independent reproduction.

### TFB-LL

Accuracy: 76.25. Result ID: 69d4b6d747f34ce924bc424a.

[Reporting paper](<https://www.sota2.com/research/paper/69d48f9d7d0172140ec74393.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7bab1e209131cea89c89.md>)

Recorded evaluation configuration: {"Backbone":"Llama-3.1-8B","Fine-tuning Steps":"5000"}. This record does not assert independent reproduction.

### TFB

Accuracy: 73.53. Result ID: 69d4b6d747f34ce924bc424b.

[Reporting paper](<https://www.sota2.com/research/paper/69d48f9d7d0172140ec74393.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7bab1e209131cea89c89.md>)

Recorded evaluation configuration: {"Backbone":"Llama-3.1-8B","Fine-tuning Steps":"5000"}. This record does not assert independent reproduction.

### BLoB

Accuracy: 72.36. Result ID: 69d4b6d747f34ce924bc424d.

[Reporting paper](<https://www.sota2.com/research/paper/69d48f9d7d0172140ec74393.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76b91e209131cea6ebb3.md>)

Recorded evaluation configuration: {"Backbone":"Llama-3.1-8B","Fine-tuning Steps":"5000"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
