# Zero-shot Reasoning on Multiple Reasoning Datasets Combined

Source: [Zero-shot Reasoning on Multiple Reasoning Datasets Combined](<https://www.sota2.com/research/sota/zero-shot-reasoning-on-multiple-reasoning-datasets-combined>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-03-26T14:57:55.342Z

Evaluation of zero-shot reasoning performance aggregated across multiple combined reasoning datasets, reporting three distinct average scores.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Zero-shot Reasoning |
| Dataset (including any stated split) | Multiple Reasoning Datasets Combined |
| Metric | Average Score 0 |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 11 of 11 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Average Score 0](<https://www.sota2.com/research/sota/zero-shot-reasoning-on-multiple-reasoning-datasets-combined.md?metric=Average%20Score%200>): Higher is better; unit: SCALAR.

- [Average Score 1](<https://www.sota2.com/research/sota/zero-shot-reasoning-on-multiple-reasoning-datasets-combined.md?metric=Average%20Score%201>): Higher is better; unit: SCALAR.

- [Average Score 2](<https://www.sota2.com/research/sota/zero-shot-reasoning-on-multiple-reasoning-datasets-combined.md?metric=Average%20Score%202>): Higher is better; unit: SCALAR.

## Recorded results

| Method | Average Score 0 | Result date | Report paper |
| --- | --- | --- | --- |
| PLDRv51-SOC-110M-5 | 42.62 | Not recorded | 69c4bd620636e5bf4afc741b |
| GPT-Neo-125M | 41.91 | Not recorded | 69c4bd620636e5bf4afc741b |
| PLDRv51-SOC-110M-2 | 41.57 | Not recorded | 69c4bd620636e5bf4afc741b |
| PLDRv51-SOC-110M-4 | 41.46 | Not recorded | 69c4bd620636e5bf4afc741b |
| PLDRv51-SOC-110M-3 | 41.21 | Not recorded | 69c4bd620636e5bf4afc741b |
| PLDRv51-SOC-110M-1 | 40.95 | Not recorded | 69c4bd620636e5bf4afc741b |
| ABL-SOC-110M-1 | 39.18 | Not recorded | 69c4bd620636e5bf4afc741b |
| ABL-SOC-110M-3 | 36.32 | Not recorded | 69c4bd620636e5bf4afc741b |
| ABL-SOC-110M-2 | 36.03 | Not recorded | 69c4bd620636e5bf4afc741b |
| SUB-SOC-110M-1 | 35.49 | Not recorded | 69c4bd620636e5bf4afc741b |
| SUB-SOC-110M-2 | 35.47 | Not recorded | 69c4bd620636e5bf4afc741b |

### PLDRv51-SOC-110M-5

Average Score 0: 42.62. Result ID: 69c5493447f34ce924af5ec8.

[Reporting paper](<https://www.sota2.com/research/paper/69c4bd620636e5bf4afc741b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69c4bd620636e5bf4afc741b.md>)

[Implementation](<https://github.com/burcgokden/PLDR-LLM-Self-Organized-Criticality>)

Recorded evaluation configuration: {"Zero-shot":"true"}. This record does not assert independent reproduction.

### GPT-Neo-125M

Average Score 0: 41.91. Result ID: 69c5493447f34ce924af5ece.

[Reporting paper](<https://www.sota2.com/research/paper/69c4bd620636e5bf4afc741b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa77211e209131cea7145a.md>)

Recorded evaluation configuration: {"Zero-shot":"true"}. This record does not assert independent reproduction.

### PLDRv51-SOC-110M-2

Average Score 0: 41.57. Result ID: 69c5493447f34ce924af5ec5.

[Reporting paper](<https://www.sota2.com/research/paper/69c4bd620636e5bf4afc741b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69c4bd620636e5bf4afc741b.md>)

[Implementation](<https://github.com/burcgokden/PLDR-LLM-Self-Organized-Criticality>)

Recorded evaluation configuration: {"Zero-shot":"true"}. This record does not assert independent reproduction.

### PLDRv51-SOC-110M-4

Average Score 0: 41.46. Result ID: 69c5493447f34ce924af5ec7.

[Reporting paper](<https://www.sota2.com/research/paper/69c4bd620636e5bf4afc741b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69c4bd620636e5bf4afc741b.md>)

[Implementation](<https://github.com/burcgokden/PLDR-LLM-Self-Organized-Criticality>)

Recorded evaluation configuration: {"Zero-shot":"true"}. This record does not assert independent reproduction.

### PLDRv51-SOC-110M-3

Average Score 0: 41.21. Result ID: 69c5493447f34ce924af5ec6.

[Reporting paper](<https://www.sota2.com/research/paper/69c4bd620636e5bf4afc741b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69c4bd620636e5bf4afc741b.md>)

[Implementation](<https://github.com/burcgokden/PLDR-LLM-Self-Organized-Criticality>)

Recorded evaluation configuration: {"Zero-shot":"true"}. This record does not assert independent reproduction.

### PLDRv51-SOC-110M-1

Average Score 0: 40.95. Result ID: 69c5493447f34ce924af5ec4.

[Reporting paper](<https://www.sota2.com/research/paper/69c4bd620636e5bf4afc741b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69c4bd620636e5bf4afc741b.md>)

[Implementation](<https://github.com/burcgokden/PLDR-LLM-Self-Organized-Criticality>)

Recorded evaluation configuration: {"Zero-shot":"true"}. This record does not assert independent reproduction.

### ABL-SOC-110M-1

Average Score 0: 39.18. Result ID: 69c5493447f34ce924af5ecb.

[Reporting paper](<https://www.sota2.com/research/paper/69c4bd620636e5bf4afc741b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69c4bd620636e5bf4afc741b.md>)

[Implementation](<https://github.com/burcgokden/PLDR-LLM-Self-Organized-Criticality>)

Recorded evaluation configuration: {"Zero-shot":"true"}. This record does not assert independent reproduction.

### ABL-SOC-110M-3

Average Score 0: 36.32. Result ID: 69c5493447f34ce924af5ecd.

[Reporting paper](<https://www.sota2.com/research/paper/69c4bd620636e5bf4afc741b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69c4bd620636e5bf4afc741b.md>)

[Implementation](<https://github.com/burcgokden/PLDR-LLM-Self-Organized-Criticality>)

Recorded evaluation configuration: {"Zero-shot":"true"}. This record does not assert independent reproduction.

### ABL-SOC-110M-2

Average Score 0: 36.03. Result ID: 69c5493447f34ce924af5ecc.

[Reporting paper](<https://www.sota2.com/research/paper/69c4bd620636e5bf4afc741b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69c4bd620636e5bf4afc741b.md>)

[Implementation](<https://github.com/burcgokden/PLDR-LLM-Self-Organized-Criticality>)

Recorded evaluation configuration: {"Zero-shot":"true"}. This record does not assert independent reproduction.

### SUB-SOC-110M-1

Average Score 0: 35.49. Result ID: 69c5493447f34ce924af5ec9.

[Reporting paper](<https://www.sota2.com/research/paper/69c4bd620636e5bf4afc741b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69c4bd620636e5bf4afc741b.md>)

[Implementation](<https://github.com/burcgokden/PLDR-LLM-Self-Organized-Criticality>)

Recorded evaluation configuration: {"Zero-shot":"true"}. This record does not assert independent reproduction.

### SUB-SOC-110M-2

Average Score 0: 35.47. Result ID: 69c5493447f34ce924af5eca.

[Reporting paper](<https://www.sota2.com/research/paper/69c4bd620636e5bf4afc741b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69c4bd620636e5bf4afc741b.md>)

[Implementation](<https://github.com/burcgokden/PLDR-LLM-Self-Organized-Criticality>)

Recorded evaluation configuration: {"Zero-shot":"true"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
