# Common-Sense Reasoning on Common-Sense Reasoning Tasks

Source: [Common-Sense Reasoning on Common-Sense Reasoning Tasks](<https://www.sota2.com/research/sota/common-sense-reasoning-on-common-sense-reasoning-tasks>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-04-16T07:03:08.064Z

Evaluation of Common-Sense Reasoning capabilities across multiple standard tasks (ARC, PIQA, HellaSwag, WinoGrande), reporting aggregated accuracy scores alongside perplexity metrics (Wiki PPL, LMB PPL).

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Common-Sense Reasoning |
| Dataset (including any stated split) | Common-Sense Reasoning Tasks |
| Metric | Wiki PPL |
| Unit | SCALAR |
| Direction | Lower is better |
| Results loaded | 18 of 18 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Wiki PPL](<https://www.sota2.com/research/sota/common-sense-reasoning-on-common-sense-reasoning-tasks.md?metric=Wiki%20PPL>): Lower is better; unit: SCALAR.

- [LMB PPL](<https://www.sota2.com/research/sota/common-sense-reasoning-on-common-sense-reasoning-tasks.md?metric=LMB%20PPL>): Lower is better; unit: SCALAR.

- [ARC-e Acc](<https://www.sota2.com/research/sota/common-sense-reasoning-on-common-sense-reasoning-tasks.md?metric=ARC-e%20Acc>): Higher is better; unit: PERCENT.

- [ARC-c Acc](<https://www.sota2.com/research/sota/common-sense-reasoning-on-common-sense-reasoning-tasks.md?metric=ARC-c%20Acc>): Higher is better; unit: PERCENT.

- [PIQA Acc](<https://www.sota2.com/research/sota/common-sense-reasoning-on-common-sense-reasoning-tasks.md?metric=PIQA%20Acc>): Higher is better; unit: PERCENT.

- [HellaSwag Acc](<https://www.sota2.com/research/sota/common-sense-reasoning-on-common-sense-reasoning-tasks.md?metric=HellaSwag%20Acc>): Higher is better; unit: PERCENT.

- [LMB Acc](<https://www.sota2.com/research/sota/common-sense-reasoning-on-common-sense-reasoning-tasks.md?metric=LMB%20Acc>): Higher is better; unit: PERCENT.

- [WinoGrande Acc](<https://www.sota2.com/research/sota/common-sense-reasoning-on-common-sense-reasoning-tasks.md?metric=WinoGrande%20Acc>): Higher is better; unit: PERCENT.

- [Avg Acc](<https://www.sota2.com/research/sota/common-sense-reasoning-on-common-sense-reasoning-tasks.md?metric=Avg%20Acc>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Wiki PPL | Result date | Report paper |
| --- | --- | --- | --- |
| Mamba2-H | 16 | Not recorded | 68fa7c101e209131cea8c392 |
| GDN-H | 16.02 | Not recorded | 68fa7c101e209131cea8c392 |
| NHA | 16.16 | Not recorded | 68fa7c101e209131cea8c392 |
| GSA-H | 16.22 | Not recorded | 68fa7c101e209131cea8c392 |
| GSA | 16.69 | Not recorded | 68fa7c101e209131cea8c392 |
| GDN | 17.14 | Not recorded | 68fa7c101e209131cea8c392 |
| GLA-H | 17.58 | Not recorded | 68fa7c101e209131cea8c392 |
| Trans++ | 17.61 | Not recorded | 68fa7c101e209131cea8c392 |
| GLA | 17.61 | Not recorded | 68fa7c101e209131cea8c392 |
| GDN-H | 25.67 | Not recorded | 68fa7c101e209131cea8c392 |
| Mamba2-H | 25.81 | Not recorded | 68fa7c101e209131cea8c392 |
| NHA | 25.97 | Not recorded | 68fa7c101e209131cea8c392 |
| GSA-H | 26.19 | Not recorded | 68fa7c101e209131cea8c392 |
| GDN | 26.47 | Not recorded | 68fa7c101e209131cea8c392 |
| Trans++ | 26.88 | Not recorded | 68fa7c101e209131cea8c392 |
| GLA-H | 27.94 | Not recorded | 68fa7c101e209131cea8c392 |
| GSA | 28.17 | Not recorded | 68fa7c101e209131cea8c392 |
| GLA | 28.78 | Not recorded | 68fa7c101e209131cea8c392 |

### Mamba2-H

Wiki PPL: 16. Result ID: 69e0898a47f34ce924c94d77.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c101e209131cea8c392.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73641e209131cea5c239.md>)

Recorded evaluation configuration: {"Parameters":"1.3B","Training Tokens":"100B","Architecture Type":"Hybrid"}. This record does not assert independent reproduction.

### GDN-H

Wiki PPL: 16.02. Result ID: 69e0898a47f34ce924c94d7a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c101e209131cea8c392.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa774b1e209131cea72592.md>)

Recorded evaluation configuration: {"Parameters":"1.3B","Training Tokens":"100B","Architecture Type":"Hybrid"}. This record does not assert independent reproduction.

### NHA

Wiki PPL: 16.16. Result ID: 69e0898a47f34ce924c94d7b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c101e209131cea8c392.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7c101e209131cea8c392.md>)

Recorded evaluation configuration: {"Parameters":"1.3B","Training Tokens":"100B","Architecture Type":"Hybrid"}. This record does not assert independent reproduction.

### GSA-H

Wiki PPL: 16.22. Result ID: 69e0898a47f34ce924c94d79.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c101e209131cea8c392.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa757b1e209131cea68452.md>)

[Implementation](<https://github.com/sustcsonglin/flash-linear-attention>)

Recorded evaluation configuration: {"Parameters":"1.3B","Training Tokens":"100B","Architecture Type":"Hybrid"}. This record does not assert independent reproduction.

### GSA

Wiki PPL: 16.69. Result ID: 69e0898a47f34ce924c94d75.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c101e209131cea8c392.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa757b1e209131cea68452.md>)

[Implementation](<https://github.com/sustcsonglin/flash-linear-attention>)

Recorded evaluation configuration: {"Parameters":"1.3B","Training Tokens":"100B","Architecture Type":"Base"}. This record does not assert independent reproduction.

### GDN

Wiki PPL: 17.14. Result ID: 69e0898a47f34ce924c94d76.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c101e209131cea8c392.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa774b1e209131cea72592.md>)

Recorded evaluation configuration: {"Parameters":"1.3B","Training Tokens":"100B","Architecture Type":"Base"}. This record does not assert independent reproduction.

### GLA-H

Wiki PPL: 17.58. Result ID: 69e0898a47f34ce924c94d78.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c101e209131cea8c392.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74a51e209131cea62e34.md>)

Recorded evaluation configuration: {"Parameters":"1.3B","Training Tokens":"100B","Architecture Type":"Hybrid"}. This record does not assert independent reproduction.

### Trans++

Wiki PPL: 17.61. Result ID: 69e0898a47f34ce924c94d73.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c101e209131cea8c392.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa703d1e209131cea49db1.md>)

[Implementation](<https://github.com/tensorflow/tensor2tensor>)

Recorded evaluation configuration: {"Parameters":"1.3B","Training Tokens":"100B","Architecture Type":"Base"}. This record does not assert independent reproduction.

### GLA

Wiki PPL: 17.61. Result ID: 69e0898a47f34ce924c94d74.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c101e209131cea8c392.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74a51e209131cea62e34.md>)

Recorded evaluation configuration: {"Parameters":"1.3B","Training Tokens":"100B","Architecture Type":"Base"}. This record does not assert independent reproduction.

### GDN-H

Wiki PPL: 25.67. Result ID: 69e0898a47f34ce924c94d71.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c101e209131cea8c392.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa774b1e209131cea72592.md>)

Recorded evaluation configuration: {"Parameters":"340M","Training Tokens":"15B","Architecture Type":"Hybrid"}. This record does not assert independent reproduction.

### Mamba2-H

Wiki PPL: 25.81. Result ID: 69e0898a47f34ce924c94d6e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c101e209131cea8c392.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73641e209131cea5c239.md>)

Recorded evaluation configuration: {"Parameters":"340M","Training Tokens":"15B","Architecture Type":"Hybrid"}. This record does not assert independent reproduction.

### NHA

Wiki PPL: 25.97. Result ID: 69e0898a47f34ce924c94d72.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c101e209131cea8c392.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7c101e209131cea8c392.md>)

Recorded evaluation configuration: {"Parameters":"340M","Training Tokens":"15B","Architecture Type":"Hybrid"}. This record does not assert independent reproduction.

### GSA-H

Wiki PPL: 26.19. Result ID: 69e0898a47f34ce924c94d70.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c101e209131cea8c392.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa757b1e209131cea68452.md>)

[Implementation](<https://github.com/sustcsonglin/flash-linear-attention>)

Recorded evaluation configuration: {"Parameters":"340M","Training Tokens":"15B","Architecture Type":"Hybrid"}. This record does not assert independent reproduction.

### GDN

Wiki PPL: 26.47. Result ID: 69e0898a47f34ce924c94d6d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c101e209131cea8c392.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa774b1e209131cea72592.md>)

Recorded evaluation configuration: {"Parameters":"340M","Training Tokens":"15B","Architecture Type":"Base"}. This record does not assert independent reproduction.

### Trans++

Wiki PPL: 26.88. Result ID: 69e0898a47f34ce924c94d6a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c101e209131cea8c392.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa703d1e209131cea49db1.md>)

[Implementation](<https://github.com/tensorflow/tensor2tensor>)

Recorded evaluation configuration: {"Parameters":"340M","Training Tokens":"15B","Architecture Type":"Base"}. This record does not assert independent reproduction.

### GLA-H

Wiki PPL: 27.94. Result ID: 69e0898a47f34ce924c94d6f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c101e209131cea8c392.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74a51e209131cea62e34.md>)

Recorded evaluation configuration: {"Parameters":"340M","Training Tokens":"15B","Architecture Type":"Hybrid"}. This record does not assert independent reproduction.

### GSA

Wiki PPL: 28.17. Result ID: 69e0898a47f34ce924c94d6c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c101e209131cea8c392.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa757b1e209131cea68452.md>)

[Implementation](<https://github.com/sustcsonglin/flash-linear-attention>)

Recorded evaluation configuration: {"Parameters":"340M","Training Tokens":"15B","Architecture Type":"Base"}. This record does not assert independent reproduction.

### GLA

Wiki PPL: 28.78. Result ID: 69e0898a47f34ce924c94d6b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c101e209131cea8c392.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74a51e209131cea62e34.md>)

Recorded evaluation configuration: {"Parameters":"340M","Training Tokens":"15B","Architecture Type":"Base"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.