Common Sense Reasoning on PIQA (dev)
83.2AccuracyMegatron-NLG
Evaluation Results
| Method | Links | |
|---|---|---|
| Megatron-NLGModel Size=530B, Evaluation Protocol=Few-shot2021.12 | 83.2 | |
| GPT-3Model Size=175B, Evaluation Protocol=Few-shot, Shots=502021.12 | 82.3 | |
| GopherModel Size=280B, Evaluation Protocol=Few-shot, Shots=02021.12 | 81.8 | |
| GLaMModel Size=64B/64E, Evaluation Protocol=Few-shot, Shots=322021.12 | 81.8 | |
| GLaMModel Size=64B/64E, Evaluation Protocol=One-shot2021.12 | 81.4 | |
| GPT-3Model Size=175B, Evaluation Protocol=Zero-shot2021.12 | 81 | |
| GPT-3Model Size=175B, Evaluation Protocol=One-shot2021.12 | 80.5 | |
| GLaMModel Size=64B/64E, Evaluation Protocol=Zero-shot2021.12 | 80.4 | |
| CKTModel Scale=large2023.06 | 76.07 | |
| CALMModel Scale=large2023.06 | 75.11 | |
| Content-SharpRouterDiscovery Source=AI Discovered2026.03 | 74.37 | |
| Hier-GateNetDiscovery Source=AI Discovered2026.03 | 74.37 | |
| Gated DeltaNetDiscovery Source=Human Discovered2026.03 | 74.1 | |
| AdaMulti-PathGateNetDiscovery Source=AI Discovered2026.03 | 74.1 | |
| Mamba2Discovery Source=Human Discovered2026.03 | 73.78 | |
| DeltaNetDiscovery Source=Human Discovered2026.03 | 73.12 | |
| PathGate-FusionNetDiscovery Source=AI Discovered2026.03 | 72.91 | |
| FusionGated-FIRNetDiscovery Source=AI Discovered2026.03 | 72.91 | |
| T5Model Scale=large2023.06 | 72.19 |