Commonsense Reasoning on SOCIALIQA (dev)
73.8AccuracyCKT
Evaluation results
| Method | Links | |
|---|---|---|
| CKTModel Scale=large2023.06 | 73.8 | |
| CALMModel Scale=large2023.06 | 72.7 | |
| T5Model Scale=large2023.06 | 71.3 | |
| FusionGated-FIRNetDiscovery Source=AI Discovered2026.03 | 42.78 | |
| PathGate-FusionNetDiscovery Source=AI Discovered2026.03 | 42.37 | |
| Hier-GateNetDiscovery Source=AI Discovered2026.03 | 42.07 | |
| AdaMulti-PathGateNetDiscovery Source=AI Discovered2026.03 | 42.07 | |
| Mamba2Discovery Source=Human Discovered2026.03 | 41.81 | |
| Content-SharpRouterDiscovery Source=AI Discovered2026.03 | 41.81 | |
| Gated DeltaNetDiscovery Source=Human Discovered2026.03 | 41.71 | |
| DeltaNetDiscovery Source=Human Discovered2026.03 | 40.74 |