Commonsense Reasoning on MC-TACO
66.14Exact Match (EM)MDM-Prime-v2
Evaluation results
| Method | Links | |
|---|---|---|
| MDM-Prime-v2Zero-shot=true, Number of Parameters=1.1B2026.03 | 66.14 | |
| PythiaZero-shot=true, Number of Parameters=1.4B2026.03 | 54.25 | |
| BloomZero-shot=true, Number of Parameters=1.1B2026.03 | 53.63 | |
| GPT-NeoZero-shot=true, Number of Parameters=1.3B2026.03 | 42.89 | |
| TinyLLaMAZero-shot=true, Number of Parameters=1.1B2026.03 | 40.88 | |
| OPTZero-shot=true, Number of Parameters=1.3B2026.03 | 37.08 | |
| SMDMZero-shot=true, Number of Parameters=1.1B2026.03 | 35.07 | |
| GLM-130Bshots=0, parameters=130B2022.10 | 13.6 | |
| BLOOM 176Bshots=0, parameters=176B2022.10 | 13.1 | |
| OPT 175Bshots=0, parameters=175B2022.10 | 12.4 |