Commonsense MCQ on Global-PIQA
80.69Accuracystandard cascade
Evaluation Results
| Method | Links | |
|---|---|---|
| standard cascadeModel=GPT-4o-mini2026.06 | 80.69 | |
| context-aware cascadeModel=GPT-4o-mini2026.06 | 76.95 | |
| context-aware cascadeModel=Llama-3.1-8B-Instruct2026.06 | 66.24 | |
| standard cascadeModel=Llama-3.1-8B-Instruct2026.06 | 65.6 | |
| end-to-endModel=Llama-3.1-8B-Instruct2026.06 | 61.95 | |
| context-aware cascadeModel=Mistral-7B-Instruct-v0.32026.06 | 59.11 | |
| standard cascadeModel=Mistral-7B-Instruct-v0.32026.06 | 51.72 | |
| end-to-endModel=Mistral-7B-Instruct-v0.32026.06 | 50.6 | |
| end-to-endModel=GPT-4o-mini2026.06 | 49.02 |