Question Answering on OpenBookQA (Acc, ECE, Brier)
0.874AccuracyCoRA
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| CoRABackbone Model=Ministral 3 8B2026.06 | 0.874 | 0.1172 | 0.2396 | |
| SFTBackbone Model=Ministral 3 8B2026.06 | 0.872 | 0.1154 | 0.2423 | |
| GRPOBackbone Model=Ministral 3 8B2026.06 | 0.864 | 0.1154 | 0.2478 | |
| CoRABackbone Model=Qwen2.5 7B2026.06 | 0.86 | 0.1189 | 0.2557 | |
| GRPOBackbone Model=Gemma 2 9B Instruct2026.06 | 0.842 | 0.1452 | 0.3023 | |
| CoRABackbone Model=Gemma 2 9B Instruct2026.06 | 0.84 | 0.1414 | 0.3021 | |
| BaseBackbone Model=Ministral 3 8B2026.06 | 0.834 | 0.1394 | 0.305 | |
| SFTBackbone Model=Qwen2.5 7B2026.06 | 0.828 | 0.1271 | 0.2974 | |
| GRPOBackbone Model=Qwen2.5 7B2026.06 | 0.826 | 0.1073 | 0.278 | |
| BaseBackbone Model=Qwen2.5 7B2026.06 | 0.808 | 0.1065 | 0.3045 | |
| SFTBackbone Model=Gemma 2 9B Instruct2026.06 | 0.806 | 0.1905 | 0.3786 | |
| BaseBackbone Model=Gemma 2 9B Instruct2026.06 | 0.788 | 0.1916 | 0.3877 |