Factual Association on BMLAMA
42.2CLCallGemma3-12B-pt
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Gemma3-12B-ptModel=Gemma3-12B-pt2026.03 | 42.2 | 68.3 | 38.3 | |
| Qwen2.5-14BModel=Qwen2.5-14B2026.03 | 41.9 | 62.7 | 38.6 | |
| Aya-Expanse-8BModel=Aya-Expanse-8B2026.03 | 41.9 | 67 | 37.8 | |
| Llama3.1-8BModel=Llama3.1-8B2026.03 | 40.9 | 61.2 | 35.8 | |
| Qwen3-14BModel=Qwen3-14B2026.03 | 38.9 | 58.4 | 36.4 | |
| DCOBase Model=Gemma3-12B-pt2026.03 | 16.7 | 1.6 | 17 | |
| DCOBase Model=Qwen3-14B2026.03 | 16.2 | 8.1 | 14.5 | |
| DCOBase Model=Llama3.1-8B2026.03 | 15.7 | 7.2 | 17.6 | |
| DCOBase Model=Qwen2.5-14B2026.03 | 15.4 | 6.3 | 14.2 | |
| DCOBase Model=Aya-Expanse-8B2026.03 | 12.3 | 1.4 | 12.2 |