Open-ended cultural on Aya
15.96chrFend-to-end
Evaluation Results
| Method | Links | |
|---|---|---|
| end-to-endModel=GPT-4o-mini2026.06 | 15.96 | |
| context-aware cascadeModel=GPT-4o-mini2026.06 | 15.52 | |
| standard cascadeModel=GPT-4o-mini2026.06 | 14.65 | |
| context-aware cascadeModel=Llama-3.1-8B-Instruct2026.06 | 14.26 | |
| end-to-endModel=Mistral-7B-Instruct-v0.32026.06 | 12.61 | |
| context-aware cascadeModel=Mistral-7B-Instruct-v0.32026.06 | 11.99 | |
| end-to-endModel=Llama-3.1-8B-Instruct2026.06 | 11.27 | |
| standard cascadeModel=Mistral-7B-Instruct-v0.32026.06 | 9.71 | |
| standard cascadeModel=Llama-3.1-8B-Instruct2026.06 | 9.56 |