Instruction Following on Konkani-Instruct-100k Romi 1.0 (test)
4.4Overall LLM-as-a-Judge ScoreLlama 8B
Evaluation results
| Method | Links | |
|---|---|---|
| Llama 8BBase model=Llama 8B2026.03 | 4.4 | |
| Qwen2.5 14BBase model=Qwen2.5 14B2026.03 | 4.03 | |
| Gemma 27BBase model=Gemma 27B2026.03 | 3.55 | |
| Gemma 12BBase model=Gemma 12B2026.03 | 3.35 | |
| Gemma 4BBase model=Gemma 4B2026.03 | 2.7 | |
| Qwen2.5 1.5BBase model=Qwen2.5 1.5B2026.03 | 2.3 |