General Language Model Reasoning on LM-Eval-Harness Hungarian
38.6Arc (hu) AccPULI-LlumiX-Llama-3.1 8B
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| PULI-LlumiX-Llama-3.1 8BChat template=false2026.01 | 38.6 | 43.2 | 42.4 | 56.1 | 53.1 | 30.4 | 48.8 | 47.6 | 47.9 | 45.5 | |
| Qwen3-4B-BaseChat template=false2026.01 | 37.9 | 41.7 | 36.1 | 45.6 | 59.7 | 32.8 | 50.5 | 64 | 64.2 | 48.1 | |
| Racka-4BChat template=true2026.01 | 34.5 | 41 | 36.6 | 45.1 | 53.8 | 36.4 | 54.9 | 53 | 53.3 | 45.4 | |
| Qwen3-4BChat template=false2026.01 | 32 | 38.4 | 33.7 | 41 | 54.3 | 31.8 | 51 | 63.3 | 62.9 | 45.3 |