Language Modeling on CulturaX v1.0 (val)
3.9Language Score (ar)Qwen2-7B
Evaluation results
| Method | Links | ||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Qwen2-7BParameters=7B, Backbone=Qwen22025.06 | 3.9 | 8.1 | 11.8 | 4.9 | 3.8 | 2.1 | 2.9 | 2.3 | 3.8 | 2.9 | 2.3 | 2.9 | 3.3 | 4.2 | |
| Qwen2-1.5BParameters=1.5B, Backbone=Qwen22025.06 | 4.7 | 11.1 | 15.7 | 6 | 4.6 | 2.4 | 3.3 | 2.6 | 5.7 | 3.3 | 2.8 | 3.4 | 4 | 5.3 | |
| TokAlign + LATBackbone=Pythia-6.9B, LAT=true2025.06 | 5.2 | 9.9 | 17.8 | 7.4 | 8 | 2.1 | 3.8 | 2.8 | 4 | 3.7 | 2.1 | 2.1 | 3.1 | 5.5 | |
| Pythia-6.9BParameters=6.9B, Backbone=Pythia2025.06 | 5.9 | 10.8 | 16.7 | 7.9 | 9.9 | 3 | 4.6 | 3.7 | 4.9 | 4.9 | 2.6 | 2.6 | 4.8 | 6.3 | |
| TokAlign + LATBackbone=Pythia-1B, LAT=true2025.06 | 6.3 | 13.9 | 23.6 | 8.9 | 9 | 2.4 | 4.4 | 3.2 | 5.2 | 4.4 | 2.4 | 2.3 | 3.7 | 4.2 | |
| Focus + LATBackbone=Pythia-6.9B, LAT=true2025.06 | 6.8 | 17.6 | 39.3 | 10.8 | 11.1 | 2.5 | 5 | 3.3 | 5.2 | 4.8 | 2.3 | 2.1 | 3.7 | 8.8 | |
| ZeTT + LATBackbone=Pythia-1B, LAT=true2025.06 | 7.1 | 15.7 | 26.4 | 10 | 10.3 | 2.8 | 5 | 3.6 | 5.9 | 4.9 | 2.6 | 2.7 | 4.6 | 7.8 | |
| Pythia-1BParameters=1B, Backbone=Pythia2025.06 | 7.6 | 15.4 | 21.7 | 9.9 | 13.2 | 3.4 | 5.6 | 4.3 | 6.7 | 6.3 | 2.9 | 3.3 | 5.8 | 8.2 | |
| Focus + LATBackbone=Pythia-1B, LAT=true2025.06 | 8.3 | 27.1 | 59.7 | 14 | 14 | 3.6 | 5.9 | 3.8 | 7.3 | 5.9 | 3.5 | 3.6 | 5.2 | 12.4 | |
| TokAlignBackbone=Pythia-1B, LAT=false2025.06 | 120 | 220 | 100 | 360 | 120 | 46.5 | 60.1 | 70.8 | 150 | 49.2 | 61 | 110 | 50.9 | 120 | |
| TokAlignBackbone=Pythia-6.9B, LAT=false2025.06 | 120 | 190 | 81.4 | 370 | 130 | 52.5 | 53.3 | 66.2 | 140 | 49.2 | 46.4 | 92.1 | 51.2 | 110 | |
| ZeTTBackbone=Pythia-1B, LAT=false2025.06 | 300 | 420 | 130 | 1,200 | 240 | 300 | 240 | 330 | 250 | 200 | 240 | 180 | 470 | 340 | |
| FocusBackbone=Pythia-1B, LAT=false2025.06 | 4,100 | 170,000 | 1,800,000 | 21,000 | 960 | 65,000 | 1,000 | 5,600 | 1,600,000 | 840 | 50,000 | 190,000 | 190,000 | 310,000 | |
| FocusBackbone=Pythia-6.9B, LAT=false2025.06 | 6,900 | 160,000 | 1,200,000 | 24,000 | 1,300 | 25,000 | 720 | 3,300 | 1,900,000 | 790 | 17,000 | 150,000 | 120,000 | 280,000 |