Multilingual NLP on Multilingual Benchmark Average across languages (test)
89.15Average ScoreXLM-R-Large
Evaluation results
| Method | Links | |
|---|---|---|
| XLM-R-LargeLatency (ms, BS=1)=11.04, Peak TP (s/s)=369.3, Peak Speedup=1.0×, Opt. J/sample=0.826, J/sample Impr. (x)=1.0×2025.12 | 89.15 | |
| XLM-R-BaseLatency (ms, BS=1)=5.68, Peak TP (s/s)=1168.5, Peak Speedup=3.2×, Opt. J/sample=0.2532, J/sample Impr. (x)=3.3×2025.12 | 87.86 | |
| TiME-mLatency (ms, BS=1)=2.85, Peak TP (s/s)=1977.2, Peak Speedup=5.4×, Opt. J/sample=0.1249, J/sample Impr. (x)=6.6×2025.12 | 87.71 | |
| TiME-sLatency (ms, BS=1)=2.86, Peak TP (s/s)=5871, Peak Speedup=15.9×, Opt. J/sample=0.0443, J/sample Impr. (x)=18.7×2025.12 | 85.16 | |
| HPLTLatency (ms, BS=1)=11.35, Peak TP (s/s)=606.7, Peak Speedup=1.6×, Opt. J/sample=0.6122, J/sample Impr. (x)=1.3×2025.12 | 84.27 | |
| *-hplt-mLatency (ms, BS=1)=2.9, Peak TP (s/s)=1515.6, Peak Speedup=4.1×, Opt. J/sample=0.1854, J/sample Impr. (x)=4.5×2025.12 | 84.22 | |
| TiME-xsLatency (ms, BS=1)=1.89, Peak TP (s/s)=9321.1, Peak Speedup=25.2×, Opt. J/sample=0.0274, J/sample Impr. (x)=30.2×2025.12 | 83.92 | |
| mMiniLM-L6-H384Latency (ms, BS=1)=3.12, Peak TP (s/s)=6229.4, Peak Speedup=16.9×, Opt. J/sample=0.0425, J/sample Impr. (x)=19.4×2025.12 | 83.46 |