MT
Benchmarks
TaskDatasetSOTA resultTrendResults
MT
49.5Mean PRR
109
MT
72.7ROC-AUC
64
MT en -> fr
39.01BLEU
14
MT en -> de
29.41BLEU
14
MT (test)
58.24Average Win Rate
12
MT
11.7Latency (ms)
9
MT2 org
10.6MRR
9
MT
0.183L2M Score
8
MT (test)
8.96MSimG Score
8
MT Small
1.12Recall@10
6
MT Large
0.97Recall@10
6
MT standard
88.4Accuracy
6
MT-Other Cities High-Freq
0.534Recall@5
5
MT Qwen2-7B-Instruct v1 (test)
2.2Acceptance Length (τ)
4
MT2 sci
25.8MRR
4
MT
12.07FID
4
MT (test)
93.79mAP
3
MT
188.69Throughput (tokens/s)
3
MT50 rand
11,000Throughput
1
MT
11.2Performance Loss
1