List your company

Contextual Machine Translation on anaphora benchmark

0.54BLEUgpt-4o
0.19680.28590.3750.4641Oct 20, 2025

Evaluation results

MethodLinks
gpt-4oreasoning=with2025.100.540.710.920.91
gpt-4reasoning=with2025.100.530.710.930.92
gpt-4reasoning=without2025.100.490.70.920.92
gpt-4oreasoning=without2025.100.490.70.920.91
gpt-4-turboreasoning=with2025.100.490.670.90.9
gpt-3.5-turboreasoning=with2025.100.490.680.910.9
Phi-4reasoning=with2025.100.490.680.920.91
Llama 3.3reasoning=with2025.100.470.670.910.9
gpt-4-turboreasoning=without2025.100.450.670.920.91
gpt-3.5-turboreasoning=without2025.100.440.660.910.91
Llama 3.3reasoning=without2025.100.440.660.920.9
Phi-4reasoning=without2025.100.430.640.910.88
DeepSeek-R1 32Breasoning=with2025.100.390.590.840.84
nllb-200reasoning=without2025.100.370.60.90.87
DeepSeek-R1 32Breasoning=without2025.100.350.590.890.87
Llama 3.1reasoning=without2025.100.340.580.890.86
DeepSeek-R1 14Breasoning=without2025.100.340.580.890.86
DeepSeek-R1 14Breasoning=with2025.100.330.530.790.79
Llama 3.1reasoning=with2025.100.30.540.870.85
Mistralreasoning=without2025.100.270.510.860.82
Mistralreasoning=with2025.100.270.50.850.8
Llama 3.2reasoning=without2025.100.270.510.870.82
DeepSeek-R1 8Breasoning=without2025.100.240.50.860.8
Llama 3.2reasoning=with2025.100.230.470.830.76
DeepSeek-R1 8Breasoning=with2025.100.210.450.770.77