Machine Translation on WMT en→xx 24
87.6XCOMETSAMAS
Evaluation results
| Method | Links | ||
|---|---|---|---|
| SAMASBase LLM=GPT-5, Routing Method=SAMAS (Dynamic)2026.02 | 87.6 | 83.78 | |
| SAMASBase LLM=Qwen3-235B-A22B, Routing Method=SAMAS (Dynamic)2026.02 | 87.1 | 83.15 | |
| TACTICRouting Method=Multi-Agent2026.02 | 86.95 | 81.26 | |
| SAMASBase LLM=Qwen3-30B-A3B, Routing Method=SAMAS (Dynamic)2026.02 | 86.85 | 81.26 | |
| GPT-5Base LLM=GPT-5, Routing Method=Single-LLM2026.02 | 86.83 | 81.03 | |
| SAMASBase LLM=GPT-5, Routing Method=Hemingway-esque Style2026.02 | 86.17 | 81.28 | |
| DeepSeek-R1Base LLM=DeepSeek-R1, Routing Method=Single-LLM2026.02 | 86.1 | 80.45 | |
| DeepSeek-V3Base LLM=DeepSeek-V3, Routing Method=Single-LLM2026.02 | 84.71 | 79.61 | |
| SAMASBase LLM=GPT-5, Routing Method=Faulkner-esque Style2026.02 | 84.2 | 82.48 | |
| SAMASBase LLM=Qwen-mt-plu, Routing Method=SAMAS (Dynamic)2026.02 | 83.47 | 78.65 | |
| SAMASBase LLM=Qwen3-235B-A22B, Routing Method=Hemingway-esque Style2026.02 | 82.97 | 78.06 | |
| SAMASBase LLM=Qwen-mt-plu, Routing Method=Hemingway-esque Style2026.02 | 82.95 | 78.34 | |
| SAMASBase LLM=Qwen3-30B-A3B, Routing Method=Faulkner-esque Style2026.02 | 82.71 | 78.08 | |
| SAMASBase LLM=Qwen-mt-plu, Routing Method=Faulkner-esque Style2026.02 | 82.69 | 77.83 | |
| SAMASBase LLM=Qwen3-30B-A3B, Routing Method=Hemingway-esque Style2026.02 | 81.68 | 77.38 | |
| GPT-4.1Base LLM=GPT-4.1, Routing Method=Single-LLM2026.02 | 81.23 | 75.81 | |
| SAMASBase LLM=Qwen3-235B-A22B, Routing Method=Faulkner-esque Style2026.02 | 81.12 | 76.25 | |
| Gemini-2.5-proBase LLM=Gemini-2.5-pro, Routing Method=Single-LLM2026.02 | 79.92 | 75.42 | |
| TransAgentsRouting Method=Multi-Agent2026.02 | 76.61 | 71.22 | |
| Qwen-mt-pluBase LLM=Qwen-mt-plu, Routing Method=Single-LLM2026.02 | 76.21 | 70.87 | |
| MAATSRouting Method=Multi-Agent2026.02 | 75.03 | 69.62 | |
| Qwen3-235B-A22BBase LLM=Qwen3-235B-A22B, Routing Method=Single-LLM2026.02 | 73.97 | 68.57 | |
| Qwen3-30B-A3BBase LLM=Qwen3-30B-A3B, Routing Method=Single-LLM2026.02 | 66.97 | 59.97 | |
| HiMATERouting Method=Multi-Agent2026.02 | 65.25 | 69.03 |