Machine Translation on FLORES-200 en->xx
96.93XCOMET ScoreSAMAS
Evaluation results
| Method | Links | ||
|---|---|---|---|
| SAMASBase LLM=GPT-5, Routing Method=SAMAS (Dynamic)2026.02 | 96.93 | 91.72 | |
| SAMASBase LLM=Qwen3-235B-A22B, Routing Method=SAMAS (Dynamic)2026.02 | 96.78 | 92.97 | |
| TACTICRouting Method=Multi-Agent2026.02 | 96.19 | 92.64 | |
| SAMASBase LLM=Qwen3-235B-A22B, Routing Method=Hemingway-esque Style2026.02 | 95.86 | 89.17 | |
| GPT-5Base LLM=GPT-5, Routing Method=Single-LLM2026.02 | 95.46 | 90.83 | |
| SAMASBase LLM=GPT-5, Routing Method=Faulkner-esque Style2026.02 | 95.08 | 90.32 | |
| SAMASBase LLM=Qwen-mt-plu, Routing Method=SAMAS (Dynamic)2026.02 | 94.9 | 89.97 | |
| SAMASBase LLM=Qwen-mt-plu, Routing Method=Hemingway-esque Style2026.02 | 94.38 | 88.51 | |
| SAMASBase LLM=GPT-5, Routing Method=Hemingway-esque Style2026.02 | 94.37 | 89.32 | |
| SAMASBase LLM=Qwen3-30B-A3B, Routing Method=SAMAS (Dynamic)2026.02 | 93.48 | 88.72 | |
| SAMASBase LLM=Qwen-mt-plu, Routing Method=Faulkner-esque Style2026.02 | 93.11 | 88.69 | |
| SAMASBase LLM=Qwen3-30B-A3B, Routing Method=Faulkner-esque Style2026.02 | 92.19 | 88.64 | |
| SAMASBase LLM=Qwen3-30B-A3B, Routing Method=Hemingway-esque Style2026.02 | 91.56 | 88.22 | |
| GPT-4.1Base LLM=GPT-4.1, Routing Method=Single-LLM2026.02 | 91.45 | 86.14 | |
| SAMASBase LLM=Qwen3-235B-A22B, Routing Method=Faulkner-esque Style2026.02 | 91.33 | 86.68 | |
| Gemini-2.5-proBase LLM=Gemini-2.5-pro, Routing Method=Single-LLM2026.02 | 90.87 | 86.33 | |
| DeepSeek-R1Base LLM=DeepSeek-R1, Routing Method=Single-LLM2026.02 | 89.33 | 90.75 | |
| TransAgentsRouting Method=Multi-Agent2026.02 | 87.65 | 81.87 | |
| Qwen-mt-pluBase LLM=Qwen-mt-plu, Routing Method=Single-LLM2026.02 | 86.97 | 81.27 | |
| MAATSRouting Method=Multi-Agent2026.02 | 85.44 | 79.63 | |
| DeepSeek-V3Base LLM=DeepSeek-V3, Routing Method=Single-LLM2026.02 | 84.43 | 89.8 | |
| Qwen3-235B-A22BBase LLM=Qwen3-235B-A22B, Routing Method=Single-LLM2026.02 | 84.17 | 78.25 | |
| Qwen3-30B-A3BBase LLM=Qwen3-30B-A3B, Routing Method=Single-LLM2026.02 | 77.53 | 70.18 | |
| HiMATERouting Method=Multi-Agent2026.02 | 77.5 | 69.73 |