List your company

Machine Translation on WMT22 Sah-Ru (test)

59.5COMET ScoreDUAL-REFLECT
57.4257.9658.559.04Jun 11, 2024Jul 2, 2024Jul 23, 2024Aug 13, 2024Sep 3, 2024Sep 24, 2024Oct 16, 2024

Evaluation results

MethodLinks
DUAL-REFLECTInference Methodology=DUAL-REFLECT2024.0659.537.9—
IBUTMode=Iterative Bilingual Understanding (IBUT)2024.1059.537.96.9
ChatGPTMode=Multi-Agent Prompt Selection (MAPS)2024.1058.737.36.7
ChatGPTMode=Reranking2024.1058.636.36.5
ChatGPT + 5-shotPrompting Strategy=Few-shot, Shots=52024.0658.336—
ChatGPTMode=5-shot prompting2024.1058.3366.4
ChatGPTMode=Iterative Refinement2024.1058.337.46.7
ChatGPTMode=Translation Error Analysis and Reduction (TEaR)2024.1058.337.26.7
ChatGPT + MADInference Methodology=MAD2024.0658.137.1—
ChatGPTMode=Multi-Agent Discussion (MAD)2024.1058.137.16.7
ChatGPTMode=Dual-Reflection2024.105837.16.5
ChatGPTPrompting Strategy=Zero-shot2024.0657.536—
ChatGPTMode=Zero-shot2024.1057.5365.9