Machine Translation on ZHUANGRULES Zhuang → Chinese
57.2BLEUREFTOOL
Evaluation results
| Method | Links | ||
|---|---|---|---|
| REFTOOLModel=Qwen-2.5-72B2025.05 | 57.2 | 54.1 | |
| Rule-by-Rule Retrieval w. CodeModel=Qwen-2.5-72B2025.05 | 56.9 | 55.7 | |
| REFTOOLModel=Llama-3.1-70B2025.05 | 52.2 | 49.6 | |
| Rule-by-Rule RetrievalModel=Qwen-2.5-72B2025.05 | 47.4 | 46.8 | |
| Retrieval from Whole BookModel=Qwen-2.5-72B2025.05 | 45.3 | 43.1 | |
| Whole Grammar BookModel=Qwen-2.5-72B2025.05 | 43.7 | 42.6 | |
| Rule-by-Rule RetrievalModel=Llama-3.1-70B2025.05 | 42.6 | 43 | |
| Rule-by-Rule Retrieval w. CodeModel=Llama-3.1-70B2025.05 | 36.4 | 45.1 | |
| Retrieval from Whole BookModel=Llama-3.1-70B2025.05 | 33.6 | 35.3 | |
| Whole Grammar BookModel=Llama-3.1-70B2025.05 | 32.6 | 35.2 |