Machine Translation on ZHUANGRULES Chinese → Zhuang
54.2BLEUREFTOOL
Evaluation results
| Method | Links | ||
|---|---|---|---|
| REFTOOLModel=Llama-3.1-70B2025.05 | 54.2 | 71.6 | |
| REFTOOLModel=Qwen-2.5-72B2025.05 | 52.5 | 71.1 | |
| Rule-by-Rule Retrieval w. CodeModel=Qwen-2.5-72B2025.05 | 47 | 74.3 | |
| Rule-by-Rule RetrievalModel=Qwen-2.5-72B2025.05 | 40.6 | 69.9 | |
| Retrieval from Whole BookModel=Qwen-2.5-72B2025.05 | 39.2 | 66.5 | |
| Rule-by-Rule RetrievalModel=Llama-3.1-70B2025.05 | 36.1 | 66.4 | |
| Rule-by-Rule Retrieval w. CodeModel=Llama-3.1-70B2025.05 | 35.3 | 64.8 | |
| Whole Grammar BookModel=Qwen-2.5-72B2025.05 | 34.9 | 64.2 | |
| Whole Grammar BookModel=Llama-3.1-70B2025.05 | 28 | 60.8 | |
| Retrieval from Whole BookModel=Llama-3.1-70B2025.05 | 26 | 54.2 |