Code Translation on Cangjie-bench
76.36ACCILA-agent
Evaluation results
| Method | Links | ||
|---|---|---|---|
| ILA-agentModels=Claude-Sonnet-4.52026.01 | 76.36 | 83.64 | |
| ILA-agentModels=Qwen3-Max2026.01 | 72.12 | 80 | |
| ILA-agentModels=DeepSeek-V3.22026.01 | 64.24 | 77.58 | |
| Cangjie TranslatorModels=Specialized2026.01 | 61.21 | 85.45 | |
| Iterative RAGModels=Claude-Sonnet-4.52026.01 | 57.58 | 63.03 | |
| Iterative RAGModels=DeepSeek-V3.22026.01 | 41.21 | 50.91 | |
| Iterative RAGModels=Qwen3-Max2026.01 | 40.61 | 43.64 | |
| Single-time RAGModels=Claude-Sonnet-4.52026.01 | 36.36 | 40 | |
| Zero-shotModels=Claude-Sonnet-4.52026.01 | 33.94 | 38.18 | |
| Single-time RAGModels=DeepSeek-V3.22026.01 | 29.09 | 30.91 | |
| Single-time RAGModels=Qwen3-Max2026.01 | 23.03 | 24.85 | |
| Zero-shotModels=DeepSeek-V3.22026.01 | 0 | 0 | |
| Zero-shotModels=Qwen3-Max2026.01 | 0 | 0 |