Machine Translation on Ostraca
20.02BLEUClaude Opus
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Claude Opus2026.04 | 20.02 | — | 46 | |
| GPT-4.1Setting=DEP2026.04 | 18.15 | 88.59 | 38 | |
| GPT-4.1Setting=LEX+SYN2026.04 | 17.99 | 90.46 | 53 | |
| GemmaModel Size=27b, Setting=LEX+SYN2026.04 | 16.19 | 87.81 | 34 | |
| Claude Haiku2026.04 | 11.52 | — | 35 | |
| CopticTrans2026.04 | 8.43 | — | 30 | |
| GemmaModel Size=12b, Setting=LEX+SYN2026.04 | 7.82 | 88.5 | 32 |