Automatic Text Diacritization on WikiNews (test)
0.326DERGPT-4
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| GPT-4Case Ending (CE)=false2024.07 | 0.326 | 1.024 | |
| GPT-4Case Ending (CE)=true2024.07 | 0.551 | 2.276 | |
| EO (Ours)Case Ending (CE)=false2024.07 | 3.105 | 12.679 | |
| ED (Ours)Case Ending (CE)=false2024.07 | 3.631 | 11.31 | |
| EO (Ours)Case Ending (CE)=true2024.07 | 5.425 | 22.132 | |
| CBHGCase Ending (CE)=false2024.07 | 5.448 | 21.528 | |
| SakhrCase Ending (CE)=false2024.07 | 5.628 | 29.921 | |
| ED (Ours)Case Ending (CE)=true2024.07 | 5.963 | 20.06 | |
| D2Case Ending (CE)=false2024.07 | 6.164 | 21.744 | |
| ShakkalaCase Ending (CE)=false2024.07 | 6.593 | 24.988 | |
| SakhrCase Ending (CE)=true2024.07 | 7.843 | 38.413 | |
| CBHGCase Ending (CE)=true2024.07 | 8.276 | 36.032 | |
| MishkalCase Ending (CE)=false2024.07 | 8.558 | 27.337 | |
| D2Case Ending (CE)=true2024.07 | 9.231 | 32.622 | |
| MultilevelCase Ending (CE)=false2024.07 | 9.318 | 36.217 | |
| ShakkalaCase Ending (CE)=true2024.07 | 9.978 | 37.241 | |
| AlkhalilCase Ending (CE)=false2024.07 | 12.145 | 35.699 | |
| MultilevelCase Ending (CE)=true2024.07 | 12.431 | 45.054 | |
| AlkhalilCase Ending (CE)=true2024.07 | 14.912 | 46.793 | |
| MishkalCase Ending (CE)=true2024.07 | 15.246 | 54.187 | |
| FarasaCase Ending (CE)=false2024.07 | 17.752 | 66.601 | |
| Command R+Case Ending (CE)=false2024.07 | 17.755 | 49.611 | |
| FarasaCase Ending (CE)=true2024.07 | 19.584 | 69.536 | |
| Command R+Case Ending (CE)=true2024.07 | 21.47 | 54.335 | |
| D3Case Ending (CE)=false2024.07 | 48.234 | 99.408 | |
| D3Case Ending (CE)=true2024.07 | 58.558 | 109.028 |