Unscramble on Unscramble (IV)
99.46Accuracy (Seq Level)Char-S
Evaluation results
| Method | Links | |
|---|---|---|
| Char-SModel=T5 with character-level source sequences2022.12 | 99.46 | |
| ByT5Model=ByT5 character model2022.12 | 99.19 | |
| Subword + IITBase Model=T5 subword model, Intervention=Joint training with character-level interventions2022.12 | 98.97 | |
| SubwordModel=T5 subword model2022.12 | 97.8 | |
| Char-STModel=T5 with character-level source and target sequences2022.12 | 97.68 | |
| Char-T + IITBase Model=T5 with character-level target sequences, Intervention=Joint training with character-level interventions2022.12 | 96.17 | |
| Char-TModel=T5 with character-level target sequences2022.12 | 92.29 | |
| GPT-3Engine=davinci-0032022.12 | 50.8 | |
| GPT-3-CEngine=davinci-003, Formatting=hyphen or space separated characters2022.12 | 16.2 |