Unscramble on Unscramble OOV
74.71Sequence AccuracyByT5
Evaluation results
| Method | Links | |
|---|---|---|
| ByT5Model=ByT5 character model2022.12 | 74.71 | |
| Char-SModel=T5 with character-level source sequences2022.12 | 72.96 | |
| Subword + IITBase Model=T5 subword model, Intervention=Joint training with character-level interventions2022.12 | 72.63 | |
| Char-STModel=T5 with character-level source and target sequences2022.12 | 71.21 | |
| Char-T + IITBase Model=T5 with character-level target sequences, Intervention=Joint training with character-level interventions2022.12 | 69.98 | |
| GPT-3Engine=davinci-0032022.12 | 38.2 | |
| GPT-3-CEngine=davinci-003, Formatting=hyphen or space separated characters2022.12 | 14 | |
| Char-TModel=T5 with character-level target sequences2022.12 | 3.67 | |
| SubwordModel=T5 subword model2022.12 | 2.91 |