Sentence Simplification on SIMPEVAL 2022 (test)
37.6BLEUT5-11B
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| T5-11BDecoding method=MLE, beam size (b)=102022.12 | 37.6 | 46.4 | 93.8 | 62.9 | 49.3 | 88.8 | |
| T5-11BDecoding method=MBR-LENS, sample size (|S|)=1002022.12 | 36.2 | 46.1 | 93.8 | 74.4 | 44.6 | 90.13 | |
| GPT-4Prompting setting=0-shot2022.12 | 31.6 | 43.7 | 94.3 | 73.5 | 29.1 | 93.63 | |
| GPT-3.5Prompting setting=5-shot2022.12 | 30.5 | 42.4 | 94.1 | 69 | 33.2 | 92.7 | |
| GPT-3.5Prompting setting=0-shot2022.12 | 27.8 | 41.4 | 93.4 | 60.7 | 31.8 | 90.77 |