Sentence Permutation on DiscoEval
73.4AccuracySLM
Evaluation results
| Method | Links | |
|---|---|---|
| SLMTraining Steps=3M2024.05 | 73.4 | |
| SLMTraining Steps=1M2024.05 | 72.4 | |
| DEPTHMode=Continued Pre-training (CPT)2024.05 | 65.59 | |
| CONPONO2024.05 | 60.7 | |
| T5Mode=Continued Pre-training (CPT)2024.05 | 59.48 | |
| T5-Base2024.05 | 58.1 | |
| DEPTHMode=From Scratch (FS)2024.05 | 55.45 | |
| BERT-Large2024.05 | 53.8 | |
| BERT-Base2024.05 | 53.1 | |
| T5Mode=From Scratch (FS)2024.05 | 40.91 | |
| RoBERTa-Base2024.05 | 38.7 |