Pre-training Evaluation on Aggregated Downstream Tasks (test)
63.7Average EMPre-trained_T5
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Pre-trained_T5Backbone=T5-Small2022.06 | 63.7 | 100 | |
| Wiki 10KBackbone=T5-Small2022.06 | 58.9 | 77 | |
| LIMEBackbone=T5-Small2022.06 | 55.4 | 67 | |
| SetBackbone=T5-Small2022.06 | 54.2 | 65 | |
| Nons_SummaryBackbone=T5-Small2022.06 | 51.8 | 47 | |
| DyckBackbone=T5-Small2022.06 | 50.2 | 49 | |
| IdentityBackbone=T5-Small2022.06 | 48.8 | 46 | |
| Random_InitBackbone=T5-Small2022.06 | 33.2 | 0 |