Text Classification on EDOS (test)
82.35Macro F1 ScoreDeBERTa-v3-base
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| DeBERTa-v3-baseType=SOTA, Training=Full fine-tuning2023.11 | 82.35 | — | — | |
| SPINBackbone=Flan-T5-XL, Variant=SPIN2023.11 | 81.48 | 16.27 | — | |
| SPINBackbone=Flan-T5, Variant=SPIN2023.11 | 78.04 | 17.11 | — | |
| SPINBackbone=GPT2-XL, Variant=SPIN2023.11 | 76.79 | 5.83 | — | |
| SPINBackbone=GPT2, Variant=SPIN2023.11 | 76.08 | 10.95 | — | |
| SPINBackbone=DistilBERT, Variant=SPIN2023.11 | 75.79 | 16.44 | — | |
| SPINBackbone=GPT2-M, Variant=SPIN2023.11 | 75.74 | 6.42 | — | |
| SPINBackbone=Flan-T5-S, Variant=SPIN2023.11 | 74.51 | 24.97 | — | |
| SPINBackbone=RoBERTa, Variant=SPIN2023.11 | 73.5 | 6.82 | — | |
| GPT2-XLBackbone=GPT2-XL, Variant=Base2023.11 | 72.56 | — | — | |
| GPT2-MBackbone=GPT2-M, Variant=Base2023.11 | 71.17 | — | — | |
| Flan-T5-XLBackbone=Flan-T5-XL, Variant=Base2023.11 | 70.08 | — | — | |
| RoBERTaBackbone=RoBERTa, Variant=Base2023.11 | 68.81 | — | — | |
| GPT2Backbone=GPT2, Variant=Base2023.11 | 68.57 | — | — | |
| Flan-T5Backbone=Flan-T5, Variant=Base2023.11 | 66.64 | — | — | |
| DistilBERTBackbone=DistilBERT, Variant=Base2023.11 | 65.09 | — | — | |
| Flan-T5-SBackbone=Flan-T5-S, Variant=Base2023.11 | 59.62 | — | — | |
| DistilBERTEvaluation Variant=Base2023.11 | — | — | 78.74 | |
| RoBERTaEvaluation Variant=Base2023.11 | — | — | 80.48 | |
| SPINBackbone=DistilBERT2023.11 | — | — | 81.12 | |
| SPINBackbone=RoBERTa2023.11 | — | — | 80.88 |