Text Classification on HumLLM D4 (test)
89.2Macro-F1SURGELLM-IWN-RoBERTa
Evaluation results
| Method | Links | |
|---|---|---|
| SURGELLM-IWN-RoBERTaFamily=IWN, Parameters=125M, Training Time (s)=3322026.06 | 89.2 | |
| SURGELLM-IWN-BERTFamily=IWN, Parameters=110M, Training Time (s)=3222026.06 | 86.6 | |
| Baseline-RoBERTaFamily=Baseline, Parameters=125M, Training Time (s)=2332026.06 | 76.2 | |
| Baseline-BERTFamily=Baseline, Parameters=110M, Training Time (s)=2272026.06 | 76 | |
| SURGELLM-G-RoBERTaFamily=SURGELLM-G, Parameters=125M, Training Time (s)=327, Early Stopping=true2026.06 | 76 | |
| Baseline-DistilBERTFamily=Baseline, Parameters=66M, Training Time (s)=822026.06 | 74.9 | |
| T5-baseFamily=T5-T2T, Parameters=220M, Training Time (s)=4122026.06 | 74.8 | |
| SURGELLM-S-BERTFamily=SURGELLM-S, Parameters=110M, Training Time (s)=3172026.06 | 74.8 | |
| SURGELLM-FULL-RoBERTaFamily=SURGELLM-FULL, Parameters=125M, Training Time (s)=326, Early Stopping=true2026.06 | 71.1 | |
| SURGELLM-FULL-ALBERTFamily=SURGELLM-FULL, Parameters=11M, Training Time (s)=3172026.06 | 70.8 | |
| SURGELLM-S-DistilBERTFamily=SURGELLM-S, Parameters=66M, Training Time (s)=1192026.06 | 68.1 |