Text Classification on ACL-ARC (test)
72.41Macro F1TARTAN-MT
Evaluation results
| Method | Links | ||
|---|---|---|---|
| TARTAN-MTBackbone=RoBERTa-base2023.10 | 72.41 | 1.94 | |
| DAPTBackbone=RoBERTa-base2023.10 | 71.84 | 4.78 | |
| SAMABackbone=RoBERTa-base2023.10 | 71.63 | 1.68 | |
| SCIBERTEvaluation Protocol=Finetune2019.03 | 70.98 | — | |
| BaselineBackbone=RoBERTa-base2023.10 | 68.17 | 2.52 | |
| SOTA (Jurgens et al., 2018)2019.03 | 67.9 | — | |
| BiLSTM-Attn w/ ELMo + both scaffoldsEmbeddings=ELMo, Scaffold Type=both2019.04 | 67.9 | — | |
| BERT-BaseEvaluation Protocol=Finetune2019.03 | 63.91 | — | |
| BiLSTM-Attn + both scaffoldsEmbeddings=Standard, Scaffold Type=both2019.04 | 63.1 | — | |
| BERT-BaseEvaluation Protocol=Frozen2019.03 | 62.04 | — | |
| SCIBERTEvaluation Protocol=Frozen2019.03 | 60.74 | — | |
| BiLSTM-Attn + section title scaffoldEmbeddings=Standard, Scaffold Type=section title2019.04 | 56.9 | — | |
| BiLSTM-Attn + citation worthiness scaffoldEmbeddings=Standard, Scaffold Type=citation worthiness2019.04 | 56.3 | — | |
| Previous SOTA (Jurgens et al., 2018)Approach=Feature-based2019.04 | 54.6 | — | |
| BiLSTM-Attn w/ ELMoEmbeddings=ELMo, Scaffolds=None2019.04 | 54.3 | — | |
| BiLSTM-AttnEmbeddings=Standard, Scaffolds=None2019.04 | 51.8 | — |