Classification on Amazon Economics 8-shot (test)
19.91Macro F1 ScoreSCIPATTON
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| SCIPATTONevaluation_protocol=8-shot, Backbone=SciBERT2023.05 | 19.91 | 25.68 | |
| PATTONevaluation_protocol=8-shot2023.05 | 19.32 | 25.12 | |
| w/o NMLMevaluation_protocol=8-shot2023.05 | 18.86 | 24.25 | |
| w/o MNPevaluation_protocol=8-shot2023.05 | 18.69 | 25.63 | |
| SimCSE.in-domainevaluation_protocol=8-shot2023.05 | 18.08 | 23.79 | |
| BERT.MLMevaluation_protocol=8-shot2023.05 | 16.6 | 22.71 | |
| SciBERT.MLMevaluation_protocol=8-shot2023.05 | 16.28 | 21.41 | |
| SPECTERevaluation_protocol=8-shot2023.05 | 16.16 | 19.84 | |
| SciBERTevaluation_protocol=8-shot2023.05 | 15.91 | 21.32 | |
| SimCSE (sup)evaluation_protocol=8-shot2023.05 | 15.03 | 18.64 | |
| SimCSE (unsup)evaluation_protocol=8-shot2023.05 | 14.54 | 19.07 | |
| BERTevaluation_protocol=8-shot2023.05 | 14.17 | 19.77 | |
| GraphFormersevaluation_protocol=8-shot2023.05 | 13.68 | 19 | |
| LinkBERTevaluation_protocol=8-shot2023.05 | 12.71 | 16.39 |