Classification on Amazon Mathematics 8-shot (test)
27.58Macro F1PATTON
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| PATTONevaluation_protocol=8-shot2023.05 | 27.58 | 32.82 | |
| SCIPATTONevaluation_protocol=8-shot, Backbone=SciBERT2023.05 | 27.35 | 31.7 | |
| w/o NMLMevaluation_protocol=8-shot2023.05 | 25.91 | 27.79 | |
| SimCSE.in-domainevaluation_protocol=8-shot2023.05 | 25.15 | 29.85 | |
| w/o MNPevaluation_protocol=8-shot2023.05 | 24.79 | 29.44 | |
| SciBERTevaluation_protocol=8-shot2023.05 | 23.5 | 23.1 | |
| BERT.MLMevaluation_protocol=8-shot2023.05 | 23.44 | 31.75 | |
| SPECTERevaluation_protocol=8-shot2023.05 | 23.37 | 29.83 | |
| SciBERT.MLMevaluation_protocol=8-shot2023.05 | 23.34 | 30.11 | |
| SimCSE (sup)evaluation_protocol=8-shot2023.05 | 20.39 | 25.56 | |
| SimCSE (unsup)evaluation_protocol=8-shot2023.05 | 20.12 | 26.11 | |
| GraphFormersevaluation_protocol=8-shot2023.05 | 18.69 | 23.24 | |
| BERTevaluation_protocol=8-shot2023.05 | 18.14 | 22.04 | |
| LinkBERTevaluation_protocol=8-shot2023.05 | 15.78 | 19.75 |