Classification on Amazon Geology 8-shot (test)
39.65Macro F1 ScoreSCIPATTON
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| SCIPATTONevaluation_protocol=8-shot, Backbone=SciBERT2023.05 | 39.65 | 48.93 | |
| PATTONevaluation_protocol=8-shot2023.05 | 39.35 | 48.19 | |
| SimCSE.in-domainevaluation_protocol=8-shot2023.05 | 38.91 | 48.93 | |
| SimCSE (unsup)evaluation_protocol=8-shot2023.05 | 38.78 | 38.55 | |
| w/o NMLMevaluation_protocol=8-shot2023.05 | 38.78 | 48.48 | |
| w/o MNPevaluation_protocol=8-shot2023.05 | 38 | 47.82 | |
| SciBERT.MLMevaluation_protocol=8-shot2023.05 | 36.94 | 46.54 | |
| BERT.MLMevaluation_protocol=8-shot2023.05 | 36.31 | 48.04 | |
| SPECTERevaluation_protocol=8-shot2023.05 | 30.4 | 38.54 | |
| SciBERTevaluation_protocol=8-shot2023.05 | 29.49 | 37.82 | |
| SimCSE (sup)evaluation_protocol=8-shot2023.05 | 25.66 | 33.89 | |
| LinkBERTevaluation_protocol=8-shot2023.05 | 24.08 | 31.32 | |
| GraphFormersevaluation_protocol=8-shot2023.05 | 22.64 | 31.02 | |
| BERTevaluation_protocol=8-shot2023.05 | 21.97 | 29.63 |