List your company
ResearchFormerly WizWand

Classification on Amazon Geology 8-shot (test)

39.65Macro F1 ScoreSCIPATTON
21.262826.036430.8135.5836May 20, 2023
Updated 8mo ago

Evaluation results

MethodLinks
SCIPATTONevaluation_protocol=8-shot, Backbone=SciBERT2023.0539.6548.93
PATTONevaluation_protocol=8-shot2023.0539.3548.19
SimCSE.in-domainevaluation_protocol=8-shot2023.0538.9148.93
SimCSE (unsup)evaluation_protocol=8-shot2023.0538.7838.55
w/o NMLMevaluation_protocol=8-shot2023.0538.7848.48
w/o MNPevaluation_protocol=8-shot2023.053847.82
SciBERT.MLMevaluation_protocol=8-shot2023.0536.9446.54
BERT.MLMevaluation_protocol=8-shot2023.0536.3148.04
SPECTERevaluation_protocol=8-shot2023.0530.438.54
SciBERTevaluation_protocol=8-shot2023.0529.4937.82
SimCSE (sup)evaluation_protocol=8-shot2023.0525.6633.89
LinkBERTevaluation_protocol=8-shot2023.0524.0831.32
GraphFormersevaluation_protocol=8-shot2023.0522.6431.02
BERTevaluation_protocol=8-shot2023.0521.9729.63