List your company
ResearchFormerly WizWand

Category Retrieval on Amazon Economics (test)

35.82Recall@50SCIPATTON
18.472822.976427.4831.9836May 20, 2023
Updated 8mo ago

Evaluation results

MethodLinks
SCIPATTONProtocol=16-shot, Backbone=SciBERT2023.0535.8246.05
w/o NMLMProtocol=16-shot, Method variant=PATTON ablation2023.0535.1746.07
PATTONProtocol=16-shot2023.0532.142.19
SPECTERProtocol=16-shot2023.0531.2640.79
SciBERTProtocol=16-shot, Backbone=SciBERT2023.0529.838.66
w/o MNPProtocol=16-shot, Method variant=PATTON ablation2023.0529.5439.57
SciBERT.MLMProtocol=16-shot, Backbone=SciBERT, Pre-training=MLM2023.0529.2339.18
SimCSE.in-domainProtocol=16-shot, Domain=in-domain2023.0528.4437.81
SimCSE (sup)Protocol=16-shot, Mode=supervised2023.0528.0736.51
BERT.MLMProtocol=16-shot, Pre-training=MLM2023.0527.1336
SimCSE (unsup)Protocol=16-shot, Mode=unsupervised2023.0525.8333.42
GraphFormersProtocol=16-shot2023.0524.4832.16
BERTProtocol=16-shot2023.0523.9531.54
LinkBERTProtocol=16-shot2023.0522.6930.77
BM25Protocol=16-shot2023.0519.1422.49