Category Retrieval on Amazon Clothes (test)
68.62R@50PATTON
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| PATTONProtocol=16-shot2023.05 | 68.62 | 77.54 | |
| w/o NMLMProtocol=16-shot, Method variant=PATTON ablation2023.05 | 65.6 | 75.19 | |
| SimCSE.in-domainProtocol=16-shot, Domain=in-domain2023.05 | 61.42 | 72.25 | |
| w/o MNPProtocol=16-shot, Method variant=PATTON ablation2023.05 | 60.2 | 69.85 | |
| BERT.MLMProtocol=16-shot, Pre-training=MLM2023.05 | 52.41 | 63.72 | |
| SimCSE (unsup)Protocol=16-shot, Mode=unsupervised2023.05 | 44.9 | 54.76 | |
| SimCSE (sup)Protocol=16-shot, Mode=supervised2023.05 | 44.69 | 54.7 | |
| GraphFormersProtocol=16-shot2023.05 | 41.77 | 51.26 | |
| BERTProtocol=16-shot2023.05 | 40.77 | 50.4 | |
| LinkBERTProtocol=16-shot2023.05 | 28.66 | 37.79 | |
| BM25Protocol=16-shot2023.05 | 15.76 | 15.88 |