Category Retrieval on Amazon Sports (test)
58.63Recall@50PATTON
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| PATTONProtocol=16-shot2023.05 | 58.63 | 68.53 | |
| w/o NMLMProtocol=16-shot, Method variant=PATTON ablation2023.05 | 57.05 | 67.22 | |
| BERT.MLMProtocol=16-shot, Pre-training=MLM2023.05 | 54.1 | 63.14 | |
| SimCSE.in-domainProtocol=16-shot, Domain=in-domain2023.05 | 53.77 | 63.73 | |
| w/o MNPProtocol=16-shot, Method variant=PATTON ablation2023.05 | 51.73 | 60.35 | |
| SimCSE (sup)Protocol=16-shot, Mode=supervised2023.05 | 40.31 | 50.55 | |
| SimCSE (unsup)Protocol=16-shot, Mode=unsupervised2023.05 | 38.81 | 49.3 | |
| GraphFormersProtocol=16-shot2023.05 | 32.39 | 43.29 | |
| BERTProtocol=16-shot2023.05 | 32.37 | 43.32 | |
| LinkBERTProtocol=16-shot2023.05 | 31.97 | 41.77 | |
| BM25Protocol=16-shot2023.05 | 22 | 23.96 |