Reranking on Geology
63.71NDCG@5SCIPATTON
Evaluation results
| Method | Links | ||
|---|---|---|---|
| SCIPATTONablation=w/o NMLM2023.05 | 63.71 | 74.75 | |
| SCIPATTON2023.05 | 63.48 | 75.86 | |
| SCIPATTONablation=w/o MNP2023.05 | 62.42 | 74.91 | |
| SciBERTtraining=MLM2023.05 | 62.01 | 74.58 | |
| PATTON2023.05 | 61.41 | 74.02 | |
| SimCSEtraining=in-domain2023.05 | 61.13 | 73.89 | |
| BERTtraining=MLM2023.05 | 60.58 | 72.52 | |
| LinkBERT2023.05 | 59.57 | 71.41 | |
| GraphFormers2023.05 | 58.32 | 69.91 | |
| SPECTER2023.05 | 57.79 | 69.57 | |
| SciBERT2023.05 | 57.04 | 69.47 | |
| BERT2023.05 | 56.59 | 68.21 | |
| SimCSEmode=unsupervised2023.05 | 49.6 | 61.51 | |
| SimCSEmode=supervised2023.05 | 48.07 | 59.79 |