Reranking on Mathematics
47.1NDCG@5SCIPATTON
Evaluation results
| Method | Links | ||
|---|---|---|---|
| SCIPATTON2023.05 | 47.1 | 60.86 | |
| SCIPATTONablation=w/o NMLM2023.05 | 46.05 | 59.39 | |
| SCIPATTONablation=w/o MNP2023.05 | 43.56 | 57.14 | |
| PATTON2023.05 | 42.08 | 55.3 | |
| SciBERT2023.05 | 40.73 | 53.22 | |
| SimCSEtraining=in-domain2023.05 | 40.37 | 53.8 | |
| BERTtraining=MLM2023.05 | 39.24 | 51.18 | |
| SciBERTtraining=MLM2023.05 | 39.03 | 52.34 | |
| SPECTER2023.05 | 38.95 | 52.17 | |
| LinkBERT2023.05 | 38.5 | 50.74 | |
| GraphFormers2023.05 | 37.85 | 47.89 | |
| BERT2023.05 | 37.15 | 44.76 | |
| SimCSEmode=supervised2023.05 | 34.85 | 44.76 | |
| SimCSEmode=unsupervised2023.05 | 32.34 | 42.59 |