Scientific Document Retrieval on DORIS-MAE (test)
13.08M@10CCQGen
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| CCQGenBackbone=Contriever-MS, Fine-tuned=true, Base query generation=Pair-wise generation2026.01 | 13.08 | — | — | 15.77 | 50.89 | 63.31 | 27.83 | 29.43 | |
| CCQGenBackbone=Contriever-MS, Fine-tuned=true, Base query generation=Promptgator2026.01 | 12.67 | — | — | 15.36 | 49.83 | 63.27 | 26.97 | 28.83 | |
| CCExpandBackbone=Contriever-MS2026.01 | 12.66 | 27.3 | 28.71 | 15.3 | 48.02 | 61.55 | — | — | |
| CCExpand--Backbone=Contriever-MS2026.01 | 12.53 | 27.12 | 28.1 | 15.03 | 47.55 | 61.14 | — | — | |
| CCQGenBackbone=SPECTER-v2, Fine-tuned=true, Base query generation=Pair-wise generation2026.01 | 12.47 | — | — | 15.46 | 50.64 | 63.04 | 26.81 | 29.32 | |
| CCQGenBackbone=SPECTER-v2, Fine-tuned=true, Base query generation=Promptgator2026.01 | 12.26 | — | — | 15.2 | 49.88 | 62.65 | 26.34 | 28.91 | |
| RetrieverBackbone=Contriever-MS2026.01 | 11.77 | 26.03 | 27.07 | 14.22 | 45.09 | 58.77 | — | — | |
| no Fine-TuneBackbone=Contriever-MS, Fine-tuned=false2026.01 | 11.77 | — | — | 14.22 | 45.09 | 58.77 | 26.03 | 27.07 | |
| Pair-wise generationBackbone=Contriever-MS, Fine-tuned=true2026.01 | 11.77 | — | — | 14.45 | 48.09 | 59.47 | 25.41 | 27.53 | |
| Pair-wise generationBackbone=SPECTER-v2, Fine-tuned=true2026.01 | 11.63 | — | — | 14.42 | 48.85 | 61.48 | 25.23 | 27.82 | |
| PromptgatorBackbone=Contriever-MS, Fine-tuned=true2026.01 | 11.61 | — | — | 14.18 | 47.18 | 59.61 | 25.26 | 27.24 | |
| GenQBackbone=Contriever-MS, Fine-tuned=true2026.01 | 11.52 | — | — | 13.96 | 45.98 | 58.05 | 24.96 | 26.47 | |
| Promptgator_diverseBackbone=Contriever-MS, Fine-tuned=true2026.01 | 11.43 | — | — | 14.06 | 46.45 | 59.51 | 24.61 | 26.9 | |
| GRFBackbone=Contriever-MS2026.01 | 11.34 | 25.38 | 27.12 | 13.93 | 46.02 | 59.5 | — | — | |
| PromptgatorBackbone=SPECTER-v2, Fine-tuned=true2026.01 | 11.31 | — | — | 13.98 | 48.51 | 60.64 | 24.79 | 27.13 | |
| Promptgator_diverseBackbone=SPECTER-v2, Fine-tuned=true2026.01 | 11.21 | — | — | 14.01 | 48.43 | 61.02 | 24.69 | 27.33 | |
| Doc exp. (Ours)Backbone=Contriever-MS2026.01 | 11.2 | 24.83 | 26.62 | 13.78 | 45.69 | 59.63 | — | — | |
| CCExpandBackbone=SPECTER-v22026.01 | 10.65 | 23.62 | 25.17 | 12.85 | 44.4 | 57.44 | — | — | |
| Doc exp. (BestQGen)Backbone=Contriever-MS2026.01 | 10.59 | 24.03 | 25.05 | 12.77 | 42.8 | 55.54 | — | — | |
| GenQBackbone=SPECTER-v2, Fine-tuned=true2026.01 | 10.45 | — | — | 12.87 | 44.12 | 56.13 | 23.38 | 25.25 | |
| CCExpand--Backbone=SPECTER-v22026.01 | 9.93 | 22.5 | 24.35 | 12.21 | 44.02 | 56.74 | — | — | |
| RetrieverBackbone=SPECTER-v22026.01 | 9.42 | 21.21 | 22.83 | 11.47 | 41.82 | 54.41 | — | — | |
| no Fine-TuneBackbone=SPECTER-v2, Fine-tuned=false2026.01 | 9.42 | — | — | 11.47 | 41.82 | 54.41 | 21.21 | 22.83 | |
| GRFBackbone=SPECTER-v22026.01 | 9.03 | 20.29 | 22.65 | 11.22 | 43.94 | 56.89 | — | — | |
| Doc exp. (Ours)Backbone=SPECTER-v22026.01 | 8.77 | 20.52 | 22.27 | 10.9 | 40.63 | 53.3 | — | — | |
| Doc exp. (BestQGen)Backbone=SPECTER-v22026.01 | 8.31 | 20.16 | 21.46 | 10.18 | 40.49 | 54.02 | — | — |