Literature Retrieval on PaSaMaster-Bench 1.0 (test)
37.93NDCG@20PaSaMaster
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| PaSaMasterCost ($)=0.052026.05 | 37.93 | 31.84 | 22.19 | 21.69 | 0 | |
| Kimi-K2.5Cost ($)=0.162026.05 | 37.8 | 28.08 | 16.95 | 17.36 | 35.67 | |
| GLM-5Cost ($)=0.562026.05 | 35.89 | 28.99 | 16.93 | 18.18 | 29.07 | |
| DeepSeek-v3.2Cost ($)=0.282026.05 | 35.82 | 24.76 | 15.35 | 15.56 | 20.57 | |
| GPT-5.2Cost ($)=6.062026.05 | 31.59 | 25.32 | 16.82 | 16.69 | 11.8 | |
| Gemini-3.1-proCost ($)=0.382026.05 | 31.34 | 21.3 | 11.68 | 12.48 | 32.41 | |
| MiniMax-M2.7Cost ($)=0.182026.05 | 30.7 | 24.23 | 14.42 | 15.11 | 37.79 | |
| Google Scholar Labs2026.05 | 30.54 | 29.01 | 18.79 | 18.87 | 0 | |
| Bohrium Science Navigator2026.05 | 22.39 | 19.37 | 12.5 | 12.26 | 0 | |
| OpenScholar2026.05 | 14.61 | 11.68 | 8.52 | 7.92 | 0 | |
| Google Scholar2026.05 | 2.07 | 1.69 | 1.48 | 1.39 | 0 |