Scientific Question Answering on SciRAG-SSLI easy 1.0 (test)
46.55F1 ScoreRankGPT
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| RankGPTSetting=LMQG2026.01 | 46.55 | 36.21 | 58.64 | 3.82 | |
| BCESetting=LMQG2026.01 | 46.49 | 34.58 | 63.82 | 4.01 | |
| JinaSetting=LMQG2026.01 | 46.02 | 36.44 | 61.36 | 3.99 | |
| DeepEraSetting=LMQG2026.01 | 46 | 34.15 | 64.35 | 4.09 | |
| BGESetting=LMQG2026.01 | 45.85 | 35.53 | 62.49 | 4.03 | |
| MXBAISetting=LMQG2026.01 | 45.64 | 34.46 | 62.7 | 4.08 | |
| SPLADESetting=LMQG2026.01 | 45.48 | 35.04 | 60.68 | 3.93 | |
| In-RankerSetting=LMQG2026.01 | 45.4 | 33.74 | 61.9 | 3.98 | |
| TwoLARSetting=LMQG2026.01 | 45.36 | 34.1 | 62.68 | 4.04 | |
| ColBERTSetting=LMQG2026.01 | 45.35 | 34.73 | 61.95 | 4.02 | |
| MiniLMSetting=LMQG2026.01 | 44.88 | 33.65 | 61.15 | 3.99 | |
| RankT5Setting=LMQG2026.01 | 44.81 | 33.58 | 60.87 | 3.99 | |
| LLM2VecSetting=LMQG2026.01 | 44.39 | 32.46 | 62.04 | 4.01 | |
| ZephyrRerankerSetting=LMQG2026.01 | 38.97 | 36.73 | 61.03 | 4 | |
| VicunaRerankerSetting=LMQG2026.01 | 38.74 | 35.56 | 60.73 | 4.03 | |
| MonoT5Setting=LMQG2026.01 | 38.56 | 35.97 | 60.43 | 3.92 | |
| DeARrerankSetting=LMQG2026.01 | 37.85 | 35.05 | 61.01 | 3.96 | |
| limrankSetting=LMQG2026.01 | 33.19 | 30.94 | 55.06 | 3.86 | |
| ListT5Setting=LMQG2026.01 | 19.64 | 14.64 | 27.94 | 2.63 |