List your company

Question Answering on Scientific QA (Base setting)

56.19F1 ScoreDeepEra
19.509229.032138.55548.0779Jan 23, 2026

Evaluation results

MethodLinks
DeepEraSetting=Ours2026.0156.1954.8658.544.3
RankGPTSetting=Ours2026.0151.9551.0250.924
VicunaRerankerSetting=Ours2026.0145.2751.3252.294.07
RankGPTSetting=LMQG2026.0145.1535.4157.123.65
JinaSetting=LMQG2026.0144.3633.5360.143.62
ZephyrRerankerSetting=Ours2026.0144.2250.6251.644.06
DeARrerankSetting=Ours2026.0144.2250.7650.674.05
MonoT5Setting=Ours2026.0143.8850.6350.693.96
DeARrerankSetting=LMQG2026.0143.4741.6160.943.69
limrankSetting=Ours2026.0143.125049.983.94
VicunaRerankerSetting=LMQG2026.0142.8441.259.183.66
MXBAISetting=Ours2026.0142.5532.7952.073.17
MonoT5Setting=LMQG2026.0142.5540.760.313.63
BGESetting=LMQG2026.0142.3131.3660.423.62
SPLADESetting=LMQG2026.0142.1231.3859.843.64
ZephyrRerankerSetting=LMQG2026.0141.7439.7759.293.64
BGESetting=Ours2026.0141.633.8351.672.94
JinaSetting=Ours2026.0141.638.9847.883.44
BCESetting=LMQG2026.0141.3730.0760.793.64
ColBERTSetting=LMQG2026.0141.3330.4360.383.62
DeepEraSetting=LMQG2026.0141.1130.260.353.67
TwoLARSetting=Ours2026.0140.7531.2650.793.01
RankT5Setting=Ours2026.0140.6132.8351.052.93
MiniLMSetting=Ours2026.0140.5731.7549.472.72
ColBERTSetting=Ours2026.0140.5331.9250.792.85
MXBAISetting=LMQG2026.0140.1129.9561.173.69
TwoLARSetting=LMQG2026.0140.0129.7461.363.66
In-RankerSetting=Ours2026.0139.631.1950.562.93
MiniLMSetting=LMQG2026.0139.5628.5261.393.63
BCESetting=Ours2026.0139.2931.6750.792.86
RankT5Setting=LMQG2026.0139.0228.6860.673.61
SPLADESetting=Ours2026.0138.8230.9350.312.69
In-RankerSetting=LMQG2026.0138.4229.1160.253.68
LLM2VecSetting=Ours2026.0138.431.2350.732.88
limrankSetting=LMQG2026.0137.1535.6654.153.44
LLM2VecSetting=LMQG2026.0136.9927.6759.373.62
ListT5Setting=LMQG2026.0124.2124.0114.481.54
ListT5Setting=Ours2026.0120.9224.8122.341.53