List your company

Information Retrieval on MAIR 20% labeled query-document pairs

48.55Avg MAP@100ERA
18.140426.035233.9341.8248Apr 3, 2026

Evaluation results

MethodLinks
ERAModel=Qwen3-8B2026.0448.5552.5657.866.9947.6427.1449.26
ERAModel=Qwen3-8B2026.0448.5552.5657.866.9947.6427.1449.26
Zero-shotModel=Qwen3-8B2026.0447.0850.7656.2163.8247.2428.3847.02
Zero-shotModel=Qwen3-8B2026.0447.0850.7656.2163.8247.2428.3847.02
ERAModel=Qwen3-0.6B2026.0441.8843.653.6258.7740.6822.0742.17
ERAModel=Qwen3-0.6B2026.0441.8843.653.6258.7740.6822.0742.17
ERAModel=OpenAI-large2026.0441.7643.0251.6357.0836.7922.4443.63
ERAModel=OpenAI-large2026.0441.7643.0251.6357.0836.7922.4443.63
Zero-shotModel=Qwen3-0.6B2026.0439.9742.4852.6255.8339.1121.8839.21
Zero-shotModel=Qwen3-0.6B2026.0439.9742.4852.6255.8339.1121.8839.21
Zero-shotModel=OpenAI-large2026.0437.5138.1644.0753.2131.2621.0539.86
Zero-shotModel=OpenAI-large2026.0437.5138.1644.0753.2131.2621.0539.86
Emb. AdapterModel=Qwen3-8B2026.0436.4536.7247.6952.1435.3916.6437.5
Embedding AdapterModel=Qwen3-8B2026.0436.4536.7247.6952.1435.3916.6437.5
ERAModel=OpenAI-small2026.0435.836.4342.5852.532.0717.8137.97
ERAModel=OpenAI-small2026.0435.836.4342.5852.532.0717.8137.97
ERAModel=BGE-M32026.0433.2935.2835.0556.0834.714.635.03
ERAModel=BGE-M32026.0433.2935.2835.0556.0834.714.635.03
Emb. AdapterModel=Qwen3-0.6B2026.0429.928.5943.3246.5727.9913.5129.5
Embedding AdapterModel=Qwen3-0.6B2026.0429.928.5943.3246.5727.9913.5129.5
Zero-shotModel=OpenAI-small2026.0428.9730.2536.3546.1927.6514.1229.07
Zero-shotModel=OpenAI-small2026.0428.9730.2536.3546.1927.6514.1229.07
Emb. AdapterModel=OpenAI-large2026.0428.1127.6932.6640.421.7315.8330.52
Embedding AdapterModel=OpenAI-large2026.0428.1127.6932.6640.421.7315.8330.52
Zero-shotModel=BGE-M32026.0426.9330.2329.9947.830.6611.8326.39
Zero-shotModel=BGE-M32026.0426.9330.2329.9947.830.6611.8326.39
Emb. AdapterModel=OpenAI-small2026.0422.0419.1929.2933.820.6611.9622.56
Embedding AdapterModel=OpenAI-small2026.0422.0419.1929.2933.820.6611.9622.56
Emb. AdapterModel=BGE-M32026.0419.3117.3425.6637.1721.297.4318.91
Embedding AdapterModel=BGE-M32026.0419.3117.3425.6637.1721.297.4318.91