Passage Reranking on BRIGHT

40.3NDCG@10 (Avg)R-Em. + gpt-oss-120b

Evaluation Results

Method
R-Em. + gpt-oss-120b2025.09	40.3	55.7	54.5	39.1	52.6	37	38.6	49	25.3	28.5	12.5	42	48.4	46.6	26.9	34.3
Diver + gpt-oss-120b2025.09	39.1	54.9	53.5	38.5	51.6	29.9	34.2	45.2	26	32.6	11.6	41.4	49.4	44	29.3	34.1
ReasonRank2025.08	38.03	58.17	48.9	36.64	53.27	33.88	38.68	45.97	25.78	20.93	9.41	38.46	46.28	—	—	—
GroupRank2025.11	38	59	57.5	39.2	50	39.1	39	42.7	14.3	14.9	12.6	39	48.8	—	—	—
R-Em. + ReasonRank-32B2025.09	38	58.4	51.3	40	51.8	39.2	37.4	45.6	21.1	13.9	9.4	42.2	45.8	46.2	17.5	32.5
Diver + ReasonRank-32B2025.09	37.2	56.1	51.6	35.3	53.9	34.9	33.4	42.7	19.8	20.8	10.2	41	46.3	44	20.3	32.5
R-Em.2025.09	36.9	54.5	54	34.4	46.1	34.6	35.9	37	37.1	12	11.3	40.7	45.5	42.4	24.6	32.5
ERank2025.11	36.2	55.9	55.1	35.2	44.6	34.1	34.5	41.2	14.1	24.4	12.2	36.7	45.9	—	—	—
ReasonRank2025.08	35.74	56.7	47.75	35.05	47.77	31.22	32.47	40.87	23.17	24.95	7.68	39.49	41.8	—	—	—
R-Em. + Qwen3-8B2025.09	35.7	55.6	50	34.5	47.9	32.8	32.7	44.3	19.4	12.6	9.4	40.3	49.3	42.5	16	33
ReasonRank2025.11	35.6	53.9	47.6	36.3	52.6	36.5	34.2	44.5	15.2	14.8	5.5	40.6	45.3	—	—	—
Diver + Qwen3-8B2025.09	34.8	53.8	50.5	31.4	48.6	27.1	28.1	40	20.6	22.8	10.2	39.8	44.6	39.9	21.7	31.5
GroupRank2025.11	34.3	52.7	51	33.8	44.5	32.1	33.9	38.1	16.3	17.3	8.7	40.7	42.4	—	—	—
S-v3 (w. BM25Q NAF) + gpt-oss-120b2025.09	33.4	44	48.9	32.9	40.6	36.9	31.7	40.7	32.7	35.7	11.9	24.1	20.4	39.4	34.2	18.8
Rank-K2025.11	33.3	51.1	42.3	33	44.5	33.1	28.4	41.6	12.8	21.6	8.5	39.3	43.2	—	—	—
Diver-Retriever2025.11	32.9	52.5	53.6	33.8	45.2	28.4	30.4	35	13	14.7	9.8	42.5	36.3	—	—	—
Rank-K2025.08	32.61	50.64	39.78	30.09	43.45	26.6	29.87	35.17	27.23	22.8	7.61	37.06	41	—	—	—
ReasonRank2025.11	32.5	51.6	43.4	32.4	44	31	25.6	39.8	15.4	20.1	7	38.9	40.7	—	—	—
BGE (w. BM25Q NAF) + gpt-oss-120b2025.09	31.9	43.1	46.5	33	36.6	33.7	32	37.9	33.8	29.3	11.6	25.7	19.9	37.5	31.6	19.1
ERank2025.11	31.8	48.2	53	31	44.5	22.4	24.8	33.7	9.7	18.2	11.1	38.2	46.6	—	—	—
Rearank2025.08	31.75	46.94	40.27	30.65	40.77	27.16	26.12	36.26	30.55	22.84	7.31	32.28	39.86	—	—	—
S-v3 (w. BM25Q NAF) + ReasonRank-32B2025.09	30.9	42.4	47.4	31.2	41.3	36.4	30.7	37.8	25.3	23.5	12	24.3	18.3	38.2	24.4	18.2
Rank-R12025.11	30.8	49.6	41.2	27.6	40	28.5	28.2	43.8	7	18.5	7.9	34.8	43.1	—	—	—
ReasonIR2025.08	30.59	43.49	43	32.65	39.57	20.82	30.96	27.34	31.69	19.55	7.37	33.93	36.68	—	—	—
BGE (w. BM25Q NAF) + ReasonRank-32B2025.09	30.3	40.1	48.2	34.5	39.2	30.5	34.1	39.1	28.3	16.2	8.7	24.5	20.6	38	22.3	17.9
Rank-R12025.08	29.66	44.45	38.73	27.39	37.1	23.11	27.82	36.77	21.27	19.23	8.8	31.66	39.53	—	—	—
S-v3 (w. BM25Q NAF) + Qwen3-8B2025.09	29.3	41.6	45.4	27.8	38.7	32.3	29	34.7	27.1	20.1	11.2	22.9	20.6	35.6	23.6	18.2
Diver2025.09	29.1	42.1	46.8	22.4	34.4	21.5	20.9	25.1	37.8	12.9	10.3	37.7	38	30.4	25.4	28.6
Rank12025.08	28.34	42.43	37.97	25.43	34.85	17.14	23.82	31.18	12.2	40.98	4.79	29.28	39.95	—	—	—
BGE (w. BM25Q NAF) + Qwen3-8B2025.09	27.9	36.6	48.2	28	39.2	25.2	30.2	33	28.1	14.6	8.7	23.4	19.8	34.3	21.4	17.3
Rank12025.08	27.23	39.91	38.91	25.34	35.32	16.77	24.81	33.47	12.71	28.14	2.58	30.67	38.18	—	—	—
RankZephyr2025.08	22.64	34.9	17.36	19.87	24.72	12.35	13.35	22.34	29.29	32.37	6.05	28.98	30.07	—	—	—
RankZephyr2025.11	22.5	42.6	19.5	18.7	29.8	13.8	13.3	29.2	12.9	19.3	7.4	31.1	31.6	—	—	—
Rank-R12025.11	21.4	40.9	31.4	23.2	32	19.8	11.2	35.5	3.8	6.6	5	17.2	30.1	—	—	—
Rank-R12025.08	20.57	36.7	27.91	20.19	30.22	18.13	11.32	29.28	17.13	9.35	3.23	14.43	28.98	—	—	—
BGE (w. BM25Q NAF)2025.09	17.7	20.3	31.6	19.2	18.5	15.3	20.5	16.5	30.1	10.6	7.6	14.5	8.1	20.3	20.4	10.1
S-v3 (w. BM25Q NAF)2025.09	17.5	23.7	30.9	16.5	16.5	15.7	18.6	16.4	28.8	15.5	8.6	11.9	7.3	19.8	22.1	9.3
rankT52025.08	16.6	13.62	22.11	11.35	11.4	10.94	11.35	15.96	27.45	38.05	9.24	18.27	9.46	—	—	—
RankT52025.11	15.7	33	22.8	18.9	8.6	2.2	10	23.9	11.9	16.9	8.9	19.6	11.7	—	—	—
Llama 3.1 8B2026.02	0.2092	0.3295	0.415	0.257	0.2526	0.2214	0.1862	0.2114	0.2887	0.0392	0.108	0.1296	0.0716	—	—	—
Rank-R1-14B2026.02	0.205	0.312	0.385	0.212	0.264	0.226	0.189	0.275	0.202	0.092	0.097	0.092	0.119	—	—	—
Qwen3 8B2026.02	0.1999	0.3032	0.402	0.2101	0.2422	0.2029	0.167	0.2158	0.2902	0.0807	0.1167	0.1126	0.056	—	—	—
Qwen3 4B2026.02	0.1986	0.3268	0.4037	0.2159	0.2306	0.1993	0.1644	0.191	0.2883	0.0784	0.1041	0.118	0.0627	—	—	—
Qwen3 0.6B2026.02	0.1858	0.3093	0.3746	0.1936	0.2004	0.1846	0.1487	0.1773	0.2785	0.0821	0.1105	0.1148	0.0552	—	—	—
Mistral 7B2026.02	0.176	0.3055	0.3431	0.2064	0.2143	0.165	0.1096	0.1712	0.2676	0.0403	0.113	0.1163	0.0597	—	—	—
Llama 3.1 8B2026.02	0.175	0.3011	0.3759	0.2135	0.2263	0.1756	0.1292	0.1638	0.2183	0.0156	0.0993	0.1189	0.0621	—	—	—
RankGPT-42026.02	0.17	0.338	0.342	0.167	0.27	0.223	0.277	0.111	0.034	0.156	0.012	0.002	0.086	—	—	—
Rank-R1-7B2026.02	0.164	0.26	0.285	0.172	0.242	0.191	0.104	0.242	0.198	0.043	0.043	0.083	0.109	—	—	—
Qwen3 0.6B2026.02	0.1493	0.2994	0.3335	0.151	0.171	0.1322	0.0852	0.1615	0.2289	0.0258	0.0921	0.0923	0.0185	—	—	—
BM252026.02	0.1369	0.181	0.2808	0.1646	0.1341	0.1092	0.1619	0.1613	0.2473	0.0434	0.0645	0.0734	0.0213	—	—	—
Mistral 7B2026.02	0.1341	0.2764	0.2881	0.1523	0.1572	0.1075	0.0467	0.1285	0.1918	0.0063	0.0945	0.1026	0.0575	—	—	—
Qwen3 4B2026.02	0.1313	0.2286	0.2955	0.1145	0.1756	0.1332	0.0926	0.1406	0.169	0.0322	0.0747	0.0954	0.0242	—	—	—
RankZephyr-7B2026.02	0.13	0.219	0.237	0.144	0.103	0.076	0.137	0.166	0.247	0.065	0.068	0.073	0.02	—	—	—
Qwen3 8B2026.02	0.1258	0.2242	0.2768	0.1286	0.177	0.1381	0.0679	0.1289	0.1575	0.0351	0.0718	0.0857	0.0173	—	—	—