Relevance Assessment Label Alignment on Robust 2004 benchmark leaderboard · SOTA2 Research

Relevance Assessment Label Alignment on Robust 2004

0.56Cohen's Kappa (κ)TREC Topic (Baseline)

Evaluation Results

Method	Links
TREC Topic (Baseline)2026.04		0.56	0.4	43	33	24
query-contrastive2026.04		0.44	0.49	50	36	14
query-contrastive2026.04		0.44	0.49	51	36	13
query-contrastive2026.04		0.44	0.49	51	36	13
query-contrastive2026.04		0.43	0.51	51	36	13
query-contrastive2026.04		0.42	0.51	53	36	12
query-docs-pos2026.04		0.38	0.55	54	39	7
query-docs-pos2026.04		0.36	0.57	57	35	7
query-docs-neg2026.04		0.33	0.6	61	33	6
query-docs-neg2026.04		0.32	0.62	63	32	6
query2026.04		0.31	0.61	60	36	3