Long-context language understanding on LongBench (Comprehensive Metric Set) benchmark leaderboard · SOTA2 Research

Long-context language understanding on LongBench (Comprehensive Metric Set)

32.3NQAKEYDIFF

Evaluation Results

Method	Links
KEYDIFF2026.04		32.3	44.93	52.98	55.52	46.6	30.26	32.45	24.47	25.71	64	87.29	40.35	10.65	99.5	45.18	46.77	46.18
CapKV2026.04		31.69	44.84	51.42	58.24	48.35	30.66	33.88	24.65	26.47	65.25	90.71	37.72	12	98.5	50.12	49.47	47.12
CapKV2026.04		31.53	47.74	56.95	57.31	51.9	32.91	34.61	24.65	26.78	68.5	90.21	38.8	13.65	100	53.47	48.52	48.6
KEYDIFF2026.04		31.5	47.2	54.17	58.79	50.95	35.85	34.48	24.77	26.83	62.5	86.56	40.13	10.65	99.5	52.25	47.03	47.7
EA2026.04		31.19	46.67	51.49	56.34	48.65	33.48	33.63	24.74	27.04	19	85.91	38.87	12.5	87	52.97	48.64	43.63
EA2026.04		31.17	47.49	56.85	58.33	49.98	33.82	34.94	24.78	27.18	29.5	85.66	38.03	11.2	99	52.49	47.54	45.5
KNORM2026.04		30.71	45.34	56.16	58.43	50.63	35.27	34.07	24.83	26.67	66	87.26	36.85	11.15	97.5	36.91	48.35	46.63
LLAMA3.1-8B2026.04		30.46	47.27	55.98	59	51.23	33.55	35.24	25.27	26.8	29.5	86.01	39.31	10.65	100	53.47	47.73	45.72
EA2026.04		30.17	39.7	41.55	55.53	44.55	26.75	31.77	23.26	26.06	27	88.98	38.59	10	45	49.84	50.01	39.3
SNAPKV2026.04		30.02	45.2	55.16	58.3	52.01	32.56	33.95	24.23	26.69	28.5	85.18	39.82	11.2	99.5	54.01	48.06	45.27
CapKV2026.04		29.73	39.93	43.71	53.19	46.49	24.66	29.32	23.71	25.19	30.75	90.83	33.44	9	66.5	44.47	50.91	40.11
KEYDIFF2026.04		29.62	33.01	41.37	52.51	37.97	25.28	29.41	23.95	22.93	52	84.36	40.03	9.66	99.5	37.48	47.58	41.67
SNAPKV2026.04		28.98	41.2	45.34	56.93	49.53	29.89	32.12	23.59	25.78	33	86.08	40.48	9.55	99.5	53.21	47.29	43.9
SNAPKV2026.04		28.5	31.47	35.4	54.62	41.94	28.26	29.01	22.17	23.14	38	84.51	40.95	9.1	90	54.18	47.84	41.19
KEYDIFF2026.04		28.49	16.95	34.22	40.71	25.38	15.27	26.3	21.03	19.15	40	80.01	39.18	8.5	89	26.07	47.99	34.89
SINK2026.04		28.29	43.53	37.19	52.35	42.17	32.69	31.92	23.97	26.33	30.5	91.81	38.57	8.44	76	47.02	47.34	41.13
KNORM2026.04		27.45	39.59	49.46	55.72	44.23	26.95	32.22	24.25	25.51	59	86.44	33.6	9.55	87.5	33.05	49.16	42.73
EA2026.04		25.87	29.04	32.51	48.46	31.27	24.48	29.07	22.72	24.6	50.5	92.17	26.9	7.55	18	40.11	48.94	34.51
SINK2026.04		25.37	37.53	32.06	49.57	38.27	23.83	30.97	22.23	25.83	31	91.9	37.62	6.95	54	49.54	48.45	37.82
CapKV2026.04		25.33	24.72	27.81	43.9	30.86	21.58	24.56	22.14	21.54	7	91.22	28.79	10	21.5	35.61	51.06	30.48
SNAPKV2026.04		24.15	20.79	22.81	44.52	23.38	20.51	25.14	19.7	20.07	34.5	81.21	38.33	6.5	53.5	51.06	48.96	33.45
SINK2026.04		23.27	24.47	25.44	42.06	27.26	19.82	28.87	20.82	23.8	32	91.52	35.66	7	33.5	50.9	50.51	33.56
KNORM2026.04		22.44	16.23	28.48	37.69	21.73	13.3	26.03	20.64	20.56	45.5	62.78	29.03	11.5	25	23.06	51.52	28.47
KNORM2026.04		22.18	29.67	39.44	47.45	30.45	20.51	28.68	22.78	23.48	51.5	72.85	28.98	9.15	52.5	27.2	49.17	34.75
SINK2026.04		21.53	18.98	22.64	37.24	22.15	14.53	24.99	19.11	19.76	28.5	90.81	34.56	4	16	52.72	52.73	30.02