Long-context multi-task evaluation on LongBench-E

45.25QasperFluxAttn

Evaluation results

Method
FluxAttn2026.04	45.25	54.42	54.54	41.34	34.54	26.16	68.33	91.91	42.17	9	97.67	47.74	65.35	52.28	51
TriangleMix2026.04	45.1	54.6	56.67	41.88	34.09	25.51	71.33	90.93	42.63	10.62	94.67	43.64	59.35	51.67	50
FluxAttn2026.04	44.77	54.12	57.35	43.43	34.31	25.8	72.33	91.32	42.62	9.33	98.33	45.48	60.7	52.42	62
Llama-3.1-8B-Instruct2026.04	44.06	53.44	59.62	44.08	34.5	26.02	71	90.54	42.94	12.67	99.33	47.78	63.85	53.28	—
FluxAttn2026.04	43.76	53.41	57.36	39.43	32.96	25.63	70.33	91.27	42.2	11	98.67	45.6	66.17	52.3	51
FluxAttn2026.04	42.14	53.13	58.53	43.5	34.66	26.06	70.67	91.46	43.13	8	99.67	50.91	64.78	53.07	72
DuoAttention2026.04	41.78	51.55	55.96	41.7	33.24	23.34	69.33	89.35	41.62	0.5	98.93	57.54	69.39	52.13	50
PruLong2026.04	41.51	52.36	50.46	37.57	34.25	25.86	66.33	89.93	41.72	9.07	97	56.84	66.23	51.68	50
Qwen3-8B2026.04	41.22	49.92	58.98	44.21	33.27	23.42	71.33	86.77	41.83	2	98.33	56.08	66.31	52.16	—
FluxAttn2026.04	41	49.76	58.19	44.36	33.32	23.35	70	88.77	41.7	1.33	99.67	55.6	67.22	52.22	47
TriangleMix2026.04	40.82	51.31	57.57	44.51	33.32	23.35	71.33	86.73	41.79	2	94.33	55.04	65.89	51.65	50
FluxAttn2026.04	40.41	50.26	57.78	40.57	33.27	23.51	69.67	87.19	42.12	1.33	99.33	55.41	65.51	51.57	51
FluxAttn2026.04	40.3	50.49	56.02	40.9	33.01	23.55	71.67	88.31	41.61	0.33	100	59.46	68.27	52.18	46
FluxAttn2026.04	39.92	50.04	55.72	40.81	33.03	23.5	72	88.48	40.96	0.33	99.22	58.57	69.46	52.05	46
PruLong2026.04	37.95	51.2	51.94	36.48	33.11	23.36	69	87.9	42.11	1	98	57.05	67.66	50.8	50
DuoAttention2026.04	35.83	49.84	47.09	32.24	33.32	23.7	69.33	85.87	39.75	4.5	94.57	50.56	57.43	48.22	50
FluxAttn2026.04	35.74	51.7	45.83	32.34	33.57	23.66	69	87.23	39.81	3.5	93.74	50.81	59.28	48.32	53
TriangleMix2026.04	35.55	52.02	45.37	31.76	33.32	23.7	69	88.2	39.74	3.83	91.51	48.58	56.38	47.72	50
Qwen3-4B2026.04	35.21	52.16	44.81	32.15	33.47	23.45	70.67	88.22	39.74	2.33	96.84	50.84	57.93	48.45	—
FluxAttn2026.04	35.1	51.68	49.65	32.86	33.04	23.42	69.33	88	40	1.67	94.47	51.4	58.68	48.59	44
FluxAttn2026.04	35.02	49.44	49.64	32.27	33.26	23.48	69.33	88.29	39.78	1.5	94.56	53.44	59.69	48.72	44
FluxAttn2026.04	35.02	50.89	45.17	34.24	33.02	23.53	69	88.08	40.38	3.94	96.06	51.68	60	48.76	47
DuoAttention2026.04	34.63	50.74	49.7	36.41	34.25	25.78	70	91.45	42.13	9.8	97.33	53.59	68.55	52.11	50
PruLong2026.04	34.15	50.78	44.48	32.89	32.96	23.53	67.67	88.69	39.55	3.17	90.17	49	54.07	47.16	50