List your company

Long-context language understanding on LongBench 2024 (test)

47.23Multi-doc QABlock-Dist - Full
24.516430.413236.3142.2068May 15, 2026

Evaluation results

MethodLinks
Block-Dist - FullModel=Qwen3-14B2026.0547.2347.7522.8763.4570.0517.7144.84
Block-Dist - BlockModel=Qwen3-14B2026.0546.3346.5422.8963.7669.236.4342.53
Original - FullModel=Qwen3-14B2026.0546.2548.8623.9462.4469.175.6642.72
Block-Dist - FullModel=Qwen3-8B2026.0542.7547.1125.7538.9767.3311.3338.87
Block-Dist - FullModel=Llama-3.1-8B-Instruct2026.054247.4225.8825.6766.520.1137.93
Block-Dist - BlockModel=Llama-3.1-8B-Instruct2026.0541.8846.9825.3524.9666.8711.8936.32
Block-Dist - BlockModel=Qwen3-8B2026.0541.7746.3825.1736.76679.9537.83
Original - FullModel=Llama-3.1-8B-Instruct2026.0541.7547.0525.8624.1665.9115.7736.75
Original - FullModel=Qwen3-8B2026.0540.5247.5124.0135.5966.991.6636.05
Block-Dist - FullModel=Qwen3-4B-Instruct-25072026.0538.7447.1422.3359.2267.6612.741.29
Block-Dist - BlockModel=Qwen3-4B-Instruct-25072026.0537.5546.1724.145966.3211.9840.86
Original - FullModel=Qwen3-4B-Instruct-25072026.0536.8846.0522.0861.6366.274.8939.63
Original - SuperpositionModel=Qwen3-14B2026.0535.8832.8522.7748.5445.2310.4132.61
Original - Prompt CacheModel=Llama-3.1-8B-Instruct2026.0533.2839.8722.4119.4550.7614.8330.1
Original - Prompt CacheModel=Qwen3-14B2026.0532.4835.824.5852.8349.428.6433.96
Original - SuperpositionModel=Llama-3.1-8B-Instruct2026.0531.9537.8125.7521.4546.1513.8729.5
Original - SuperpositionModel=Qwen3-8B2026.0529.7535.8628.9622.7849.658.5129.25
Original - Prompt CacheModel=Qwen3-8B2026.0528.8938.8623.7720.7645.275.6727.2
Original - Prompt CacheModel=Qwen3-4B-Instruct-25072026.0528.3631.8917.8949.2348.494.8330.12
Original - SuperpositionModel=Qwen3-4B-Instruct-25072026.0525.3934.8518.3841.5245.722.3228.02