List your company

Long-context downstream tasks on LongBench-E (test)

49.92S-Doc QA PerfElastic Attention
41.246443.498245.7548.0018Jan 24, 2026

Evaluation results

MethodLinks
Elastic AttentionBackbone=Llama-3.1-8B-Instruct, Sparse Head Mode=SSA2026.0149.920.6448.920.6330.140.7367.990.74540.6460.70.7953.350.69
Elastic AttentionBackbone=Llama-3.1-8B-Instruct, Sparse Head Mode=XA2026.0149.40.7152.940.6930.30.868.550.7949.660.7256.490.8752.710.77
Llama-3.1-8B-InstructBackbone=Llama-3.1-8B-Instruct2026.0148.75—51.85—30.26—68.16—56—55.81—53.28—
DuoAttentionBackbone=Llama-3.1-8B-Instruct2026.0148.650.745.210.729.930.767.350.754.560.756.470.751.820.7
PruLongBackbone=Llama-3.1-8B-Instruct2026.0147.690.743.050.730.020.767.860.753.560.761.070.752.110.7
Elastic AttentionBackbone=Qwen3-8B, Sparse Head Mode=SSA2026.0146.150.6446.540.6528.190.7267.520.7148.070.6562.950.7851.510.69
PruLongBackbone=Qwen3-8B2026.0146.050.746.880.728.30.766.610.748.660.762.240.751.340.7
Qwen3-8BBackbone=Qwen3-8B2026.0145.57—51.59—28.34—66.64—50.16—61.2—52.16—
DuoAttentionBackbone=Qwen3-8B2026.0145.450.744.520.728.160.766.420.747.50.762.380.750.670.7
Elastic AttentionBackbone=Qwen3-4B, Sparse Head Mode=XA2026.0144.40.6839.420.7128.490.8265.260.7644.350.7454.290.8747.590.76
Elastic AttentionBackbone=Qwen3-8B, Sparse Head Mode=XA2026.0144.010.7549.990.7628.30.8366.230.850.950.7760.570.8651.660.8
InfLLM-V2Backbone=Llama-3.1-8B-Instruct2026.0143.77—46.3—30.08—67.32—42.03—64.3—50.73—
Qwen3-4BBackbone=Qwen3-4B2026.0143.69—38.48—28.46—66.21—49.59—54.38—48.45—
InfLLM-V2Backbone=Qwen3-4B2026.0143.3—34.97—29.95—64.19—38.54—59.58—46.68—
Elastic AttentionBackbone=Qwen3-4B, Sparse Head Mode=SSA2026.0142.20.6638.860.6828.50.7665.730.7348.430.7154.340.8248.080.73
InfLLM-V2Backbone=Qwen3-8B2026.0142.2—42.33—29.58—64.55—45.87—59.58—49.03—
DuoAttentionBackbone=Qwen3-4B2026.0141.730.735.720.728.470.764.590.747.170.753.910.746.950.7
PruLongBackbone=Qwen3-4B2026.0141.580.737.580.728.530.764.80.747.230.753.20.747.190.7