List your company

Long-context language understanding on RULER 32K

85.8Easy Average ScoreHashAttention
84.520884.852985.18585.5171Oct 7, 2025

Evaluation results

MethodLinks
HashAttentionModel=Meta-llama/Llama-3.1-8B-Instruct, Context Window=32K, Sparsity=10%2025.1085.881.9483.87
oracle-top-kModel=Meta-llama/Llama-3.1-8B-Instruct, Context Window=32K, Sparsity=10%2025.1085.3187.1886.25
full attentionModel=Meta-llama/Llama-3.1-8B-Instruct, Context Window=32K2025.1085.388.7487.02
vAttention(oracle-top-k)Model=Meta-llama/Llama-3.1-8B-Instruct, Context Window=32K, Sparsity=10%, Approximation=oracle-top-k2025.1085.1788.6186.89
vAttention(HashAttention)Model=Meta-llama/Llama-3.1-8B-Instruct, Context Window=32K, Sparsity=10%, Approximation=HashAttention2025.1084.5786.5685.57