List your company

Large Language Model Inference on 8K context (test)

81.35Q ScoreDense
73.539675.567377.59579.6227May 13, 2026

Evaluation results

MethodLinks
DenseModel=Qwen2.5-14B2026.0581.35—151.6—1,690.9—0.014
SphKV (rep)Model=Qwen2.5-14B2026.0581.0134239.41.581,083.735.90.009
DenseModel=GPT-oss2026.0579.71—163.7—1,717.1—0.014
SphKV (rep)Model=GPT-oss2026.0579.1952261.21.61,220.328.90.01
DenseModel=Llama-3.1-8B2026.0574.2—173.4—1,658.3—0.013
SphKV (rep)Model=Llama-3.1-8B2026.0573.8437268.51.551,262.323.90.01