List your company

Zero-shot Evaluation on PiQA, LAMBADA, HellaSwag, and ARC (Easy/Challenge)

62.47PiQA AccuracyDense (full)
50.853253.869156.88559.9009Mar 17, 2026

Evaluation results

MethodLinks
Dense (full)Model=Qwen3-0.6B, Latency (128k context)=77.652026.0362.4734.8245.4120.3533.9539.4
SFA (k = 16)Model=Qwen3-0.6B, Latency (128k context)=34.202026.0361.7334.0545.6219.2734.0338.94
Dense (full)Model=GPT2-350M, Latency (128k context)=46.782026.0359.7924.7430.1915.7822.0430.51
Dense (d = 64)Model=Qwen3-0.6B, Latency (128k context)=30.842026.0358.4331.2741.5815.8328.2936.68
SFA (k = 8)Model=GPT2-350M, Latency (128k context)=23.672026.0358.0223.8330.2213.6622.1329.57
Dense (full)Model=GPT2-124M, Latency (128k context)=16.862026.0356.3422.7828.3514.3219.6128.28
Dense (d = 32)Model=GPT2-350M, Latency (128k context)=20.582026.0355.1719.9628.1511.8318.4326.71
SFA (k = 8)Model=GPT2-124M, Latency (128k context)=9.412026.0354.9221.0328.417.3919.2627.4
Dense (d = 32)Model=GPT2-124M, Latency (128k context)=7.862026.0351.319.3925.7212.4714.2624.63