Information Retrieval on NIAH
2Delta AccuracyCertified Quantized Attention
Evaluation results
| Method | Links | |
|---|---|---|
| Certified Quantized AttentionContext Length=32K, n=100 paired trials, Backbone=LLaMA 3.1-8B, Key Precision=INT8 (asymmetric), Value Precision=INT4 (g=16)2026.05 | 2 | |
| Certified Quantized AttentionContext Length=8K, n=100 paired trials, Backbone=LLaMA 3.1-8B, Key Precision=INT8 (asymmetric), Value Precision=INT4 (g=16)2026.05 | 0 | |
| Certified Quantized AttentionContext Length=64K, n=100 paired trials, Backbone=LLaMA 3.1-8B, Key Precision=INT8 (asymmetric), Value Precision=INT4 (g=16)2026.05 | 0 |