Long-context retrieval on RULER-NIAH 4k
100AccuracyBF16
Evaluation Results
| Method | Links | |
|---|---|---|
| BF16Backbone=Qwen3-4B-Thinking-25072026.05 | 100 | |
| BF16Backbone=Qwen3-8B2026.05 | 100 | |
| BF16Backbone=GLM-4.7-FP8†2026.05 | 100 | |
| QuaRot-INT2Backbone=GLM-4.7-FP8†2026.05 | 100 | |
| OSCARBackbone=GLM-4.7-FP8†2026.05 | 100 | |
| OSCARBackbone=Qwen3-4B-Thinking-25072026.05 | 99.7 | |
| OSCARBackbone=Qwen3-8B2026.05 | 99.5 | |
| QuaRot-INT2Backbone=Qwen3-8B2026.05 | 74 | |
| QuaRot-INT2Backbone=Qwen3-4B-Thinking-25072026.05 | 0 |