Synthetic Retrieval on NIAH
100Score @ 4096 ContextQwen3-8B
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Qwen3-8BVariant=Base2026.03 | 100 | 100 | 97 | 92 | |
| Qwen3-8BVariant=Fine-tune2026.03 | 100 | 100 | 99 | 95 | |
| Qwen3-8BVariant=SFA (k = 16)2026.03 | 100 | 100 | 100 | 97 | |
| Qwen3-4BVariant=Fine-tune2026.03 | 99 | 96 | 92 | 84 | |
| Qwen3-4BVariant=SFA (k = 16)2026.03 | 99 | 93 | 91 | 84 | |
| Qwen3-4BVariant=Base2026.03 | 97 | 95 | 90 | 81 | |
| Qwen3-0.6BVariant=SFA (k = 16)2026.03 | 95 | 93 | 77 | 53 | |
| Qwen3-0.6BVariant=Fine-tune2026.03 | 94 | 92 | 79 | 55 | |
| Qwen3-0.6BVariant=Base2026.03 | 90 | 87 | 77 | 52 |