Information Retrieval on NIAH multikey v1.0 (test)
98.7AccuracyBOSCH
Evaluation results
| Method | Links | ||
|---|---|---|---|
| BOSCHBackbone=Qwen3-14B-Base, Context Length=32k, Training Tokens=2.5B, SWA ratio=0.752026.04 | 98.7 | — | |
| BOSCHBackbone=Qwen3-30B-A3B-Base, Context Length=32k, Training Tokens=2.5B, SWA ratio=0.752026.04 | 94.2 | — | |
| BOSCHBackbone=Qwen3-8B-Base, Context Length=32k, Training Tokens=2.5B, SWA ratio=0.752026.04 | 94 | — | |
| BOSCHBackbone=Qwen3-1.7B-Base, Context Length=32k, Training Tokens=2.5B, SWA ratio=0.752026.04 | 78.1 | — | |
| BOSCHBackbone=Qwen3-1.7B-Base, Training Tokens=2.5B, SWA ratio=0.752026.04 | — | 95.2 | |
| BOSCHBackbone=Qwen3-8B-Base, Training Tokens=2.5B, SWA ratio=0.752026.04 | — | 99.1 | |
| BOSCHBackbone=Qwen3-14B-Base, Training Tokens=2.5B, SWA ratio=0.752026.04 | — | 99.8 | |
| BOSCHBackbone=Qwen3-30B-A3B-Base, Training Tokens=2.5B, SWA ratio=0.752026.04 | — | 99 |