Synthetic Retrieval on Needle-In-A-Haystack (NIAH)
99.8NIAH-1 Success RateOryx-TM
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Oryx-TMFamily=Oryx-TM, Mixer=Transformer, Context Length=2K2026.05 | 99.8 | 99.4 | 81.6 | 93.6 | |
| Oryx-TGFamily=Oryx-TG, Mixer=Transformer, Context Length=2K2026.05 | 99.4 | 98.6 | 99.4 | 99.1 | |
| BaselineFamily=Baseline, Mixer=Gated DeltaNet, Context Length=2K2026.05 | 99.4 | 39.6 | 32.6 | 57.2 | |
| Oryx-TGFamily=Oryx-TG, Mixer=Gated DeltaNet, Context Length=2K2026.05 | 99.4 | 60.2 | 82.8 | 80.8 | |
| BaselineFamily=Baseline, Mixer=Transformer, Context Length=2K2026.05 | 99 | 90.4 | 95 | 94.8 | |
| BaselineFamily=Baseline, Mixer=Mamba-2, Context Length=2K2026.05 | 90.4 | 15.8 | 33.2 | 46.5 | |
| Oryx-TMFamily=Oryx-TM, Mixer=Mamba-2, Context Length=2K2026.05 | 50.8 | 17 | 41 | 36.3 |