List your company
ResearchFormerly WizWand

Long context retrieval and reasoning on RULER

94.7ScoreNemotron 3 Ultra
35.981651.225866.4781.7142Jun 12, 2026Jun 15, 2026Jun 18, 2026Jun 21, 2026Jun 24, 2026Jun 27, 2026Jun 30, 2026
Updated 4mo ago

Evaluation results

MethodLinks
Nemotron 3 UltraContext length=1M, Parameter Count=550B-A55B2026.0694.7
DS-v4-ProContext length=1M, Parameter Count=1.6T-A49B2026.0694.2
Full KVBackbone=Qwen2.5-14B, KV Cache Budget=Full2026.0690.74
Qwen-3.5Context length=1M, Parameter Count=397B-17B2026.0690.1
Full KVBackbone=Llama-3.1-8B, KV Cache Budget=Full2026.0688.35
DS-v4-FlashContext length=1M, Parameter Count=284B-A13B2026.0687.7
SEKVBackbone=Qwen2.5-14B, KV Cache Budget=10%2026.0687.34
SEKVBackbone=Llama-3.1-8B, KV Cache Budget=10%2026.0684.17
SentenceKVBackbone=Qwen2.5-14B, KV Cache Budget=10%2026.0683.41
SemantiCacheBackbone=Qwen2.5-14B, KV Cache Budget=10%2026.0682.04
Full KVBackbone=Llama-3-8B, KV Cache Budget=Full2026.0681.94
ChunkKVBackbone=Qwen2.5-14B, KV Cache Budget=10%2026.0681.17
SentenceKVBackbone=Llama-3.1-8B, KV Cache Budget=10%2026.0680.37
PyramidKVBackbone=Qwen2.5-14B, KV Cache Budget=10%2026.0679.33
SemantiCacheBackbone=Llama-3.1-8B, KV Cache Budget=10%2026.0679.18
SEKVBackbone=Llama-3-8B, KV Cache Budget=10%2026.0678.43
ChunkKVBackbone=Llama-3.1-8B, KV Cache Budget=10%2026.0678.41
SnapKVBackbone=Qwen2.5-14B, KV Cache Budget=10%2026.0677.48
PyramidKVBackbone=Llama-3.1-8B, KV Cache Budget=10%2026.0676.23
SentenceKVBackbone=Llama-3-8B, KV Cache Budget=10%2026.0674.82
SnapKVBackbone=Llama-3.1-8B, KV Cache Budget=10%2026.0674.31
Full KVBackbone=Llama-3.2-3B, KV Cache Budget=Full2026.0673.67
SemantiCacheBackbone=Llama-3-8B, KV Cache Budget=10%2026.0673.47
ChunkKVBackbone=Llama-3-8B, KV Cache Budget=10%2026.0672.83
H2OBackbone=Qwen2.5-14B, KV Cache Budget=10%2026.0671.24
PyramidKVBackbone=Llama-3-8B, KV Cache Budget=10%2026.0670.14
SnapKVBackbone=Llama-3-8B, KV Cache Budget=10%2026.0668.42
Full KVBackbone=Mistral-7B, KV Cache Budget=Full2026.0668.38
H2OBackbone=Llama-3.1-8B, KV Cache Budget=10%2026.0667.82
SEKVBackbone=Llama-3.2-3B, KV Cache Budget=10%2026.0663.84
StreamingLLMBackbone=Qwen2.5-14B, KV Cache Budget=10%2026.0661.87
H2OBackbone=Llama-3-8B, KV Cache Budget=10%2026.0661.33
SEKVBackbone=Mistral-7B, KV Cache Budget=10%2026.0661.23
SentenceKVBackbone=Llama-3.2-3B, KV Cache Budget=10%2026.0660.43
SemantiCacheBackbone=Llama-3.2-3B, KV Cache Budget=10%2026.0659.12
StreamingLLMBackbone=Llama-3.1-8B, KV Cache Budget=10%2026.0658.43
ChunkKVBackbone=Llama-3.2-3B, KV Cache Budget=10%2026.0658.34
SentenceKVBackbone=Mistral-7B, KV Cache Budget=10%2026.0657.84
SemantiCacheBackbone=Mistral-7B, KV Cache Budget=10%2026.0656.33
PyramidKVBackbone=Llama-3.2-3B, KV Cache Budget=10%2026.0656.17
ChunkKVBackbone=Mistral-7B, KV Cache Budget=10%2026.0655.72
SnapKVBackbone=Llama-3.2-3B, KV Cache Budget=10%2026.0654.83
PyramidKVBackbone=Mistral-7B, KV Cache Budget=10%2026.0653.41
StreamingLLMBackbone=Llama-3-8B, KV Cache Budget=10%2026.0652.17
SnapKVBackbone=Mistral-7B, KV Cache Budget=10%2026.0651.63
H2OBackbone=Llama-3.2-3B, KV Cache Budget=10%2026.0648.71
H2OBackbone=Mistral-7B, KV Cache Budget=10%2026.0645.17
StreamingLLMBackbone=Llama-3.2-3B, KV Cache Budget=10%2026.0641.32
StreamingLLMBackbone=Mistral-7B, KV Cache Budget=10%2026.0638.24