List your company
ResearchFormerly WizWand

Needle-in-the-Haystack retrieval on PG-19 mini 10K context

100Accuracy (Needle-in-the-Haystack)Quest
72.9679.988794.02Aug 9, 2025
Updated 6mo ago

Evaluation results

MethodLinks
QuestModel=Llama-3-8B, Budget (K)=5122025.08100
TidalDecodeModel=Llama-3-8B, Budget (K)=1282025.08100
TidalDecodeModel=Llama-3-8B, Budget (K)=2562025.08100
TidalDecodeModel=Llama-3-8B, Budget (K)=5122025.08100
LessIsMoreModel=Llama-3-8B, Budget (K)=322025.08100
LessIsMoreModel=Llama-3-8B, Budget (K)=642025.08100
LessIsMoreModel=Llama-3-8B, Budget (K)=1282025.08100
LessIsMoreModel=Llama-3-8B, Budget (K)=2562025.08100
LessIsMoreModel=Llama-3-8B, Budget (K)=5122025.08100
QuestModel=Llama-3.1-8B, Budget (K)=2562025.08100
TidalDecodeModel=Llama-3.1-8B, Budget (K)=322025.08100
TidalDecodeModel=Llama-3.1-8B, Budget (K)=642025.08100
TidalDecodeModel=Llama-3.1-8B, Budget (K)=1282025.08100
TidalDecodeModel=Llama-3.1-8B, Budget (K)=2562025.08100
TidalDecodeModel=Llama-3.1-8B, Budget (K)=5122025.08100
LessIsMoreModel=Llama-3.1-8B, Budget (K)=322025.08100
LessIsMoreModel=Llama-3.1-8B, Budget (K)=642025.08100
LessIsMoreModel=Llama-3.1-8B, Budget (K)=1282025.08100
LessIsMoreModel=Llama-3.1-8B, Budget (K)=2562025.08100
LessIsMoreModel=Llama-3.1-8B, Budget (K)=5122025.08100
QuestModel=Llama-3-8B, Budget (K)=1282025.0899
QuestModel=Llama-3-8B, Budget (K)=2562025.0898
TidalDecodeModel=Llama-3-8B, Budget (K)=642025.0898
QuestModel=Llama-3.1-8B, Budget (K)=5122025.0898
QuestModel=Llama-3.1-8B, Budget (K)=1282025.0894
TidalDecodeModel=Llama-3-8B, Budget (K)=322025.0888
QuestModel=Llama-3.1-8B, Budget (K)=642025.0886
QuestModel=Llama-3-8B, Budget (K)=642025.0884
QuestModel=Llama-3-8B, Budget (K)=322025.0874
QuestModel=Llama-3.1-8B, Budget (K)=322025.0874