List your company
ResearchFormerly WizWand

Needle-in-the-Haystack retrieval on PG-19 mini 32K context

100AccuracyQuest
77.1283.068994.94Aug 9, 2025
Updated 6mo ago

Evaluation results

MethodLinks
QuestModel=Llama-3.1-8B, Budget (K)=2562025.08100
QuestModel=Llama-3.1-8B, Budget (K)=5122025.08100
TidalDecodeModel=Llama-3.1-8B, Budget (K)=642025.08100
TidalDecodeModel=Llama-3.1-8B, Budget (K)=1282025.08100
TidalDecodeModel=Llama-3.1-8B, Budget (K)=2562025.08100
TidalDecodeModel=Llama-3.1-8B, Budget (K)=5122025.08100
LessIsMoreModel=Llama-3.1-8B, Budget (K)=322025.08100
LessIsMoreModel=Llama-3.1-8B, Budget (K)=642025.08100
LessIsMoreModel=Llama-3.1-8B, Budget (K)=1282025.08100
LessIsMoreModel=Llama-3.1-8B, Budget (K)=2562025.08100
LessIsMoreModel=Llama-3.1-8B, Budget (K)=5122025.08100
TidalDecodeModel=Llama-3.1-8B, Budget (K)=322025.0898
QuestModel=Llama-3.1-8B, Budget (K)=1282025.0892
QuestModel=Llama-3.1-8B, Budget (K)=642025.0888
QuestModel=Llama-3.1-8B, Budget (K)=322025.0878