List your company
ResearchFormerly WizWand

Long-context retrieval on Needle-in-the-Haystack 10k-context

100AccuracyQuest
-4235077Aug 9, 2025
Updated 6mo ago

Evaluation results

MethodLinks
QuestModel=LongChat-7B-v1.5-32k, Budget (K)=5122025.08100
TidalDecodeModel=LongChat-7B-v1.5-32k, Budget (K)=5122025.08100
LessIsMoreModel=LongChat-7B-v1.5-32k, Budget (K)=2562025.08100
LessIsMoreModel=LongChat-7B-v1.5-32k, Budget (K)=5122025.08100
QuestModel=LongChat-7B-v1.5-32k, Budget (K)=642025.0899
QuestModel=LongChat-7B-v1.5-32k, Budget (K)=1282025.0899
QuestModel=LongChat-7B-v1.5-32k, Budget (K)=2562025.0899
TidalDecodeModel=LongChat-7B-v1.5-32k, Budget (K)=2562025.0899
TidalDecodeModel=LongChat-7B-v1.5-32k, Budget (K)=1282025.0898
LessIsMoreModel=LongChat-7B-v1.5-32k, Budget (K)=642025.0898
LessIsMoreModel=LongChat-7B-v1.5-32k, Budget (K)=1282025.0898
TidalDecodeModel=LongChat-7B-v1.5-32k, Budget (K)=642025.0892
LessIsMoreModel=LongChat-7B-v1.5-32k, Budget (K)=322025.0892
TidalDecodeModel=LongChat-7B-v1.5-32k, Budget (K)=322025.0873
QuestModel=LongChat-7B-v1.5-32k, Budget (K)=322025.0865
TOVAModel=LongChat-7B-v1.5-32k, Budget (K)=5122025.088
StreamingLLMModel=LongChat-7B-v1.5-32k, Budget (K)=5122025.085
H2OModel=LongChat-7B-v1.5-32k, Budget (K)=5122025.083
TOVAModel=LongChat-7B-v1.5-32k, Budget (K)=2562025.083
StreamingLLMModel=LongChat-7B-v1.5-32k, Budget (K)=2562025.083
H2OModel=LongChat-7B-v1.5-32k, Budget (K)=642025.081
H2OModel=LongChat-7B-v1.5-32k, Budget (K)=1282025.081
H2OModel=LongChat-7B-v1.5-32k, Budget (K)=2562025.081
TOVAModel=LongChat-7B-v1.5-32k, Budget (K)=642025.081
TOVAModel=LongChat-7B-v1.5-32k, Budget (K)=1282025.081
StreamingLLMModel=LongChat-7B-v1.5-32k, Budget (K)=322025.081
StreamingLLMModel=LongChat-7B-v1.5-32k, Budget (K)=642025.081
StreamingLLMModel=LongChat-7B-v1.5-32k, Budget (K)=1282025.081
H2OModel=LongChat-7B-v1.5-32k, Budget (K)=322025.080
TOVAModel=LongChat-7B-v1.5-32k, Budget (K)=322025.080