List your company
ResearchFormerly WizWand

Book Plot Retrieval on NDP v1

68.98Recall@10SitEmb-v1.5-Qwen3 + book note data
7.123.16539.2355.295Aug 3, 2025
Updated 6mo ago

Evaluation results

MethodLinks
SitEmb-v1.5-Qwen3 + book note dataSize=8B, Context Setting=+ Situated Context, Maximum Length=81922025.0868.9879.3286.68
SitEmb-v1.5-Qwen3 + book note dataSize=8B, Context Setting=+ Situated Summ., Maximum Length=81922025.0867.8176.3784.37
SitEmb-v1.5-Qwen3 + book note dataSize=8B, Context Setting=Chunk-Only, Maximum Length=81922025.0866.8174.3684.32
SitEmb-v1.5-Qwen3Size=8B, Context Setting=+ Situated Context, Maximum Length=81922025.0863.3272.7583.59
SitEmb-v1.5-Qwen3Size=8B, Context Setting=Chunk-Only, Maximum Length=81922025.0861.6669.0679.54
voyage-context-3Size=unk, Context Setting=+ Situated Summ., Maximum Length=81922025.0861.3770.3682.84
SitEmb-v1.5-Qwen3Size=8B, Context Setting=+ Situated Summ., Maximum Length=81922025.0861.2670.0281.57
voyage-context-3Size=unk, Context Setting=+ Situated Context, Maximum Length=81922025.0860.4669.582.19
voyage-context-3Size=unk, Context Setting=Chunk-Only, Maximum Length=81922025.0858.5468.4779.09
Qwen3-EmbeddingSize=8B, Context Setting=Chunk-Only, Maximum Length=81922025.0851.5861.3273.47
SitEmb-v1-M3Size=1B, Context Setting=+ Situated Summ., Maximum Length=81922025.0851.4763.6976.76
NV-Embed-v2Size=7B, Context Setting=Chunk-Only, Maximum Length=81922025.0851.3860.1171.16
Qwen3-EmbeddingSize=8B, Context Setting=+ Situated Summ., Maximum Length=81922025.0851.261.6376.1
SitEmb-v1-M3Size=1B, Context Setting=+ Situated Context, Maximum Length=81922025.0850.8560.5776.4
NV-Embed-v2Size=7B, Context Setting=+ Situated Summ., Maximum Length=81922025.0849.2558.3370.85
SitEmb-v1-M3Size=1B, Context Setting=Chunk-Only, Maximum Length=81922025.0848.7958.4573.29
Qwen3-EmbeddingSize=8B, Context Setting=+ Situated Context, Maximum Length=81922025.0848.0158.9171.86
GTE-Qwen2Size=7B, Context Setting=Chunk-Only, Maximum Length=81922025.0846.1955.7971.15
Jina-v3Size=0.5B, Context Setting=+ Situated Summ., Maximum Length=81922025.0845.4856.1269.9
E5-MistralSize=7B, Context Setting=+ Situated Summ., Maximum Length=81922025.0844.5854.3268.27
E5-MistralSize=7B, Context Setting=Chunk-Only, Maximum Length=81922025.0843.1851.9366.65
Jina-v3Size=0.5B, Context Setting=Chunk-Only, Maximum Length=81922025.0842.6552.6767.92
M3Size=0.5B, Context Setting=Chunk-Only, Maximum Length=81922025.0842.5553.3366.51
GTE-Qwen2Size=7B, Context Setting=+ Situated Summ., Maximum Length=81922025.0842.4449.8860.85
M3Size=0.5B, Context Setting=+ Situated Summ., Maximum Length=81922025.0841.8353.9467.78
Jina-v3Size=0.5B, Context Setting=+ Situated Context, Maximum Length=81922025.0834.144.2758.33
NV-Embed-v2Size=7B, Context Setting=+ Situated Context, Maximum Length=81922025.0821.0130.242.18
GTE-Qwen2Size=7B, Context Setting=+ Situated Context, Maximum Length=81922025.0819.0129.7749.34
E5-MistralSize=7B, Context Setting=+ Situated Context, Maximum Length=81922025.0814.7724.4932.68
M3Size=0.5B, Context Setting=+ Situated Context, Maximum Length=81922025.089.4815.6824.7