List your company
ResearchFormerly WizWand

Book Plot Retrieval on Book Plot Retrieval (test)

63.03Recall@10SitEmb-v1.5-Qwen3 (QA+SA)
31.715639.845347.97556.1047Aug 3, 2025
Updated 6mo ago

Evaluation results

MethodLinks
SitEmb-v1.5-Qwen3 (QA+SA)Setting=Situated, Size=8B2025.0863.0372.8382.7
Qwen3 (QA+SA)Setting=Chunk-only, Size=8B2025.0860.3668.8780.45
SitEmb-v1.5-Qwen3 (QA)Setting=Situated, Size=8B2025.0853.5763.5678.64
voyage-context-3Setting=Late Chunking, Size=unk2025.0851.3960.8973.7
Qwen3 (QA)Setting=Chunk-only, Size=8B2025.0851.0260.7873.89
SitEmb-v1-M3 (SA)Setting=Situated, Size=1B2025.0845.1555.6669.25
SitEmb-v1-M3 (SA) - ResidualSetting=Situated, Size=0.5B2025.0843.8554.9868.93
Qwen3 (out-of-box)Setting=Chunk-only, Size=8B2025.0843.5752.9469.48
M3 (SA) + ResidualSetting=Chunk-only, Size=1B2025.0843.4351.7465.51
M3 (SA)Setting=Chunk-only, Size=0.5B2025.0842.8752.9166.01
M3 (out-of-box)Setting=Chunk-only, Size=0.5B2025.0832.9241.4655.85