List your company
ResearchFormerly WizWand

Story Question Answering on DetectiveQA

82.3AccuracySitEmb-v1.5-Qwen3 (QA)
61.70867.05472.477.746Aug 3, 2025
Updated 6mo ago

Evaluation results

MethodLinks
SitEmb-v1.5-Qwen3 (QA)Number of retrieved chunks=top-102025.0882.3
Qwen3 (QA)Number of retrieved chunks=top-102025.0881.8
SitEmb-v1.5-Qwen3 (QA)Number of retrieved chunks=top-52025.0878.7
SitEmb-v1.5-Qwen3 (QA+SA)Number of retrieved chunks=top-102025.0878.3
Qwen3 (QA)Number of retrieved chunks=top-52025.0878.2
SitEmb-v1.5-Qwen3 (QA+SA)Number of retrieved chunks=top-52025.0874.2
Qwen3 (out-of-box)Number of retrieved chunks=top-102025.0873.2
SitEmb-v1.5-Qwen3 (QA)Number of retrieved chunks=top-32025.0873.2
Qwen3 (QA)Number of retrieved chunks=top-32025.0870.5
Qwen3 (out-of-box)Number of retrieved chunks=top-52025.0868.7
SitEmb-v1.5-Qwen3 (QA+SA)Number of retrieved chunks=top-32025.0866.5
Qwen3 (out-of-box)Number of retrieved chunks=top-32025.0862.5