List your company
ResearchFormerly WizWand

Story Question Answering on LongStoryQA Large

61.9F1 ScoreSitEmb-v1.5-Qwen3 (QA)
52.33254.81657.359.784Aug 3, 2025
Updated 6mo ago

Evaluation results

MethodLinks
SitEmb-v1.5-Qwen3 (QA)Number of retrieved chunks=top-102025.0861.9
SitEmb-v1.5-Qwen3 (QA+SA)Number of retrieved chunks=top-102025.0861.5
Qwen3 (QA)Number of retrieved chunks=top-102025.0861.4
Qwen3 (out-of-box)Number of retrieved chunks=top-102025.0861.2
SitEmb-v1.5-Qwen3 (QA+SA)Number of retrieved chunks=top-52025.0859.4
Qwen3 (QA)Number of retrieved chunks=top-52025.0859.2
SitEmb-v1.5-Qwen3 (QA)Number of retrieved chunks=top-52025.0858.7
Qwen3 (QA)Number of retrieved chunks=top-32025.0858.3
Qwen3 (out-of-box)Number of retrieved chunks=top-52025.0857.9
SitEmb-v1.5-Qwen3 (QA)Number of retrieved chunks=top-32025.0857.7
SitEmb-v1.5-Qwen3 (QA+SA)Number of retrieved chunks=top-32025.0857.7
Qwen3 (out-of-box)Number of retrieved chunks=top-32025.0852.7