Story Question Answering on LongStoryQA Large
61.9F1 ScoreSitEmb-v1.5-Qwen3 (QA)
Evaluation Results
| Method | Links | |
|---|---|---|
| SitEmb-v1.5-Qwen3 (QA)Number of retrieved chunks=top-102025.08 | 61.9 | |
| SitEmb-v1.5-Qwen3 (QA+SA)Number of retrieved chunks=top-102025.08 | 61.5 | |
| Qwen3 (QA)Number of retrieved chunks=top-102025.08 | 61.4 | |
| Qwen3 (out-of-box)Number of retrieved chunks=top-102025.08 | 61.2 | |
| SitEmb-v1.5-Qwen3 (QA+SA)Number of retrieved chunks=top-52025.08 | 59.4 | |
| Qwen3 (QA)Number of retrieved chunks=top-52025.08 | 59.2 | |
| SitEmb-v1.5-Qwen3 (QA)Number of retrieved chunks=top-52025.08 | 58.7 | |
| Qwen3 (QA)Number of retrieved chunks=top-32025.08 | 58.3 | |
| Qwen3 (out-of-box)Number of retrieved chunks=top-52025.08 | 57.9 | |
| SitEmb-v1.5-Qwen3 (QA)Number of retrieved chunks=top-32025.08 | 57.7 | |
| SitEmb-v1.5-Qwen3 (QA+SA)Number of retrieved chunks=top-32025.08 | 57.7 | |
| Qwen3 (out-of-box)Number of retrieved chunks=top-32025.08 | 52.7 |