Story Question Answering on NoCha Public
55.6Pair AccuracySitEmb-v1.5-Qwen3 (QA)
Evaluation results
| Method | Links | |
|---|---|---|
| SitEmb-v1.5-Qwen3 (QA)Number of retrieved chunks=top-52025.08 | 55.6 | |
| SitEmb-v1.5-Qwen3 (QA+SA)Number of retrieved chunks=top-32025.08 | 55.6 | |
| Qwen3 (QA)Number of retrieved chunks=top-32025.08 | 54 | |
| SitEmb-v1.5-Qwen3 (QA)Number of retrieved chunks=top-32025.08 | 54 | |
| Qwen3 (QA)Number of retrieved chunks=top-52025.08 | 52.4 | |
| SitEmb-v1.5-Qwen3 (QA+SA)Number of retrieved chunks=top-52025.08 | 52.4 | |
| SitEmb-v1.5-Qwen3 (QA+SA)Number of retrieved chunks=top-102025.08 | 49.2 | |
| Qwen3 (out-of-box)Number of retrieved chunks=top-102025.08 | 46 | |
| SitEmb-v1.5-Qwen3 (QA)Number of retrieved chunks=top-102025.08 | 46 | |
| Qwen3 (out-of-box)Number of retrieved chunks=top-32025.08 | 42.9 | |
| Qwen3 (out-of-box)Number of retrieved chunks=top-52025.08 | 41.3 | |
| Qwen3 (QA)Number of retrieved chunks=top-102025.08 | 36.5 |