Story Question Answering on ∞Bench En.MC
90AccuracySitEmb-v1.5-Qwen3 (QA)
Evaluation results
| Method | Links | |
|---|---|---|
| SitEmb-v1.5-Qwen3 (QA)Number of retrieved chunks=top-102025.08 | 90 | |
| Qwen3 (QA)Number of retrieved chunks=top-102025.08 | 88.7 | |
| SitEmb-v1.5-Qwen3 (QA+SA)Number of retrieved chunks=top-102025.08 | 88.2 | |
| SitEmb-v1.5-Qwen3 (QA)Number of retrieved chunks=top-52025.08 | 86.9 | |
| Qwen3 (out-of-box)Number of retrieved chunks=top-102025.08 | 86 | |
| SitEmb-v1.5-Qwen3 (QA+SA)Number of retrieved chunks=top-52025.08 | 85.6 | |
| Qwen3 (QA)Number of retrieved chunks=top-52025.08 | 84.7 | |
| Qwen3 (QA)Number of retrieved chunks=top-32025.08 | 83 | |
| SitEmb-v1.5-Qwen3 (QA)Number of retrieved chunks=top-32025.08 | 83 | |
| SitEmb-v1.5-Qwen3 (QA+SA)Number of retrieved chunks=top-32025.08 | 83 | |
| Qwen3 (out-of-box)Number of retrieved chunks=top-52025.08 | 80.4 | |
| Qwen3 (out-of-box)Number of retrieved chunks=top-32025.08 | 75.1 |