Multi-document Question Answering on HotpotQA (Acc, throughput)
45AccuracyDense
Evaluation results
| Method | Links | ||
|---|---|---|---|
| DenseModel=QwQ 32B2025.07 | 45 | 297.34 | |
| DenseModel=Phi 4 reasoning plus2025.07 | 43 | 525.39 | |
| ReasonCacheModel=QwQ 32B2025.07 | 41 | 423.23 | |
| ReasonCacheModel=Phi 4 reasoning plus2025.07 | 40 | 695.88 | |
| DenseModel=DeepSeek R1 Distill Qwen 32B2025.07 | 37.5 | 381.51 | |
| ReasonCacheModel=DeepSeek R1 Distill Qwen 32B2025.07 | 36 | 542.43 | |
| RandomModel=QwQ 32B2025.07 | 22 | 421.89 | |
| RandomModel=Phi 4 reasoning plus2025.07 | 21 | 699.87 | |
| RandomModel=DeepSeek R1 Distill Qwen 32B2025.07 | 18 | 537.85 |