Question Answering on HotpotQA (Speedup Evaluation)
4.14Prefill Speedup RatioDRAGIN+IDR2
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| DRAGIN+IDR2LLM=Vicuna-13B2025.05 | 4.14 | 2.29 | 2.15 | |
| DRAGIN+IDR2LLM=Llama2-7B2025.05 | 4.09 | 2.08 | 1.95 | |
| DRAGIN+IDR2LLM=Llama2-13B2025.05 | 3.97 | 2.15 | 2.01 | |
| FLARE+IDR2LLM=Llama2-7B2025.05 | 3.12 | 2.61 | 2.31 | |
| FLARE+IDR2LLM=Llama2-13B2025.05 | 2.42 | 1.87 | 1.8 | |
| FS-RAG+IDR2LLM=Llama2-7B2025.05 | 2.41 | 1.88 | 1.69 | |
| FL-RAG+IDR2LLM=Llama2-7B2025.05 | 2.29 | 1.85 | 1.53 | |
| FL-RAG+IDR2LLM=Llama2-13B2025.05 | 2.27 | 2 | 1.54 | |
| FLARE+IDR2LLM=Vicuna-13B2025.05 | 2.27 | 2.07 | 1.98 | |
| FL-RAG+IDR2LLM=Vicuna-13B2025.05 | 2.22 | 1.97 | 1.51 | |
| FS-RAG+IDR2LLM=Llama2-13B2025.05 | 2.16 | 2.05 | 1.59 | |
| FS-RAG+IDR2LLM=Vicuna-13B2025.05 | 2.15 | 2.31 | 1.66 |