Speedup Evaluation on StrategyQA
3.39Prefilling Speedup RatioDRAGIN+IDR2
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| DRAGIN+IDR2LLM=Llama2-7B2025.05 | 3.39 | 2.09 | 1.95 | |
| DRAGIN+IDR2LLM=Vicuna-13B2025.05 | 3.25 | 1.88 | 1.82 | |
| DRAGIN+IDR2LLM=Llama2-13B2025.05 | 3.15 | 1.98 | 1.87 | |
| FLARE+IDR2LLM=Llama2-7B2025.05 | 2.71 | 2.27 | 1.77 | |
| FLARE+IDR2LLM=Llama2-13B2025.05 | 2.45 | 1.71 | 1.69 | |
| FS-RAG+IDR2LLM=Llama2-7B2025.05 | 2.36 | 1.97 | 1.79 | |
| FLARE+IDR2LLM=Vicuna-13B2025.05 | 2.05 | 1.93 | 1.89 | |
| FS-RAG+IDR2LLM=Vicuna-13B2025.05 | 2.02 | 1.78 | 1.53 | |
| FL-RAG+IDR2LLM=Llama2-13B2025.05 | 1.76 | 1.62 | 1.4 | |
| FL-RAG+IDR2LLM=Llama2-7B2025.05 | 1.75 | 1.49 | 1.4 | |
| FS-RAG+IDR2LLM=Llama2-13B2025.05 | 1.74 | 1.59 | 1.44 | |
| FL-RAG+IDR2LLM=Vicuna-13B2025.05 | 1.65 | 1.55 | 1.31 |