Question Answering Speedup on IIRC
4.72Prefill Speedup RatioDRAGIN+IDR2
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| DRAGIN+IDR2LLM=Vicuna-13B2025.05 | 4.72 | 4 | 3.53 | |
| DRAGIN+IDR2LLM=Llama2-7B2025.05 | 4.49 | 2.58 | 2.58 | |
| DRAGIN+IDR2LLM=Llama2-13B2025.05 | 4.25 | 2.86 | 2.65 | |
| FLARE+IDR2LLM=Llama2-13B2025.05 | 3.58 | 3.15 | 3.01 | |
| FLARE+IDR2LLM=Llama2-7B2025.05 | 3.54 | 2.97 | 2.89 | |
| FL-RAG+IDR2LLM=Llama2-7B2025.05 | 3.08 | 2.76 | 2.1 | |
| FS-RAG+IDR2LLM=Llama2-7B2025.05 | 2.92 | 2.88 | 2.2 | |
| FL-RAG+IDR2LLM=Llama2-13B2025.05 | 2.7 | 2.65 | 1.83 | |
| FLARE+IDR2LLM=Vicuna-13B2025.05 | 2.7 | 2.24 | 2.22 | |
| FL-RAG+IDR2LLM=Vicuna-13B2025.05 | 2.66 | 2.72 | 1.82 | |
| FS-RAG+IDR2LLM=Vicuna-13B2025.05 | 2.35 | 2.69 | 1.92 | |
| FS-RAG+IDR2LLM=Llama2-13B2025.05 | 2.16 | 2.65 | 1.74 |