List your company
ResearchFormerly WizWand

Question Answering on HotpotQA (Speedup Evaluation)

4.14Prefill Speedup RatioDRAGIN+IDR2
2.07042.60773.1453.6823May 19, 2025
Updated 8mo ago

Evaluation results

MethodLinks
DRAGIN+IDR2LLM=Vicuna-13B2025.054.142.292.15
DRAGIN+IDR2LLM=Llama2-7B2025.054.092.081.95
DRAGIN+IDR2LLM=Llama2-13B2025.053.972.152.01
FLARE+IDR2LLM=Llama2-7B2025.053.122.612.31
FLARE+IDR2LLM=Llama2-13B2025.052.421.871.8
FS-RAG+IDR2LLM=Llama2-7B2025.052.411.881.69
FL-RAG+IDR2LLM=Llama2-7B2025.052.291.851.53
FL-RAG+IDR2LLM=Llama2-13B2025.052.2721.54
FLARE+IDR2LLM=Vicuna-13B2025.052.272.071.98
FL-RAG+IDR2LLM=Vicuna-13B2025.052.221.971.51
FS-RAG+IDR2LLM=Llama2-13B2025.052.162.051.59
FS-RAG+IDR2LLM=Vicuna-13B2025.052.152.311.66