Question Answering on HotpotQA (ACC, ASR)
26ACCSDAG
Evaluation results
| Method | Links | ||
|---|---|---|---|
| SDAG#adv. docs=1, k=10, Generator=Llama, Retriever=E52026.02 | 26 | 28 | |
| SDAG-D&A#adv. docs=1, k=10, Generator=Llama, Retriever=E52026.02 | 26 | 25 | |
| SDAG#adv. docs=1, k=5, Generator=Llama, Retriever=E52026.02 | 23 | 41 | |
| SDAG-D&A#adv. docs=1, k=5, Generator=Llama, Retriever=E52026.02 | 23 | 38 | |
| RAGD#adv. docs=2, k=5, Generator=Llama, Retriever=E52026.02 | 21 | 32 | |
| RAGD#adv. docs=2, k=10, Generator=Llama, Retriever=E52026.02 | 21 | 28 | |
| RAGD#adv. docs=3, k=10, Generator=Llama, Retriever=E52026.02 | 21 | 38 | |
| SDAG-RAGD#adv. docs=3, k=10, Generator=Llama, Retriever=E52026.02 | 21 | 26 | |
| RAGD#adv. docs=1, k=10, Generator=Llama, Retriever=E52026.02 | 19 | 25 | |
| SDAG-RAGD#adv. docs=1, k=10, Generator=Llama, Retriever=E52026.02 | 19 | 14 | |
| CARG#adv. docs=1, k=10, Generator=Llama, Retriever=E52026.02 | 18 | 66 | |
| D&A#adv. docs=1, k=10, Generator=Llama, Retriever=E52026.02 | 18 | 62 | |
| SDAG-RAGD#adv. docs=2, k=5, Generator=Llama, Retriever=E52026.02 | 18 | 28 | |
| SDAG-D&A#adv. docs=2, k=10, Generator=Llama, Retriever=E52026.02 | 18 | 45 | |
| SDAG-RAGD#adv. docs=2, k=10, Generator=Llama, Retriever=E52026.02 | 18 | 19 | |
| SDAG#adv. docs=2, k=10, Generator=Llama, Retriever=E52026.02 | 17 | 50 | |
| D&A#adv. docs=1, k=5, Generator=Llama, Retriever=E52026.02 | 16 | 64 | |
| CARG#adv. docs=1, k=5, Generator=Llama, Retriever=E52026.02 | 15 | 68 | |
| SDAG-RAGD#adv. docs=1, k=5, Generator=Llama, Retriever=E52026.02 | 15 | 50 | |
| SDAG-D&A#adv. docs=2, k=5, Generator=Llama, Retriever=E52026.02 | 14 | 60 | |
| SDAG#adv. docs=2, k=5, Generator=Llama, Retriever=E52026.02 | 13 | 63 | |
| D&A#adv. docs=2, k=5, Generator=Llama, Retriever=E52026.02 | 12 | 74 | |
| D&A#adv. docs=2, k=10, Generator=Llama, Retriever=E52026.02 | 12 | 73 | |
| CARG#adv. docs=2, k=5, Generator=Llama, Retriever=E52026.02 | 11 | 77 | |
| CARG#adv. docs=2, k=10, Generator=Llama, Retriever=E52026.02 | 11 | 77 | |
| SDAG-D&A#adv. docs=3, k=10, Generator=Llama, Retriever=E52026.02 | 11 | 63 | |
| RAGD#adv. docs=1, k=5, Generator=Llama, Retriever=E52026.02 | 10 | 70 | |
| D&A#adv. docs=3, k=10, Generator=Llama, Retriever=E52026.02 | 10 | 77 | |
| SDAG#adv. docs=3, k=10, Generator=Llama, Retriever=E52026.02 | 10 | 67 | |
| CARG#adv. docs=3, k=10, Generator=Llama, Retriever=E52026.02 | 7 | 82 |