Document Selection for Question Answering on SQuAD v2 (250 QA pairs)
4.54Relaxed F1SRAS (PPO Base)
Evaluation results
| Method | Links | ||
|---|---|---|---|
| SRAS (PPO Base)Answer Generator=T5-base, Selector Type=PPO Base, Documents per question=12026.01 | 4.54 | 85.46 | |
| RandomAnswer Generator=T5-base, Documents per question=12026.01 | 3.13 | 9.56 | |
| Top-k CosineAnswer Generator=T5-base, Documents per question=12026.01 | 2.56 | 12.82 |