Question Answering on SQuAD 50-passage (train)
49.6AccuracySEAL Baseline
Evaluation results
| Method | Links | |
|---|---|---|
| SEAL BaselineStrategy=Rewrite, Iteration=02026.01 | 49.6 | |
| SEAL BaselineStrategy=Rewrite, Iteration=12026.01 | 47.3 | |
| SEAL BaselineStrategy=Rewrite, Iteration=22026.01 | 46.6 | |
| SEAL BaselineStrategy=Rewrite, Iteration=32026.01 | 44.9 | |
| SEAL BaselineStrategy=Rewrite, Iteration=42026.01 | 43.3 | |
| Learned-Template Self-EditingArchive=With, Iteration=22026.01 | 40.1 | |
| Learned-Template Self-EditingArchive=With, Iteration=32026.01 | 38.6 | |
| Learned-Template Self-EditingArchive=With, Iteration=12026.01 | 38 | |
| Learned-Template Self-EditingArchive=With, Iteration=42026.01 | 36.3 | |
| Learned-Template Self-EditingArchive=No, Iteration=02026.01 | 35.9 | |
| Learned-Template Self-EditingArchive=No, Iteration=12026.01 | 35.9 | |
| Learned-Template Self-EditingArchive=No, Iteration=42026.01 | 35.3 | |
| Learned-Template Self-EditingArchive=No, Iteration=32026.01 | 34.5 | |
| Learned-Template Self-EditingArchive=No, Iteration=22026.01 | 34.4 | |
| SEAL BaselineStrategy=Implications, Iteration=32026.01 | 27.8 | |
| SEAL BaselineStrategy=Implications, Iteration=22026.01 | 26.9 | |
| SEAL BaselineStrategy=Implications, Iteration=42026.01 | 26.9 | |
| SEAL BaselineStrategy=Implications, Iteration=12026.01 | 26 | |
| SEAL BaselineStrategy=Implications, Iteration=02026.01 | 20 | |
| Learned-Template Self-EditingArchive=With, Iteration=02026.01 | 18.5 |