Question Answering on TriviaQA (reverse, vanilla)
74.5Reverse QA ScoreAttention Rectification
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Attention Rectificationxi=52026.01 | 74.5 | 73.7 | |
| Attention Rectificationxi=32026.01 | 74.1 | 73.1 | |
| Attention Rectificationxi=102026.01 | 74.1 | 73.4 | |
| Attention Rectificationxi=12026.01 | 73.9 | 73.1 | |
| LoRA2026.01 | 72.6 | 71.3 | |
| vanilla2026.01 | 52.1 | 45.6 |