Question Answering on HotpotQA (reverse and vanilla metrics)
87.3Reverse AccuracyAttention Rectification
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Attention Rectificationxi=32026.01 | 87.3 | 86.3 | |
| Attention Rectificationxi=102026.01 | 87.2 | 85.8 | |
| Attention Rectificationxi=52026.01 | 87.1 | 86.1 | |
| Attention Rectificationxi=12026.01 | 86.6 | 86.1 | |
| LoRA2026.01 | 86.1 | 85.6 | |
| vanilla2026.01 | 61.4 | 54.3 |