Question Answering on NQ (reverse, vanilla metrics)
67.6Reverse ScoreAttention Rectification
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Attention Rectificationxi=52026.01 | 67.6 | 64.8 | |
| Attention Rectificationxi=102026.01 | 66.9 | 65.4 | |
| Attention Rectificationxi=32026.01 | 66.7 | 64.2 | |
| LoRA2026.01 | 65.7 | 62.6 | |
| Attention Rectificationxi=12026.01 | 64.9 | 64.4 | |
| vanilla2026.01 | 52.4 | 46.7 |