Prompt-heavy Aggregate Performance Evaluation on Qasper, Multi-News, HotpotQA, Musique, and 2WikiMQA
64.81Weighted Top-1CASK
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| CASKBudget=3842026.04 | 64.81 | 89.4 | 1.521 | |
| CASKBudget=2562026.04 | 63.72 | 88.59 | 1.594 | |
| TriAttentionBudget=2562026.04 | 58.42 | 82.74 | 1.985 | |
| TriAttentionBudget=3842026.04 | 57.34 | 82.74 | 2.002 |