Question Answering on NarrativeQA SCROLLS (test)
11.63F1 ScoreBART
Evaluation results
| Method | Links | |
|---|---|---|
| BARTBackbone=BART-base, Evaluation Protocol=FT (standard), Input Length (n)=1024, Attention=Dense2026.05 | 11.63 | |
| Block-ChaCALBackbone=BART-base, Evaluation Protocol=FT (modified), Input Length (n)=1024, Attention=Blockwise substitution in decoder's first layer, m=n//32026.05 | 7.86 | |
| BARTBackbone=BART-base, Evaluation Protocol=zero-shot, Input Length (n)=1024, Attention=Dense2026.05 | 2.39 |