Natural Language Inference on ContractNLI SCROLLS (test)
59.38Exact Match (EM)BART
Evaluation results
| Method | Links | |
|---|---|---|
| BARTBackbone=BART-base, Evaluation Protocol=FT (standard), Input Length (n)=1024, Attention=Dense2026.05 | 59.38 | |
| Block-ChaCALBackbone=BART-base, Evaluation Protocol=FT (modified), Input Length (n)=1024, Attention=Blockwise substitution in decoder's first layer, m=n//32026.05 | 36.72 | |
| BARTBackbone=BART-base, Evaluation Protocol=zero-shot, Input Length (n)=1024, Attention=Dense2026.05 | 30.63 |