Long-context reasoning on LongBench Llama-2-7B-4K
62.54Code CompletionWINA
Evaluation Results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| WINASparsity=0.252025.05 | 62.54 | 52.46 | 12.48 | 7.07 | 12.95 | 5.26 | 22.89 | |
| BaselineSparsity=02025.05 | 62.28 | 52.09 | 11.63 | 6.73 | 13 | 5.56 | 22.62 | |
| TEALSparsity=0.252025.05 | 62.14 | 51.8 | 11.83 | 7.24 | 12.87 | 5.06 | 22.59 | |
| WINASparsity=0.42025.05 | 61.52 | 51.76 | 13.81 | 7.63 | 13.64 | 4.97 | 23.11 | |
| WINASparsity=0.52025.05 | 61.15 | 52.16 | 14.62 | 7.41 | 12.09 | 3.13 | 22.71 | |
| TEALSparsity=0.42025.05 | 60.28 | 52.23 | 12.55 | 8.12 | 13.4 | 4.54 | 22.83 | |
| TEALSparsity=0.52025.05 | 58.41 | 50.1 | 12.97 | 8.39 | 12.8 | 4.28 | 22.23 | |
| WINASparsity=0.652025.05 | 55.03 | 48.93 | 8.98 | 6.42 | 8.6 | 2.85 | 19.54 | |
| TEALSparsity=0.652025.05 | 44.2 | 44.15 | 11.16 | 7.09 | 8.17 | 1.62 | 17.88 |