Long-context language modeling on LongBench 4-task average
12.7Average Accuracy2d hetero
Evaluation results
| Method | Links | ||
|---|---|---|---|
| 2d heteroeviction budget (b)=20482026.04 | 12.7 | 582 | |
| 2d heteroeviction budget (b)=10242026.04 | 12.1 | 283 | |
| 2d heteroeviction budget (b)=5122026.04 | 12 | 136 | |
| 2d heteroeviction budget (b)=40962026.04 | 11.5 | 1,175 | |
| fulleviction budget (b)=full2026.04 | 11.5 | 1,859 | |
| 2d uniformeviction budget (b)=40962026.04 | 7.7 | 448 | |
| 2d uniformeviction budget (b)=20482026.04 | 7.5 | 224 | |
| 2deviction budget (b)=40962026.04 | 7.3 | 1,175 | |
| 1deviction budget (b)=20482026.04 | 6.9 | 224 | |
| 2d uniformeviction budget (b)=10242026.04 | 6.8 | 112 | |
| 2deviction budget (b)=20482026.04 | 6.5 | 582 | |
| 1deviction budget (b)=5122026.04 | 6.1 | 56 | |
| 1deviction budget (b)=40962026.04 | 6 | 448 | |
| 2deviction budget (b)=5122026.04 | 5.9 | 139 | |
| 2deviction budget (b)=10242026.04 | 5.8 | 283 | |
| 2d uniformeviction budget (b)=5122026.04 | 4.9 | 56 | |
| 1deviction budget (b)=10242026.04 | 4.1 | 112 |