Long-range sequence modeling on LRA 92 (test)
63.14ListOps AccuracyMEGA
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| MEGAsource=copied from respective paper2023.11 | 63.14 | 90.43 | 91.25 | |
| Liquid S4source=copied from respective paper2023.11 | 62.75 | 89.02 | 91.2 | |
| Long Conv, Exp + Squashsource=copied from respective paper2023.11 | 62.2 | 89.6 | 91.3 | |
| S5source=copied from respective paper2023.11 | 62.15 | 89.31 | 91.4 | |
| SGConvsource=copied from respective paper2023.11 | 61.45 | 89.2 | 91.11 | |
| LRUsource=copied from respective paper2023.11 | 60.28 | 89.41 | 89.91 | |
| S4D-Invsource=copied from respective paper2023.11 | 60.18 | 87.3 | 91.09 | |
| ChordMixersource=copied from respective paper2023.11 | 60.12 | 88.82 | 90.17 | |
| S4-LegSsource=copied from respective paper2023.11 | 59.6 | 86.82 | 90.9 | |
| S4Dmean_of_runs=22023.11 | 59.53 | 88.13 | 89.74 | |
| S4D-Invversion=reproduction, mean_of_runs=22023.11 | 59.3 | 88.18 | 91.17 | |
| RIR-EBT-GRCmean_of_runs=22023.11 | 58.04 | 87.97 | 88.99 | |
| BBT-GRCmean_of_runs=22023.11 | 55.15 | 85.69 | 90.78 | |
| H-Transformer-1Dsource=copied from respective paper2023.11 | 49.53 | 78.69 | 63.99 | |
| Reformersource=copied from respective paper2023.11 | 37.27 | 56.1 | 53.4 | |
| Transformersource=copied from respective paper2023.11 | 37.11 | 65.21 | 79.14 | |
| Transformer TLBsource=copied from respective paper2023.11 | 37.05 | 81.88 | 76.91 | |
| BigBirdsource=copied from respective paper2023.11 | 36.05 | 64.02 | 59.29 | |
| Linformersource=copied from respective paper2023.11 | 35.7 | 53.94 | 52.27 | |
| Longformersource=copied from respective paper2023.11 | 35.63 | 62.85 | 56.89 | |
| Skinhorn Transformersource=copied from respective paper2023.11 | 33.67 | 61.2 | 53.83 | |
| RIR-GRCmean_of_runs=22023.11 | 20.18 | 86.89 | 88.2 | |
| Performersource=copied from respective paper2023.11 | 18.01 | 65.4 | 53.82 | |
| Sparse Transformersource=copied from respective paper2023.11 | 17.07 | 63.58 | 59.59 | |
| Linear Transformersource=copied from respective paper2023.11 | 16.13 | 65.9 | 53.09 | |
| Local Attentionsource=copied from respective paper2023.11 | 15.82 | 52.98 | 53.39 |