Token Manipulation on Synthetic Token Manipulation Dataset (test)
100RecallLSTM
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| LSTMNumber of layers=1, Maximum hidden dimension=61442026.02 | 100 | 100 | 75 | 91.6 | |
| Mamba2Number of layers=1, Maximum hidden dimension=61442026.02 | 100 | 80.7 | 72 | 84.2 | |
| Deltanet[-1,1]Number of layers=1, Maximum hidden dimension=61442026.02 | 100 | 89.2 | 78.2 | 89.2 | |
| Deltaproduct4[-1,1]Number of layers=1, Maximum hidden dimension=61442026.02 | 100 | 100 | 71.7 | 90.6 | |
| BD-LRUm (block size)=2, Number of layers=1, Maximum hidden dimension=61442026.02 | 100 | 96.2 | 76 | 90.8 | |
| BD-LRUm (block size)=3, Number of layers=1, Maximum hidden dimension=61442026.02 | 100 | 98 | 76.2 | 91.6 | |
| BD-LRUm (block size)=5, Number of layers=1, Maximum hidden dimension=61442026.02 | 100 | 98.5 | 78.2 | 92.2 | |
| BD-LRUm (block size)=8, Number of layers=1, Maximum hidden dimension=61442026.02 | 100 | 99.2 | 74.8 | 91.3 | |
| H-LRUm (window size)=3, Number of layers=1, Maximum hidden dimension=61442026.02 | 100 | 85.5 | 77.2 | 87.6 | |
| H-LRUm (window size)=5, Number of layers=1, Maximum hidden dimension=61442026.02 | 100 | 83.8 | 77.5 | 87.1 | |
| H-LRUm (window size)=8, Number of layers=1, Maximum hidden dimension=61442026.02 | 100 | 81 | 76.8 | 85.9 | |
| H-LRUm (window size)=2, Number of layers=1, Maximum hidden dimension=61442026.02 | 99.8 | 85.5 | 77 | 87.4 | |
| H-LRUm (window size)=1, Number of layers=1, Maximum hidden dimension=61442026.02 | 78.5 | 84.8 | 76 | 79.7 | |
| BD-LRUm (block size)=1, Number of layers=1, Maximum hidden dimension=61442026.02 | 77.5 | 83.5 | 72.5 | 77.8 |