sys-bAbI task on sys-bAbI original (test)
7.95GapTPR-RNN
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| TPR-RNN2024.06 | 7.95 | 79 | 8.74 | — | |
| TPR-RNN# params=0.14 M2024.06 | 7.95 | — | — | 8.74 | |
| TPR-RNN2024.12 | 7.95 | — | — | — | |
| TPR-RNN + AIDAugmentation=AID2024.06 | 4.92 | 69 | 5.61 | — | |
| TPR-RNN + AID# params=0.32 M2024.06 | 4.92 | — | — | 5.61 | |
| TPR-RNN + AID2024.12 | 4.92 | — | — | — | |
| DAM2024.06 | 4.77 | 48 | 5.25 | — | |
| STM2024.06 | 3.7 | 49 | 4.79 | — | |
| TPR-RNN + D3Augmentation=D3, Dcode=642024.06 | 2.85 | 65 | 3.5 | — | |
| TPR-RNN + D3# params=0.17 M2024.06 | 2.85 | — | — | 3.5 | |
| FWM2024.06 | 2.06 | 79 | 2.85 | — | |
| FWM# params=0.73 M2024.06 | 2.06 | — | — | 2.85 | |
| FWM2024.12 | 2.06 | — | — | — | |
| TPR Autoencoder2024.12 | 1.97 | — | — | — | |
| FWM + D3 (w/o F)Augmentation=D3, Dcode=64, Filtering=false2024.06 | 1.79 | 79 | 2.58 | — | |
| FWM + D3 (w/o F)# params=0.75 M2024.06 | 1.79 | — | — | 2.58 | |
| FWM + D3 (w/ F)Augmentation=D3, Dcode=64, Filtering=true2024.06 | 1.21 | 75 | 1.96 | — | |
| FWM + D3 (w/ F)# params=0.75 M2024.06 | 1.21 | — | — | 1.96 | |
| Soft TPR Autoencoder2024.12 | 0.85 | — | — | — | |
| FWM + AIDAugmentation=AID2024.06 | 0.76 | 45 | 1.21 | — | |
| FWM + AID# params=1.23 M2024.06 | 0.76 | — | — | 1.21 | |
| FWM + AID2024.12 | 0.76 | — | — | — | |
| FWM# params=0.73 M2024.06 | — | 79 | — | — | |
| FWM + AID# params=1.23 M2024.06 | — | 45 | — | — | |
| FWM + D3 (w/ F)# params=0.75 M2024.06 | — | 75 | — | — | |
| FWM + D3 (w/o F)# params=0.75 M2024.06 | — | 79 | — | — | |
| TPR-RNN# params=0.14 M2024.06 | — | 79 | — | — | |
| TPR-RNN + AID# params=0.32 M2024.06 | — | 69 | — | — | |
| TPR-RNN + D3# params=0.17 M2024.06 | — | 65 | — | — |