Machine Translation on IWSLT14 en-fr (test)
40.9BLEUTransformer w/ LABO
Evaluation results
| Method | Links | |
|---|---|---|
| Transformer w/ LABObeam size=5, Backbone=6-layer encoder-decoder transformer2023.05 | 40.9 | |
| Standard enc + PRF decComplexity (encoder/decoder)=O(n²)/O(n), Encoder Attention=softmax, Decoder Attention=PRF2021.06 | 40.6 | |
| Transformer w/ LSbeam size=5, Backbone=6-layer encoder-decoder transformer2023.05 | 40.5 | |
| Transformer w/ AFLbeam size=5, Backbone=6-layer encoder-decoder transformer2023.05 | 40.5 | |
| NPRF enc-dec w/ RPEComplexity (encoder/decoder)=O(nlogn)/O(nlogn), Relative Positional Encoding=true2021.06 | 40.4 | |
| Transformer w/ CPbeam size=5, Backbone=6-layer encoder-decoder transformer2023.05 | 40.4 | |
| Standard enc-decComplexity (encoder/decoder)=O(n²)/O(n²), Encoder Attention=softmax, Decoder Attention=softmax2021.06 | 40.2 | |
| Transformerbeam size=5, Backbone=6-layer encoder-decoder transformer2023.05 | 40 | |
| Transformer w/ FLbeam size=5, Backbone=6-layer encoder-decoder transformer2023.05 | 39.2 | |
| PRF enc-decComplexity (encoder/decoder)=O(n)/O(n), Encoder Attention=PRF, Decoder Attention=PRF2021.06 | 38.2 |