Machine Translation on IWSLT14 fr-en (test)
40.3BLEUStandard enc + PRF dec
Evaluation results
| Method | Links | |
|---|---|---|
| Standard enc + PRF decComplexity (encoder/decoder)=O(n²)/O(n), Encoder Attention=softmax, Decoder Attention=PRF2021.06 | 40.3 | |
| Transformer w/ LABObeam size=5, Backbone=6-layer encoder-decoder transformer2023.05 | 40.3 | |
| Standard enc-decComplexity (encoder/decoder)=O(n²)/O(n²), Encoder Attention=softmax, Decoder Attention=softmax2021.06 | 40 | |
| NPRF enc-dec w/ RPEComplexity (encoder/decoder)=O(nlogn)/O(nlogn), Relative Positional Encoding=true2021.06 | 39.9 | |
| Transformer w/ LSbeam size=5, Backbone=6-layer encoder-decoder transformer2023.05 | 39.8 | |
| Transformer w/ AFLbeam size=5, Backbone=6-layer encoder-decoder transformer2023.05 | 39.5 | |
| Transformer w/ CPbeam size=5, Backbone=6-layer encoder-decoder transformer2023.05 | 39.2 | |
| Transformerbeam size=5, Backbone=6-layer encoder-decoder transformer2023.05 | 39 | |
| Transformer w/ FLbeam size=5, Backbone=6-layer encoder-decoder transformer2023.05 | 38.3 | |
| PRF enc-decComplexity (encoder/decoder)=O(n)/O(n), Encoder Attention=PRF, Decoder Attention=PRF2021.06 | 38 |