Machine Translation on IT All-domain datastore (test)
3,270.84Throughput (Tok/Sec)Base NMT
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Base NMTBatch Size=128, GPU=NVIDIA RTX A60002024.06 | 3,270.84 | — | |
| Base NMTBatch Size=64, GPU=NVIDIA RTX A60002024.06 | 3,150.95 | — | |
| kNN-MT-DRBatch Size=128, GPU=NVIDIA RTX A60002024.06 | 2,944.38 | — | |
| Faster kNN-MTBatch Size=128, GPU=NVIDIA RTX A60002024.06 | 2,912.67 | — | |
| kNN-MT-DRBatch Size=64, GPU=NVIDIA RTX A60002024.06 | 2,798.39 | — | |
| kNN-MT-ARBatch Size=64, GPU=NVIDIA RTX A6000, alpha=0.252024.06 | 2,789.59 | — | |
| Faster kNN-MTBatch Size=64, GPU=NVIDIA RTX A60002024.06 | 2,783.62 | — | |
| kNN-MT-ARBatch Size=128, GPU=NVIDIA RTX A6000, alpha=0.252024.06 | 2,724.76 | — | |
| Vanilla kNN-MTBatch Size=128, GPU=NVIDIA RTX A60002024.06 | 2,584.31 | — | |
| Base NMTBatch Size=32, GPU=NVIDIA RTX A60002024.06 | 2,559.84 | — | |
| Vanilla kNN-MTBatch Size=64, GPU=NVIDIA RTX A60002024.06 | 2,506.85 | — | |
| Faster kNN-MTBatch Size=32, GPU=NVIDIA RTX A60002024.06 | 2,131.48 | — | |
| kNN-MT-DRBatch Size=32, GPU=NVIDIA RTX A60002024.06 | 2,117.94 | — | |
| Vanilla kNN-MTBatch Size=32, GPU=NVIDIA RTX A60002024.06 | 2,101.97 | — | |
| kNN-MT-ARBatch Size=32, GPU=NVIDIA RTX A6000, alpha=0.252024.06 | 2,067.55 | — | |
| Base NMTBatch Size=16, GPU=NVIDIA RTX A60002024.06 | 1,577.03 | — | |
| kNN-MT-DRBatch Size=16, GPU=NVIDIA RTX A60002024.06 | 1,441.66 | — | |
| Faster kNN-MTBatch Size=16, GPU=NVIDIA RTX A60002024.06 | 1,396.32 | — | |
| Vanilla kNN-MTBatch Size=16, GPU=NVIDIA RTX A60002024.06 | 1,378.65 | — | |
| kNN-MT-ARBatch Size=16, GPU=NVIDIA RTX A6000, alpha=0.252024.06 | 1,369.49 | — | |
| kNN-MT-DR2024.06 | 886.54 | 45.24 | |
| Faster kNN-MT2024.06 | 762.51 | 43.79 | |
| kNN-MT-ARalpha=0.252024.06 | 569.73 | 43.56 | |
| SK-MT1Batch Size=128, GPU=NVIDIA RTX A60002024.06 | 524.65 | — | |
| SK-MT1Batch Size=64, GPU=NVIDIA RTX A60002024.06 | 518.82 | — | |
| SK-MT1Batch Size=32, GPU=NVIDIA RTX A60002024.06 | 486.17 | — | |
| Vanilla kNN-MT2024.06 | 467.21 | 45.72 | |
| SK-MT1Batch Size=16, GPU=NVIDIA RTX A60002024.06 | 410.57 | — | |
| SK-MT2Batch Size=128, GPU=NVIDIA RTX A60002024.06 | 385.95 | — | |
| SK-MT2Batch Size=64, GPU=NVIDIA RTX A60002024.06 | 381.87 | — | |
| SK-MT2Batch Size=32, GPU=NVIDIA RTX A60002024.06 | 360.76 | — | |
| SK-MT2Batch Size=16, GPU=NVIDIA RTX A60002024.06 | 318.62 | — | |
| SK-MT12024.06 | 306.53 | 45.36 | |
| SK-MT22024.06 | 258.14 | 45.51 | |
| Base NMTBatch Size=1, GPU=NVIDIA RTX A60002024.06 | 159.24 | — | |
| kNN-MT-DRBatch Size=1, GPU=NVIDIA RTX A60002024.06 | 139.84 | — | |
| Faster kNN-MTBatch Size=1, GPU=NVIDIA RTX A60002024.06 | 139.54 | — | |
| Vanilla kNN-MTBatch Size=1, GPU=NVIDIA RTX A60002024.06 | 136.19 | — | |
| kNN-MT-ARBatch Size=1, GPU=NVIDIA RTX A6000, alpha=0.252024.06 | 127.23 | — | |
| SK-MT1Batch Size=1, GPU=NVIDIA RTX A60002024.06 | 89.76 | — | |
| SK-MT2Batch Size=1, GPU=NVIDIA RTX A60002024.06 | 84.1 | — |