Position Embedding Application on Positional Embedding Operator
1.6Latency (ms)RoME
Evaluation results
| Method | Links | ||
|---|---|---|---|
| RoMEMode=interleave, Dimension=2D (dim=64+64)2026.04 | 1.6 | 3.3 | |
| RoMEMode=interleave, Dimension=3D (dim=44+44+40)2026.04 | 1.6 | 3.6 | |
| RoMEMode=half, Dimension=2D (dim=64+64)2026.04 | 1.6 | 2.1 | |
| RoMEMode=half, Dimension=3D (dim=44+44+40)2026.04 | 1.6 | 3.6 | |
| RoPE+fuseMode=interleave, Dimension=2D (dim=64+64)2026.04 | 2 | — | |
| RoPE+fuseMode=half, Dimension=2D (dim=64+64)2026.04 | 2.2 | — | |
| RoPEMode=half, Dimension=2D (dim=64+64)2026.04 | 5 | — | |
| RoPEMode=interleave, Dimension=2D (dim=64+64)2026.04 | 5.2 | — | |
| RoPEMode=interleave, Dimension=3D (dim=44+44+40)2026.04 | 5.7 | — | |
| RoPEMode=half, Dimension=3D (dim=44+44+40)2026.04 | 5.8 | — | |
| RoPE+fuseMode=half, Dimension=3D (dim=44+44+40)2026.04 | 9.9 | — |