Transformer
Benchmarks
TaskDatasetSOTA resultTrendResults
12-layer Transformer 1024 tokens (inference)
342.74Speedup
24
Transformer
0.28Median Runtime (ms)
8
Transformer 128 tokens
93.29Scaling Efficiency (Linear Projection)
5
Transformer
4,656Number of Multiplications
5