Sparse GEMM Performance on Matrix Dimensions (M, N, K) H20 GPU
0.135Runtime (ms)RT-Lynx-Kernel
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| RT-Lynx-KernelM=N=2048, K=3072, GPU=H202026.05 | 0.135 | 1.47 | 8.33 | |
| Pytorch-GEMMM=N=2048, K=3072, GPU=H202026.05 | 0.199 | — | — | |
| CUTLASSM=N=2048, K=3072, GPU=H202026.05 | 0.216 | 0.92 | — | |
| Pytorch-SpMMM=N=2048, K=3072, GPU=H202026.05 | 0.221 | 0.9 | — | |
| cuSparseLtM=N=2048, K=3072, GPU=H202026.05 | 0.282 | 0.71 | — | |
| RT-Lynx-KernelM=N=2048, K=12288, GPU=H202026.05 | 0.454 | 1.72 | 9.39 | |
| RT-Lynx-KernelM=N=4096, K=3072, GPU=H202026.05 | 0.465 | 1.68 | 4.6 | |
| CUTLASSM=N=4096, K=3072, GPU=H202026.05 | 0.616 | 1.26 | — | |
| cuSparseLtM=N=4096, K=3072, GPU=H202026.05 | 0.709 | 1.1 | — | |
| Pytorch-SpMMM=N=4096, K=3072, GPU=H202026.05 | 0.715 | 1.09 | — | |
| Pytorch-GEMMM=N=4096, K=3072, GPU=H202026.05 | 0.781 | — | — | |
| Pytorch-GEMMM=N=2048, K=12288, GPU=H202026.05 | 0.781 | — | — | |
| CUTLASSM=N=2048, K=12288, GPU=H202026.05 | 0.801 | 0.97 | — | |
| cuSparseLtM=N=2048, K=12288, GPU=H202026.05 | 1.137 | 0.69 | — | |
| Pytorch-SpMMM=N=2048, K=12288, GPU=H202026.05 | 1.259 | 0.62 | — | |
| RT-Lynx-KernelM=N=4096, K=12288, GPU=H202026.05 | 1.652 | 1.88 | 4.83 | |
| RT-Lynx-KernelM=N=8192, K=3072, GPU=H202026.05 | 1.802 | 1.66 | 2.28 | |
| CUTLASSM=N=8192, K=3072, GPU=H202026.05 | 2.044 | 1.46 | — | |
| cuSparseLtM=N=8192, K=3072, GPU=H202026.05 | 2.066 | 1.5 | — | |
| Pytorch-SpMMM=N=8192, K=3072, GPU=H202026.05 | 2.087 | 1.43 | — | |
| CUTLASSM=N=4096, K=12288, GPU=H202026.05 | 2.287 | 1.35 | — | |
| Pytorch-SpMMM=N=4096, K=12288, GPU=H202026.05 | 2.648 | 1.17 | — | |
| cuSparseLtM=N=4096, K=12288, GPU=H202026.05 | 2.669 | 1.16 | — | |
| Pytorch-GEMMM=N=8192, K=3072, GPU=H202026.05 | 2.994 | — | — | |
| Pytorch-GEMMM=N=4096, K=12288, GPU=H202026.05 | 3.099 | — | — | |
| RT-Lynx-KernelM=N=8192, K=12288, GPU=H202026.05 | 6.754 | 1.77 | 2.37 | |
| CUTLASSM=N=8192, K=12288, GPU=H202026.05 | 7.497 | 1.59 | — | |
| cuSparseLtM=N=8192, K=12288, GPU=H202026.05 | 8.202 | 1.45 | — | |
| Pytorch-SpMMM=N=8192, K=12288, GPU=H202026.05 | 8.217 | 1.45 | — | |
| Pytorch-GEMMM=N=8192, K=12288, GPU=H202026.05 | 11.95 | — | — |