Graph Transformer Efficiency Benchmarking on ogbn-arxiv
4.84Latency Speedup (Forward)Ours
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| OursHidden dimension (D)=512, Aggregation operator=min-aggregation2026.05 | 4.84 | 2.09 | 1.71 | 1.37 | |
| CSR fused kernelsHeads (H)=8, Head Dimension (D)=1282026.05 | 3.11 | 1.16 | 6.73 | 4.11 | |
| cuGraphHidden dimension (D)=512, Aggregation operator=min-aggregation2026.05 | 2.87 | 1.45 | 1.19 | 1.14 | |
| CSR fused kernelsHeads (H)=2, Head Dimension (D)=642026.05 | 2.82 | 0.98 | 4.67 | 3.46 | |
| DF-GNNNumber of Heads (H)=4, Head Dimension (D)=1282026.05 | 1.62 | 1.19 | 1.18 | 1.14 | |
| Ours (WSB/TC)Number of Heads (H)=4, Head Dimension (D)=1282026.05 | 1.56 | 0.77 | 1.08 | 1.21 | |
| Ours (CSR fused)Number of Heads (H)=4, Head Dimension (D)=1282026.05 | 1.27 | 1.24 | 1.19 | 1.01 | |
| PyGHeads (H)=2, Head Dimension (D)=642026.05 | 0.95 | 0.95 | 0.58 | 0.69 | |
| PyGHeads (H)=8, Head Dimension (D)=1282026.05 | 0.46 | 0.54 | 0.55 | 0.64 |