Jacobian computation on Transformer
0.28Median Runtime (ms)AlphaGrad
Evaluation Results
| Method | Links | |
|---|---|---|
| AlphaGradAD Mode=AlphaGrad, Device=NVIDIA RTX 4090 (GPU), Batch Size=1, Compilation=JIT2024.06 | 0.28 | |
| ReverseAD Mode=Reverse, Device=NVIDIA RTX 4090 (GPU), Batch Size=1, Compilation=JIT2024.06 | 0.29 | |
| MarkowitzAD Mode=Markowitz, Device=NVIDIA RTX 4090 (GPU), Batch Size=1, Compilation=JIT2024.06 | 16.17 | |
| ForwardAD Mode=Forward, Device=NVIDIA RTX 4090 (GPU), Batch Size=1, Compilation=JIT2024.06 | 21.38 | |
| ReverseAD Mode=Reverse, Device=AMD EPYC 9684X (CPU), Batch Size=1, Compilation=XLA2024.06 | 39.07 | |
| AlphaGradAD Mode=AlphaGrad, Device=AMD EPYC 9684X (CPU), Batch Size=1, Compilation=XLA2024.06 | 40.38 | |
| MarkowitzAD Mode=Markowitz, Device=AMD EPYC 9684X (CPU), Batch Size=1, Compilation=XLA2024.06 | 498.94 | |
| ForwardAD Mode=Forward, Device=AMD EPYC 9684X (CPU), Batch Size=1, Compilation=XLA2024.06 | 990.09 |