List your company
ResearchFormerly WizWand

Jacobian computation on Transformer

0.28Median Runtime (ms)AlphaGrad
-39.3124227.9363495.185762.4337Jun 7, 2024
Updated 8mo ago

Evaluation results

MethodLinks
AlphaGradAD Mode=AlphaGrad, Device=NVIDIA RTX 4090 (GPU), Batch Size=1, Compilation=JIT2024.060.28
ReverseAD Mode=Reverse, Device=NVIDIA RTX 4090 (GPU), Batch Size=1, Compilation=JIT2024.060.29
MarkowitzAD Mode=Markowitz, Device=NVIDIA RTX 4090 (GPU), Batch Size=1, Compilation=JIT2024.0616.17
ForwardAD Mode=Forward, Device=NVIDIA RTX 4090 (GPU), Batch Size=1, Compilation=JIT2024.0621.38
ReverseAD Mode=Reverse, Device=AMD EPYC 9684X (CPU), Batch Size=1, Compilation=XLA2024.0639.07
AlphaGradAD Mode=AlphaGrad, Device=AMD EPYC 9684X (CPU), Batch Size=1, Compilation=XLA2024.0640.38
MarkowitzAD Mode=Markowitz, Device=AMD EPYC 9684X (CPU), Batch Size=1, Compilation=XLA2024.06498.94
ForwardAD Mode=Forward, Device=AMD EPYC 9684X (CPU), Batch Size=1, Compilation=XLA2024.06990.09