List your company
ResearchFormerly WizWand

Transformer Inference on 12-layer Transformer 1024 tokens

342.74SpeedupASTRA
-12.284879.8851172.055264.2249May 25, 2025
Updated 5mo ago

Evaluation results

MethodLinks
ASTRABandwidth (Mbps)=10, Number of devices=4, Input token length=1024, Baseline model=TP2025.05342.74
ASTRABandwidth (Mbps)=20, Number of devices=4, Input token length=1024, Baseline model=TP2025.05177.89
ASTRABandwidth (Mbps)=10, Number of devices=4, Input token length=1024, Baseline model=SP2025.05171.82
ASTRABandwidth (Mbps)=20, Number of devices=4, Input token length=1024, Baseline model=SP2025.0589.41
ASTRABandwidth (Mbps)=50, Number of devices=4, Input token length=1024, Baseline model=TP2025.0573.14
ASTRABandwidth (Mbps)=100, Number of devices=4, Input token length=1024, Baseline model=TP2025.0537.19
ASTRABandwidth (Mbps)=50, Number of devices=4, Input token length=1024, Baseline model=SP2025.0537.05
ASTRABandwidth (Mbps)=10, Number of devices=4, Input token length=1024, Baseline model=BP+SP, Nb=12025.0529.37
ASTRABandwidth (Mbps)=100, Number of devices=4, Input token length=1024, Baseline model=SP2025.0519.08
ASTRABandwidth (Mbps)=200, Number of devices=4, Input token length=1024, Baseline model=TP2025.0519.02
ASTRABandwidth (Mbps)=20, Number of devices=4, Input token length=1024, Baseline model=BP+SP, Nb=12025.0515.66
ASTRABandwidth (Mbps)=10, Number of devices=4, Input token length=1024, Baseline model=BP+AG, Nb=12025.0515.25
ASTRABandwidth (Mbps)=200, Number of devices=4, Input token length=1024, Baseline model=SP2025.059.99
ASTRABandwidth (Mbps)=20, Number of devices=4, Input token length=1024, Baseline model=BP+AG, Nb=12025.058.41
ASTRABandwidth (Mbps)=500, Number of devices=4, Input token length=1024, Baseline model=TP2025.058.05
ASTRABandwidth (Mbps)=50, Number of devices=4, Input token length=1024, Baseline model=BP+SP, Nb=12025.056.95
ASTRABandwidth (Mbps)=500, Number of devices=4, Input token length=1024, Baseline model=SP2025.054.51
ASTRABandwidth (Mbps)=50, Number of devices=4, Input token length=1024, Baseline model=BP+AG, Nb=12025.054.07
ASTRABandwidth (Mbps)=100, Number of devices=4, Input token length=1024, Baseline model=BP+SP, Nb=12025.053.96
ASTRABandwidth (Mbps)=100, Number of devices=4, Input token length=1024, Baseline model=BP+AG, Nb=12025.052.58
ASTRABandwidth (Mbps)=200, Number of devices=4, Input token length=1024, Baseline model=BP+SP, Nb=12025.052.45
ASTRABandwidth (Mbps)=200, Number of devices=4, Input token length=1024, Baseline model=BP+AG, Nb=12025.051.83
ASTRABandwidth (Mbps)=500, Number of devices=4, Input token length=1024, Baseline model=BP+SP, Nb=12025.051.53
ASTRABandwidth (Mbps)=500, Number of devices=4, Input token length=1024, Baseline model=BP+AG, Nb=12025.051.37