Time Series Analysis on General Efficiency Profiling
0.104Training Time (s/iter)GPT-2(6)-768
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| GPT-2(6)-768Parameter=82.28M, Batch size=1282025.02 | 0.104 | 0.054 | 5,230 | 2,566 | |
| GTMParameter=35.73M, Batch size=1282025.02 | 0.29 | 0.165 | 8,324 | 1,250 | |
| FEDformer-768Parameter=30.75M, Batch size=1282025.02 | 0.467 | 0.172 | 9,535 | 1,880.19 | |
| Time-Moe(base)Parameter=50.00M, Batch size=1282025.02 | 0.84 | 0.095 | 1,812.48 | 226.7 | |
| TimesNet-768Parameter=42.21M, Batch size=1282025.02 | 1.849 | 0.547 | 35,871 | 1,904.18 |