Sequence Generation on Sequence modeling Context Length 4096 (test)
8,203.82Throughput (TP)PGM 8/8
Evaluation Results
| Method | Links | |
|---|---|---|
| PGM 8/8Inference Steps=64, Context Length=4096, PGM configuration=8/82025.05 | 8,203.82 | |
| PGM 6/6 (dim=1024)Inference Steps=64, Context Length=4096, PGM configuration=6/6, Model Dimension=10242025.05 | 8,175.69 | |
| PGM 8/8Inference Steps=256, Context Length=4096, PGM configuration=8/82025.05 | 2,216.91 | |
| PGM 6/6 (dim=1024)Inference Steps=256, Context Length=4096, PGM configuration=6/6, Model Dimension=10242025.05 | 2,146.6 | |
| MDLMInference Steps=64, Context Length=40962025.05 | 1,912.16 | |
| PGM 6/6 (dim=1024)Inference Steps=1024, Context Length=4096, PGM configuration=6/6, Model Dimension=10242025.05 | 706.65 | |
| PGM 8/8Inference Steps=1024, Context Length=4096, PGM configuration=8/82025.05 | 697.36 | |
| MDLMInference Steps=256, Context Length=40962025.05 | 483.53 | |
| PGM 6/6 (dim=1024)Inference Steps=4096, Context Length=4096, PGM configuration=6/6, Model Dimension=10242025.05 | 129.01 | |
| PGM 8/8Inference Steps=4096, Context Length=4096, PGM configuration=8/82025.05 | 128.99 | |
| MDLMInference Steps=1024, Context Length=40962025.05 | 121.25 | |
| MDLMInference Steps=4096, Context Length=40962025.05 | 30.45 |