PG19
Benchmarks
TaskDatasetSOTA resultTrendResults
PG19
1.26Speedup
26
PG19 tokens (test)
3.49Bits per Token
14
PG19 bytes (test)
0.935Bits Per Token
14
PG19 T5 (val)
15.31PPLX
10
PG19 32K
7.96Perplexity
8
PG19 16K
8.01Perplexity
8
PG19 4K
8.68Perplexity
8
PG19 100K
8.24Perplexity
6
PG19
6.77Compression Ratio (bits)
5
PG19 synthetic prompts
80Max Batch Size
4