PG19
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
PG19
1.26Speedup
26
PG19 tokens (test)
3.49Bits per Token
14
PG19 bytes (test)
0.935Bits Per Token
14
PG19 T5 (val)
15.31PPLX
10
PG19 32K
7.96Perplexity
8
PG19 16K
8.01Perplexity
8
PG19 4K
8.68Perplexity
8
PG19 100K
8.24Perplexity
6
PG19
6.77Compression Ratio (bits)
5
PG19 synthetic prompts
80Max Batch Size
4