Density modeling on Classical music 5 seconds at 12 kHz (test)
1.97Bits per ByteSparse Transformer
Evaluation Results
| Method | Links | |
|---|---|---|
| Sparse TransformerNumber of parameters=152M, Attention pattern=strided2019.04 | 1.97 |
Loading the SOTA2 catalog…
| Method | Links | |
|---|---|---|
| Sparse TransformerNumber of parameters=152M, Attention pattern=strided2019.04 | 1.97 |