Gradient Compression on CIFAR-10 ConvNet gradients
1.1738Compression RateLM-GC
Evaluation Results
| Method | Links | |
|---|---|---|
| LM-GCLLM=Tinyllama 1.1B, Serialization=ISO2024.09 | 1.1738 | |
| LM-GCLLM=LLAMA 2 7B, Serialization=ISO2024.09 | 1.0907 | |
| LM-GCLLM=LLAMA 2 7B, Serialization=Hn2024.09 | 0.721 | |
| LM-GCLLM=Openllama 3B, Serialization=ISO2024.09 | 0.7185 | |
| FLACChunking mode=Unchunked2024.09 | 0.5237 | |
| FLACChunking mode=Chunked2024.09 | 0.5046 | |
| FPZIPChunking mode=Chunked2024.09 | 0.4927 | |
| PNGChunking mode=Chunked2024.09 | 0.4918 | |
| LZMAChunking mode=Chunked2024.09 | 0.4736 | |
| GZIPChunking mode=Chunked2024.09 | 0.471 | |
| LM-GCLLM=Tinyllama 1.1B, Serialization=Hsemi2024.09 | 0.4345 | |
| PNGChunking mode=Unchunked2024.09 | 0.433 | |
| GZIPChunking mode=Unchunked2024.09 | 0.4242 | |
| LZMAChunking mode=Unchunked2024.09 | 0.4191 | |
| FPZIPChunking mode=Unchunked2024.09 | 0.4126 | |
| LM-GCLLM=Tinyllama 1.1B, Serialization=Hs2024.09 | 0.3883 | |
| LM-GCLLM=Tinyllama 1.1B, Serialization=Hc+s2024.09 | 0.3846 | |
| LM-GCLLM=Tinyllama 1.1B, Serialization=Hc2024.09 | 0.384 | |
| LM-GCLLM=Openllama 3B, Serialization=Hn2024.09 | 0.3707 | |
| LM-GCLLM=Tinyllama 1.1B, Serialization=Hn2024.09 | 0.363 | |
| LM-GCLLM=Openllama 3B, Serialization=Hc2024.09 | 0.3431 | |
| LM-GCLLM=Openllama 3B, Serialization=Hsemi2024.09 | 0.3357 | |
| LM-GCLLM=Openllama 3B, Serialization=Hc+s2024.09 | 0.3307 | |
| LM-GCLLM=LLAMA 2 7B, Serialization=Hc2024.09 | 0.3296 | |
| LM-GCLLM=LLAMA 2 7B, Serialization=Hsemi2024.09 | 0.3278 | |
| LM-GCLLM=Openllama 3B, Serialization=Hs2024.09 | 0.3232 | |
| LM-GCLLM=LLAMA 2 7B, Serialization=Hs2024.09 | 0.3226 | |
| LM-GCLLM=LLAMA 2 7B, Serialization=Hc+s2024.09 | 0.3221 |