Decoder Reconstruction on Gemma 4B IT 3
98.6ROUGE-1TIGER
Evaluation results
| Method | Links | ||
|---|---|---|---|
| TIGERTotal token count (T)=32, Batch size (B)=1, Noise level (sigma)=5 x 10^-52026.06 | 98.6 | 98.6 | |
| TIGERTotal token count (T)=16, Batch size (B)=1, Noise level (sigma)=5 x 10^-52026.06 | 95.9 | 95.9 | |
| TIGERTotal token count (T)=64, Batch size (B)=1, Noise level (sigma)=5 x 10^-52026.06 | 94.6 | 94.4 | |
| TIGERTotal token count (T)=128, Batch size (B)=1, Noise level (sigma)=5 x 10^-52026.06 | 91.2 | 89.4 | |
| TIGERTotal token count (T)=32, Batch size (B)=2, Noise level (sigma)=5 x 10^-52026.06 | 63.6 | 63.1 | |
| TIGERTotal token count (T)=64, Batch size (B)=2, Noise level (sigma)=5 x 10^-52026.06 | 62.7 | 62.5 | |
| TIGERTotal token count (T)=32, Batch size (B)=4, Noise level (sigma)=5 x 10^-52026.06 | 58.8 | 58.4 | |
| TIGERTotal token count (T)=128, Batch size (B)=2, Noise level (sigma)=5 x 10^-52026.06 | 58.6 | 56.7 | |
| TIGERTotal token count (T)=64, Batch size (B)=8, Noise level (sigma)=5 x 10^-52026.06 | 57.9 | 57.7 | |
| TIGERTotal token count (T)=64, Batch size (B)=4, Noise level (sigma)=5 x 10^-52026.06 | 54.9 | 54.3 | |
| TIGERTotal token count (T)=128, Batch size (B)=4, Noise level (sigma)=5 x 10^-52026.06 | 42.3 | 40.7 | |
| TIGERTotal token count (T)=128, Batch size (B)=8, Noise level (sigma)=5 x 10^-52026.06 | 39.7 | 38.9 | |
| DAGERTotal token count (T)=16, Batch size (B)=1, Noise level (sigma)=5 x 10^-52026.06 | 0 | 0 | |
| DAGERTotal token count (T)=32, Batch size (B)=1, Noise level (sigma)=5 x 10^-52026.06 | 0 | 0 | |
| DAGERTotal token count (T)=32, Batch size (B)=2, Noise level (sigma)=5 x 10^-52026.06 | 0 | 0 | |
| DAGERTotal token count (T)=32, Batch size (B)=4, Noise level (sigma)=5 x 10^-52026.06 | 0 | 0 | |
| DAGERTotal token count (T)=64, Batch size (B)=1, Noise level (sigma)=5 x 10^-52026.06 | 0 | 0 | |
| DAGERTotal token count (T)=64, Batch size (B)=2, Noise level (sigma)=5 x 10^-52026.06 | 0 | 0 | |
| DAGERTotal token count (T)=64, Batch size (B)=4, Noise level (sigma)=5 x 10^-52026.06 | 0 | 0 | |
| DAGERTotal token count (T)=64, Batch size (B)=8, Noise level (sigma)=5 x 10^-52026.06 | 0 | 0 | |
| DAGERTotal token count (T)=128, Batch size (B)=1, Noise level (sigma)=5 x 10^-52026.06 | 0 | 0 | |
| DAGERTotal token count (T)=128, Batch size (B)=2, Noise level (sigma)=5 x 10^-52026.06 | 0 | 0 | |
| DAGERTotal token count (T)=128, Batch size (B)=4, Noise level (sigma)=5 x 10^-52026.06 | 0 | 0 | |
| DAGERTotal token count (T)=128, Batch size (B)=8, Noise level (sigma)=5 x 10^-52026.06 | 0 | 0 |