Decoder Reconstruction on GEMMA-3-4B-IT
99.1ROUGE-1 ScoreTIGER
Evaluation results
| Method | Links | ||
|---|---|---|---|
| TIGERBatch Size (B)=4, Noise Level (σ)=02026.06 | 99.1 | 99.1 | |
| TIGERBatch Size (B)=2, Noise Level (σ)=02026.06 | 98.9 | 98.9 | |
| TIGERBatch Size (B)=1, Noise Level (σ)=02026.06 | 98.8 | 98.8 | |
| TIGERBatch Size (B)=1, Noise Level (σ)=10−52026.06 | 97.4 | 97.4 | |
| TIGERBatch Size (B)=1, Noise Level (σ)=5 × 10−52026.06 | 95.9 | 95.9 | |
| TIGERBatch Size (B)=1, Noise Level (σ)=10−42026.06 | 94.1 | 94.1 | |
| DAGERBatch Size (B)=1, Noise Level (σ)=02026.06 | 93.7 | 93.7 | |
| TIGERBatch Size (B)=4, Noise Level (σ)=10−52026.06 | 92.9 | 92.9 | |
| DAGERBatch Size (B)=2, Noise Level (σ)=02026.06 | 92.2 | 92.2 | |
| TIGERBatch Size (B)=8, Noise Level (σ)=02026.06 | 92.2 | 92.2 | |
| DAGERBatch Size (B)=4, Noise Level (σ)=02026.06 | 90.6 | 90.4 | |
| TIGERBatch Size (B)=2, Noise Level (σ)=10−52026.06 | 89.8 | 89.4 | |
| DAGERBatch Size (B)=8, Noise Level (σ)=02026.06 | 85.8 | 85.7 | |
| TIGERBatch Size (B)=8, Noise Level (σ)=10−52026.06 | 83.9 | 83.9 | |
| TIGERBatch Size (B)=1, Noise Level (σ)=10−32026.06 | 71.1 | 67.8 | |
| TIGERBatch Size (B)=2, Noise Level (σ)=5 × 10−52026.06 | 63.6 | 63.1 | |
| TIGERBatch Size (B)=4, Noise Level (σ)=5 × 10−52026.06 | 54.9 | 54.3 | |
| TIGERBatch Size (B)=2, Noise Level (σ)=10−42026.06 | 49.6 | 49.6 | |
| TIGERBatch Size (B)=4, Noise Level (σ)=10−42026.06 | 42.2 | 41.6 | |
| TIGERBatch Size (B)=8, Noise Level (σ)=5 × 10−52026.06 | 39.7 | 38.9 | |
| TIGERBatch Size (B)=2, Noise Level (σ)=10−32026.06 | 38.1 | 35.8 | |
| TIGERBatch Size (B)=4, Noise Level (σ)=10−32026.06 | 27.8 | 26 | |
| TIGERBatch Size (B)=8, Noise Level (σ)=10−42026.06 | 27.8 | 26.7 | |
| TIGERBatch Size (B)=8, Noise Level (σ)=10−32026.06 | 19.4 | 17.8 | |
| DAGERBatch Size (B)=1, Noise Level (σ)=10−52026.06 | 0 | 0 | |
| DAGERBatch Size (B)=1, Noise Level (σ)=5 × 10−52026.06 | 0 | 0 | |
| DAGERBatch Size (B)=1, Noise Level (σ)=10−42026.06 | 0 | 0 | |
| DAGERBatch Size (B)=1, Noise Level (σ)=10−32026.06 | 0 | 0 | |
| DAGERBatch Size (B)=2, Noise Level (σ)=10−52026.06 | 0 | 0 | |
| DAGERBatch Size (B)=2, Noise Level (σ)=5 × 10−52026.06 | 0 | 0 | |
| DAGERBatch Size (B)=2, Noise Level (σ)=10−42026.06 | 0 | 0 | |
| DAGERBatch Size (B)=2, Noise Level (σ)=10−32026.06 | 0 | 0 | |
| DAGERBatch Size (B)=4, Noise Level (σ)=10−52026.06 | 0 | 0 | |
| DAGERBatch Size (B)=4, Noise Level (σ)=5 × 10−52026.06 | 0 | 0 | |
| DAGERBatch Size (B)=4, Noise Level (σ)=10−42026.06 | 0 | 0 | |
| DAGERBatch Size (B)=4, Noise Level (σ)=10−32026.06 | 0 | 0 | |
| DAGERBatch Size (B)=8, Noise Level (σ)=10−52026.06 | 0 | 0 | |
| DAGERBatch Size (B)=8, Noise Level (σ)=5 × 10−52026.06 | 0 | 0 | |
| DAGERBatch Size (B)=8, Noise Level (σ)=10−42026.06 | 0 | 0 | |
| DAGERBatch Size (B)=8, Noise Level (σ)=10−32026.06 | 0 | 0 |