Text Reconstruction on EMBEDDINGGEMMA 300M
90.8ROUGE-1TIGER
Evaluation results
| Method | Links | ||
|---|---|---|---|
| TIGERBatch size (B)=1, Noise level (sigma)=0, Total token count (Tmax)=322026.06 | 90.8 | 86.7 | |
| TIGERTotal token count (T)=16, Batch size (B)=12026.06 | 90.8 | 86.7 | |
| TIGERBatch size (B)=2, Noise level (sigma)=0, Total token count (Tmax)=322026.06 | 87.8 | 75.9 | |
| TIGERTotal token count (T)=32, Batch size (B)=22026.06 | 87.8 | 75.9 | |
| TIGERTotal token count (T)=32, Batch size (B)=12026.06 | 84.6 | 75.1 | |
| TIGERTotal token count (T)=32, Batch size (B)=42026.06 | 83.9 | 79.7 | |
| TIGERTotal token count (T)=64, Batch size (B)=12026.06 | 83.3 | 56.2 | |
| TIGERTotal token count (T)=128, Batch size (B)=12026.06 | 82.1 | 43.8 | |
| TIGERBatch size (B)=4, Noise level (sigma)=0, Total token count (Tmax)=322026.06 | 80.9 | 66.6 | |
| TIGERTotal token count (T)=64, Batch size (B)=42026.06 | 80.9 | 66.6 | |
| TIGERTotal token count (T)=64, Batch size (B)=82026.06 | 80.9 | 74.2 | |
| TIGERTotal token count (T)=128, Batch size (B)=22026.06 | 79.4 | 52.2 | |
| TIGERTotal token count (T)=64, Batch size (B)=22026.06 | 79 | 59.5 | |
| TIGERTotal token count (T)=128, Batch size (B)=42026.06 | 72.2 | 54.1 | |
| TIGERBatch size (B)=8, Noise level (sigma)=0, Total token count (Tmax)=322026.06 | 71 | 56.7 | |
| TIGERTotal token count (T)=128, Batch size (B)=82026.06 | 71 | 56.7 | |
| TIGERTotal token count (T)=256, Batch size (B)=22026.06 | 68.7 | 35.8 | |
| TIGERTotal token count (T)=256, Batch size (B)=42026.06 | 66.2 | 38 | |
| TIGERTotal token count (T)=256, Batch size (B)=12026.06 | 64.5 | 26.5 | |
| TIGERBatch size (B)=16, Noise level (sigma)=0, Total token count (Tmax)=322026.06 | 60.3 | 50.7 | |
| TIGERTotal token count (T)=256, Batch size (B)=162026.06 | 60.3 | 50.7 | |
| TIGERTotal token count (T)=256, Batch size (B)=82026.06 | 57.9 | 41.8 | |
| TIGERBatch size (B)=1, Noise level (sigma)=10^−5, Total token count (Tmax)=322026.06 | 48.1 | 41.4 | |
| TIGERBatch size (B)=2, Noise level (sigma)=10^−5, Total token count (Tmax)=322026.06 | 27.9 | 24.1 | |
| LAMPTotal token count (T)=256, Batch size (B)=12026.06 | 26.8 | 17 | |
| LAMPBatch size (B)=16, Noise level (sigma)=0, Total token count (Tmax)=322026.06 | 23.3 | 17.4 | |
| LAMPTotal token count (T)=256, Batch size (B)=162026.06 | 23.3 | 17.4 | |
| LAMPTotal token count (T)=256, Batch size (B)=42026.06 | 23.1 | 15.7 | |
| LAMPBatch size (B)=16, Noise level (sigma)=10^−5, Total token count (Tmax)=322026.06 | 22.9 | 18.3 | |
| LAMPTotal token count (T)=128, Batch size (B)=12026.06 | 22.9 | 15.7 | |
| TIGERBatch size (B)=16, Noise level (sigma)=10^−5, Total token count (Tmax)=322026.06 | 22.3 | 17.5 | |
| LAMPTotal token count (T)=256, Batch size (B)=22026.06 | 22.1 | 15.8 | |
| LAMPTotal token count (T)=256, Batch size (B)=82026.06 | 21.8 | 16.9 | |
| TIGERBatch size (B)=8, Noise level (sigma)=10^−5, Total token count (Tmax)=322026.06 | 21.3 | 16.8 | |
| TIGERBatch size (B)=4, Noise level (sigma)=10^−5, Total token count (Tmax)=322026.06 | 20.4 | 17.7 | |
| LAMPTotal token count (T)=64, Batch size (B)=82026.06 | 20.3 | 18.6 | |
| LAMPBatch size (B)=8, Noise level (sigma)=10^−5, Total token count (Tmax)=322026.06 | 19.1 | 15.6 | |
| LAMPTotal token count (T)=128, Batch size (B)=42026.06 | 19.1 | 13.9 | |
| LAMPBatch size (B)=8, Noise level (sigma)=0, Total token count (Tmax)=322026.06 | 18.5 | 15.2 | |
| LAMPTotal token count (T)=128, Batch size (B)=82026.06 | 18.5 | 15.2 | |
| LAMPTotal token count (T)=128, Batch size (B)=22026.06 | 18 | 12.6 | |
| LAMPTotal token count (T)=64, Batch size (B)=12026.06 | 17.6 | 12.7 | |
| LAMPBatch size (B)=2, Noise level (sigma)=10^−5, Total token count (Tmax)=322026.06 | 17.1 | 14.9 | |
| LAMPBatch size (B)=4, Noise level (sigma)=10^−5, Total token count (Tmax)=322026.06 | 16.2 | 12.8 | |
| LAMPBatch size (B)=4, Noise level (sigma)=0, Total token count (Tmax)=322026.06 | 16 | 12.2 | |
| LAMPTotal token count (T)=64, Batch size (B)=42026.06 | 16 | 12.2 | |
| LAMPBatch size (B)=2, Noise level (sigma)=0, Total token count (Tmax)=322026.06 | 15.2 | 12.6 | |
| LAMPTotal token count (T)=32, Batch size (B)=22026.06 | 15.2 | 12.6 | |
| LAMPTotal token count (T)=64, Batch size (B)=22026.06 | 13.8 | 12 | |
| LAMPTotal token count (T)=32, Batch size (B)=42026.06 | 12.7 | 10.8 | |
| LAMPBatch size (B)=1, Noise level (sigma)=0, Total token count (Tmax)=322026.06 | 9.8 | 9.8 | |
| LAMPTotal token count (T)=16, Batch size (B)=12026.06 | 9.8 | 9.8 | |
| LAMPTotal token count (T)=32, Batch size (B)=12026.06 | 9.6 | 7.5 | |
| LAMPBatch size (B)=1, Noise level (sigma)=10^−5, Total token count (Tmax)=322026.06 | 5.9 | 5.9 |