Text Reconstruction on SST-2 (ROUGE-L)
100ROUGE-LDAGER
Evaluation results
| Method | Links | |
|---|---|---|
| DAGERBatch Size=4, Model=GPT-J-6B2026.03 | 100 | |
| SOMPBatch Size=4, Model=GPT-J-6B2026.03 | 100 | |
| SOMPBatch Size=8, Model=GPT-J-6B2026.03 | 95.8 | |
| DAGERBatch Size=8, Model=GPT-J-6B2026.03 | 92.9 | |
| SOMPBatch Size=16, Model=GPT-J-6B2026.03 | 92.6 | |
| DAGERBatch Size=16, Model=GPT-J-6B2026.03 | 87.1 | |
| GRABBatch Size=4, Model=GPT-J-6B2026.03 | 43.3 | |
| GRABBatch Size=8, Model=GPT-J-6B2026.03 | 36.4 | |
| GRABBatch Size=16, Model=GPT-J-6B2026.03 | 22.3 | |
| LAMPBatch Size=4, Model=GPT-J-6B2026.03 | 12.9 | |
| LAMPBatch Size=8, Model=GPT-J-6B2026.03 | 7.2 | |
| LAMPBatch Size=16, Model=GPT-J-6B2026.03 | 1.8 |