Text Reconstruction on CoLA
96.3ROUGE-LSOMP
Evaluation results
| Method | Links | |
|---|---|---|
| SOMPBatch Size=4, Model=GPT-J-6B2026.03 | 96.3 | |
| SOMPBatch Size=8, Model=GPT-J-6B2026.03 | 94.5 | |
| DAGERBatch Size=4, Model=GPT-J-6B2026.03 | 92.9 | |
| SOMPBatch Size=16, Model=GPT-J-6B2026.03 | 89.7 | |
| DAGERBatch Size=8, Model=GPT-J-6B2026.03 | 87.8 | |
| DAGERBatch Size=16, Model=GPT-J-6B2026.03 | 84.8 | |
| GRABBatch Size=4, Model=GPT-J-6B2026.03 | 42.6 | |
| GRABBatch Size=8, Model=GPT-J-6B2026.03 | 35.1 | |
| GRABBatch Size=16, Model=GPT-J-6B2026.03 | 24.3 | |
| LAMPBatch Size=4, Model=GPT-J-6B2026.03 | 10.6 | |
| LAMPBatch Size=8, Model=GPT-J-6B2026.03 | 6.3 | |
| LAMPBatch Size=16, Model=GPT-J-6B2026.03 | 1.4 |