Text Reconstruction on IMDB
89.3ROUGE-LSOMP
Evaluation results
| Method | Links | |
|---|---|---|
| SOMPBatch Size=4, Model=GPT-J-6B2026.03 | 89.3 | |
| SOMPBatch Size=16, Model=GPT-J-6B2026.03 | 76.4 | |
| SOMPBatch Size=8, Model=GPT-J-6B2026.03 | 73.5 | |
| DAGERBatch Size=4, Model=GPT-J-6B2026.03 | 58.4 | |
| DAGERBatch Size=8, Model=GPT-J-6B2026.03 | 39.2 | |
| DAGERBatch Size=16, Model=GPT-J-6B2026.03 | 31.6 | |
| GRABBatch Size=4, Model=GPT-J-6B2026.03 | 8.6 | |
| GRABBatch Size=8, Model=GPT-J-6B2026.03 | 2 | |
| LAMPBatch Size=4, Model=GPT-J-6B2026.03 | 1.2 | |
| GRABBatch Size=16, Model=GPT-J-6B2026.03 | 0.9 | |
| LAMPBatch Size=8, Model=GPT-J-6B2026.03 | 0.3 | |
| LAMPBatch Size=16, Model=GPT-J-6B2026.03 | 0.1 |