Short-form generation on 1D-DiffTask Short-form generation
64PRRMSP
Evaluation results
| Method | Links | |
|---|---|---|
| MSPModel=Gemma-2-9B2026.04 | 64 | |
| HBOModel=Gemma-2-9B2026.04 | 64 | |
| MSPModel=Llama 3.1-8B2026.04 | 57 | |
| HBOModel=Llama 3.1-8B2026.04 | 57 | |
| SATRMD-MSPModel=Gemma-2-9B2026.04 | 52 | |
| SAPLMA (mid)Model=Llama 3.1-8B2026.04 | 32 | |
| SATMD-MSPModel=Gemma-2-9B2026.04 | 27 | |
| HUQ-SATMDModel=Llama 3.1-8B2026.04 | 24 | |
| HUQ-SATRMDModel=Llama 3.1-8B2026.04 | 22 | |
| SATRMD-MSPModel=Llama 3.1-8B2026.04 | 21 | |
| SAPLMA (mid)Model=Gemma-2-9B2026.04 | 21 | |
| HUQ-SATMDModel=Gemma-2-9B2026.04 | 17 | |
| HUQ-SATRMDModel=Gemma-2-9B2026.04 | 17 | |
| SATMD-MSPModel=Llama 3.1-8B2026.04 | 8 |