Short-form generation on Short-form generation 1D-SameTask
0.64PRRMSP
Evaluation Results
| Method | Links | |
|---|---|---|
| MSPModel=Gemma-2-9B2026.04 | 0.64 | |
| HBOModel=Gemma-2-9B2026.04 | 0.64 | |
| MSPModel=Llama 3.1-8B2026.04 | 0.57 | |
| HBOModel=Llama 3.1-8B2026.04 | 0.57 | |
| SATRMD-MSPModel=Gemma-2-9B2026.04 | 0.41 | |
| SAPLMA (mid)Model=Llama 3.1-8B2026.04 | 0.3 | |
| HUQ-SATRMDModel=Gemma-2-9B2026.04 | 0.23 | |
| SAPLMA (mid)Model=Gemma-2-9B2026.04 | 0.11 | |
| SATRMD-MSPModel=Llama 3.1-8B2026.04 | 0.05 | |
| SATMD-MSPModel=Llama 3.1-8B2026.04 | 0.04 | |
| SATMD-MSPModel=Gemma-2-9B2026.04 | -0.07 | |
| HUQ-SATRMDModel=Llama 3.1-8B2026.04 | -0.08 | |
| HUQ-SATMDModel=Llama 3.1-8B2026.04 | -0.12 | |
| HUQ-SATMDModel=Gemma-2-9B2026.04 | -0.35 |