Multi-objective Question Answering on Multi-objective QA 16-Objective
3.57EM ScoreABBEL
Evaluation results
| Method | Links | ||
|---|---|---|---|
| ABBELmode=Trained2025.12 | 3.57 | 10.12 | |
| ABBELlength_penalty=true2025.12 | 3.43 | 7.64 | |
| VANILLAmode=Full-context2025.12 | 3.06 | 96.08 | |
| MEM1variant=Instruct2025.12 | 2.5 | 10.58 | |
| MEM1variant=Base2025.12 | 1.97 | 10.4 | |
| ABBELmode=Zero-shot2025.12 | 1.62 | 9.46 | |
| VANILLAmodel_size=14B, mode=Zero-shot2025.12 | 0.57 | 38.4 | |
| VANILLAmode=Zero-shot2025.12 | 0.4 | 15.4 |