Multi-objective Question Answering on Multi-objective QA 8-Objective
2.54EM ScoreVANILLA
Evaluation results
| Method | Links | ||
|---|---|---|---|
| VANILLAmode=Full-context2025.12 | 2.54 | 64.07 | |
| ABBELmode=Trained2025.12 | 2.4 | 8.95 | |
| ABBELlength_penalty=true2025.12 | 2.19 | 7.61 | |
| MEM1variant=Instruct2025.12 | 1.88 | 9.13 | |
| MEM1variant=Base2025.12 | 1.87 | 8.01 | |
| VANILLAmodel_size=14B, mode=Zero-shot2025.12 | 1.55 | 44.7 | |
| ABBELmode=Zero-shot2025.12 | 1.28 | 8.67 | |
| VANILLAmode=Zero-shot2025.12 | 0.37 | 16.06 |