Question Answering with Clarification on AmbigQA Unambiguous queries (dev)
42.05RewardSGP-Oracle
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| SGP-OracleBase Model=Gemma-2-9b2025.12 | 42.05 | 48.66 | 20.03 | 10.32 | |
| SGPBase Model=Gemma-2-9b2025.12 | 31.36 | 41.28 | 26.46 | 13.99 | |
| AnswerBase Model=Gemma-2-9b2025.12 | 26.73 | 35.58 | 0 | 0 | |
| ClarifyBase Model=Gemma-2-9b2025.12 | 8.86 | 31.86 | 100 | 0 | |
| Prompted-COTBase Model=Gemma-2-9b2025.12 | -5.02 | 29.12 | 48.34 | 49.54 | |
| PromptedBase Model=Gemma-2-9b2025.12 | -15.01 | 33.07 | 64.78 | 58.07 | |
| Multi-answer (MA)Base Model=Gemma-2-9b2025.12 | -25.4 | 33.76 | 0 | 100 | |
| Clarify-and-MABase Model=Gemma-2-9b2025.12 | -35.26 | 32.28 | 100 | 100 |