Question Answering on HotpotQA (out-of-domain)
64.9PrecisionKP
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| KPBackbone=Gemma-2-9B2026.02 | 64.9 | 42.4 | 51.3 | |
| VeriFY-NMBackbone=Gemma-2-9B2026.02 | 61.8 | 69.6 | 65.5 | |
| VeriFY-MMBackbone=Gemma-2-9B2026.02 | 56 | 80.7 | 66.1 | |
| SCBackbone=Gemma-2-9B2026.02 | 55.9 | 79.3 | 65.6 | |
| VeriFY-SMBackbone=Gemma-2-9B2026.02 | 54.3 | 81.9 | 65.3 | |
| KPBackbone=Gemma-2-2B2026.02 | 51.7 | 43 | 47 | |
| VeriFY-NMBackbone=Gemma-2-2B2026.02 | 48.8 | 59.9 | 53.8 | |
| SCBackbone=Gemma-2-2B2026.02 | 47.5 | 58.8 | 52.6 | |
| BaseBackbone=Gemma-2-9B2026.02 | 44.2 | — | — | |
| VeriFY-MMBackbone=Gemma-2-2B2026.02 | 42.4 | 73.6 | 53.8 | |
| VeriFY-SMBackbone=Gemma-2-2B2026.02 | 40.4 | 77.9 | 53.2 | |
| BaseBackbone=Gemma-2-2B2026.02 | 31.4 | — | — |