Question Answering on 2WikiMHQA Covered Questions
66.9AccuracySPARQL
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| SPARQLModel=70B, GW=false2026.03 | 66.9 | 60 | 52.6 | |
| SPARQL + GWModel=70B, GW=true2026.03 | 66.7 | 57.6 | 49.6 | |
| Base + GWModel=70B, GW=true2026.03 | 61 | 56.1 | 50.4 | |
| SPARQL + GWModel=8B, GW=true2026.03 | 59.5 | 44.5 | 37.5 | |
| BaseModel=70B, GW=false2026.03 | 54.8 | 47.9 | 40.7 | |
| SPARQLModel=8B, GW=false2026.03 | 49.9 | 40.6 | 33.6 | |
| Base + GWModel=8B, GW=true2026.03 | 33.1 | 30.8 | 26.9 | |
| BaseModel=8B, GW=false2026.03 | 32.1 | 30.1 | 24.7 |