Question Answering on Pop-QA Cities 20 (Custom Metrics)
1.75Factual AccuracyInstructLab
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| InstructLabSize=5M2026.05 | 1.75 | 1.93 | 2.76 | 3 | 26.6 | |
| InstructLabSize=20M2026.05 | 1.73 | 1.91 | 2.76 | 2.99 | 26.6 | |
| EmbGenSize=20M2026.05 | 1.73 | 1.92 | 2.69 | 2.96 | 28.2 | |
| EmbGenSize=5M2026.05 | 1.68 | 1.93 | 2.53 | 2.83 | 26.6 | |
| Knowledge-InstructSize=5M2026.05 | 1.54 | 1.94 | 2.59 | 2.96 | 7.9 | |
| Knowledge-InstructSize=20M2026.05 | 1.54 | 1.95 | 2.6 | 2.99 | 5.4 | |
| EntiGraphSize=5M2026.05 | 1.39 | 2 | 2.22 | 2.88 | 0.8 | |
| EntiGraphSize=20M2026.05 | 1.35 | 2.01 | 2.14 | 2.81 | 0.8 | |
| Baseline: llama 8B InstructSize=5M2026.05 | 1.25 | 1.98 | 2.15 | 2.85 | 4.2 | |
| Baseline: llama 8B InstructSize=20M2026.05 | 1.25 | 1.98 | 2.15 | 2.85 | 4.2 |