Question Answering Evaluation on Wikitext-10
1.46Factual AccuracyEntiGraph
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| EntiGraphSize=20M2026.05 | 1.46 | 1.08 | 1.3 | 2.03 | 2 | |
| EntiGraphSize=5M2026.05 | 1.34 | 1.32 | 2.32 | 2.84 | 6.4 | |
| EmbGenSize=5M2026.05 | 1.32 | 1.38 | 2.76 | 2.98 | 7.2 | |
| EmbGenSize=20M2026.05 | 1.25 | 1.4 | 2.62 | 2.97 | 6.8 | |
| Knowledge-InstructSize=20M2026.05 | 1.2 | 1.36 | 2.59 | 2.97 | 2 | |
| Knowledge-InstructSize=5M2026.05 | 1.19 | 1.42 | 2.67 | 2.96 | 3.2 | |
| InstructLabSize=5M2026.05 | 1.18 | 1.44 | 2.86 | 2.98 | 3.6 | |
| InstructLabSize=20M2026.05 | 1.16 | 1.42 | 2.72 | 2.95 | 3.6 | |
| Baseline: llama 8B InstructSize=5M2026.05 | 1.05 | 1.38 | 2.02 | 2.9 | 0 | |
| Baseline: llama 8B InstructSize=20M2026.05 | 1.05 | 1.38 | 2.02 | 2.9 | 0 |