Question Answering on SQuAD 2.0 (BLEU/ROUGE Evaluation)
5.1BLEU-1InstructLab
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| InstructLabSize=5M2026.05 | 5.1 | 2.8 | 1.3 | 13.1 | 5.1 | 12.6 | 13.3 | |
| InstructLabSize=20M2026.05 | 5 | 2.6 | 1.1 | 13.2 | 5 | 12.9 | 13 | |
| EmbGenSize=5M2026.05 | 4.3 | 2.3 | 1 | 11.7 | 4.4 | 11.2 | 11.8 | |
| EmbGenSize=20M2026.05 | 4.3 | 2.3 | 1 | 11.9 | 4.5 | 11.4 | 11.7 | |
| Knowledge-InstructSize=5M2026.05 | 3.6 | 1.8 | 0.8 | 6.9 | 2.2 | 6.5 | 11.9 | |
| Knowledge-InstructSize=20M2026.05 | 3.6 | 1.9 | 0.9 | 6.9 | 2.4 | 6.5 | 12.2 | |
| EntiGraph Squad 5MSize=5M2026.05 | 2.4 | 1.3 | 0.6 | 5.2 | 1.9 | 4.9 | 9.3 | |
| Baseline: llama 8B InstructSize=5M2026.05 | 1.9 | 1 | 0.4 | 4.1 | 1.4 | 3.9 | 8.3 | |
| Baseline: llama 8B InstructSize=20M2026.05 | 1.9 | 1 | 0.4 | 4.1 | 1.4 | 3.9 | 8.3 | |
| EntiGraphSize=20M2026.05 | 1.7 | 0.9 | 0.4 | 3.8 | 1.1 | 3.6 | 7.4 |