Extractive Question Answering on SynthWiki 28K
96.5Score (Seed 42)Attn Sort k = 5
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Attn Sort k = 5Passes=5×(sort+gen), Backbone=LLaMA-2-7B-32K-Instruct2026.06 | 96.5 | 95 | 95 | 95.5 | 0.71 | |
| Attn Sort k = 1Passes=1 sort + 1 gen, Backbone=LLaMA-2-7B-32K-Instruct2026.06 | 94 | 96.5 | 94 | 94.83 | 1.44 | |
| Debiased k = 1Passes=1 sort + 1 gen, Backbone=LLaMA-2-7B-32K-Instruct2026.06 | 94 | 96.5 | 94 | 94.83 | 1.44 | |
| No SortingPasses=1 gen, Backbone=LLaMA-2-7B-32K-Instruct2026.06 | 70.5 | 76 | 72 | 72.83 | 2.84 |