Question Answering on SQuAD Short-form QA (F1, AIL, RCO)
74.79F1 ScoreBatch (Full)
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Batch (Full)Backbone=Qwen2.5-3B-Instruct, Processing Mode=Offline2026.05 | 74.79 | 77.55 | 100 | |
| Proactive-EntrBackbone=Qwen2.5-3B-Instruct, Processing Mode=Streaming2026.05 | 73.48 | 53.14 | 75 | |
| Proactive-AttnBackbone=Qwen2.5-3B-Instruct, Processing Mode=Streaming2026.05 | 71.69 | 59.17 | 89 | |
| Batch (Full)Backbone=Qwen-3-4B, Processing Mode=Offline2026.05 | 70.75 | 76.53 | 100 | |
| Proactive-EntrBackbone=Qwen-3-4B, Processing Mode=Streaming2026.05 | 62.48 | 49.41 | 71 | |
| Proactive-AttnBackbone=Qwen-3-4B, Processing Mode=Streaming2026.05 | 60.13 | 47.18 | 69 | |
| Wait-9Backbone=Qwen2.5-3B-Instruct, Processing Mode=Streaming, Wait-k interval=92026.05 | 15.14 | -21.32 | 19 | |
| Wait-7Backbone=Qwen2.5-3B-Instruct, Processing Mode=Streaming, Wait-k interval=72026.05 | 11.76 | -22.89 | 15 | |
| Wait-7Backbone=Qwen-3-4B, Processing Mode=Streaming, Wait-k interval=72026.05 | 9.83 | -16.81 | 30 | |
| Wait-5Backbone=Qwen2.5-3B-Instruct, Processing Mode=Streaming, Wait-k interval=52026.05 | 8.91 | -25.21 | 11 | |
| Wait-3Backbone=Qwen2.5-3B-Instruct, Processing Mode=Streaming, Wait-k interval=32026.05 | 8.03 | -27.44 | 14 | |
| Wait-9Backbone=Qwen-3-4B, Processing Mode=Streaming, Wait-k interval=92026.05 | 4.66 | 1.03 | 48 | |
| Wait-5Backbone=Qwen-3-4B, Processing Mode=Streaming, Wait-k interval=52026.05 | 3.74 | -3.46 | 45 | |
| Wait-3Backbone=Qwen-3-4B, Processing Mode=Streaming, Wait-k interval=32026.05 | 3.53 | -5.13 | 44 |