Multi-hop Question Answering on HotpotQA (val) (F1)
80F1 ScoreGTBP
Evaluation results
| Method | Links | |
|---|---|---|
| GTBPBackbone=GPT-4.1-mini, Number of intermediate modules K=tuned over {1, 2, 4}, Mini-batch size=15, Number of iterations=152026.06 | 80 | |
| GEPABackbone=GPT-4.1-mini, Implementation=DSPy, Reflection mini-batch size=3, Metric-call budget=10002026.06 | 76.97 | |
| Few-shotBackbone=GPT-4.1-mini, Shot mode=few-shot, Number of examples=tuned over {1, 3, 5, 10}2026.06 | 76.59 | |
| Zero-shotBackbone=GPT-4.1-mini, Shot mode=zero-shot2026.06 | 75.35 |