Open-domain Question Answering on HotpotQA fullwiki (eval)
55.16F1 ScoreFixed k=5
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Fixed k=5Backbone=Qwen, Retrieval Engine=BM252026.06 | 55.16 | — | — | — | |
| TASRBackbone=Qwen, Retrieval Engine=BM252026.06 | 53.83 | 2.68 | 0.05 | 2.28 | |
| Fixed k=3Backbone=Qwen, Retrieval Engine=BM252026.06 | 53.78 | — | — | — | |
| Fixed k=5Backbone=Devstral, Retrieval Engine=BM252026.06 | 52.54 | — | — | — | |
| Fixed k=3Backbone=Devstral, Retrieval Engine=BM252026.06 | 51.18 | — | — | — | |
| TASRBackbone=Devstral, Retrieval Engine=BM252026.06 | 50.81 | 2.72 | 0.38 | 2.31 | |
| Fixed k=5Backbone=Gemma, Retrieval Engine=BM252026.06 | 44.63 | — | — | — | |
| TASRBackbone=Gemma, Retrieval Engine=BM252026.06 | 43.84 | 3.62 | 2.15 | 0.27 | |
| Fixed k=3Backbone=Gemma, Retrieval Engine=BM252026.06 | 41.69 | — | — | — |