Open-domain Question Answering on NQ-Open (eval)
50.43F1 ScoreFixed k=3
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Fixed k=3Backbone=Devstral, Retrieval Engine=BM252026.06 | 50.43 | — | — | — | |
| Fixed k=5Backbone=Devstral, Retrieval Engine=BM252026.06 | 50.3 | — | — | — | |
| TASRBackbone=Devstral, Retrieval Engine=BM252026.06 | 49.61 | 2.76 | 0.81 | 2.39 | |
| Fixed k=5Backbone=Qwen, Retrieval Engine=BM252026.06 | 48.46 | — | — | — | |
| TASRBackbone=Qwen, Retrieval Engine=BM252026.06 | 46.2 | 2.85 | 1.05 | 1.25 | |
| Fixed k=3Backbone=Qwen, Retrieval Engine=BM252026.06 | 45.15 | — | — | — | |
| TASRBackbone=Gemma, Retrieval Engine=BM252026.06 | 43.02 | 3.78 | 2.98 | 0.92 | |
| Fixed k=5Backbone=Gemma, Retrieval Engine=BM252026.06 | 42.85 | — | — | — | |
| Fixed k=3Backbone=Gemma, Retrieval Engine=BM252026.06 | 40.04 | — | — | — |