Open-domain Question Answering on TriviaQA Open (eval)
76.94F1 ScoreTASR
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| TASRBackbone=Devstral, Retrieval Engine=BM252026.06 | 76.94 | 2.68 | 0.84 | 0.63 | |
| Fixed k=5Backbone=Devstral, Retrieval Engine=BM252026.06 | 76.89 | — | — | — | |
| Fixed k=3Backbone=Devstral, Retrieval Engine=BM252026.06 | 76.11 | — | — | — | |
| TASRBackbone=Qwen, Retrieval Engine=BM252026.06 | 71.72 | 2.53 | 0.3 | 1.63 | |
| Fixed k=5Backbone=Qwen, Retrieval Engine=BM252026.06 | 71.65 | — | — | — | |
| Fixed k=3Backbone=Qwen, Retrieval Engine=BM252026.06 | 71.42 | — | — | — | |
| Fixed k=5Backbone=Gemma, Retrieval Engine=BM252026.06 | 61.96 | — | — | — | |
| Fixed k=3Backbone=Gemma, Retrieval Engine=BM252026.06 | 59.18 | — | — | — | |
| TASRBackbone=Gemma, Retrieval Engine=BM252026.06 | 59.13 | 3.21 | 0.06 | 2.11 |