End-to-end Generation on NQ (test)
15.818F1 ScoreRankT5
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| RankT5CAR=true, Generator=Qwen2.5-7B-Instruct, Initial Retriever=BM252026.05 | 15.818 | 0.5 | |
| QLMCAR=true, Generator=Qwen2.5-7B-Instruct, Initial Retriever=BM252026.05 | 15.741 | 1.8 | |
| RankT5CAR=false, Generator=Qwen2.5-7B-Instruct, Initial Retriever=BM252026.05 | 15.735 | — | |
| ColBERTCAR=true, Generator=Qwen2.5-7B-Instruct, Initial Retriever=BM252026.05 | 15.733 | 0.6 | |
| Cross-EncoderCAR=true, Generator=Qwen2.5-7B-Instruct, Initial Retriever=BM252026.05 | 15.724 | 0.3 | |
| Cross-EncoderCAR=false, Generator=Qwen2.5-7B-Instruct, Initial Retriever=BM252026.05 | 15.681 | — | |
| ColBERTCAR=false, Generator=Qwen2.5-7B-Instruct, Initial Retriever=BM252026.05 | 15.635 | — | |
| QLMCAR=false, Generator=Qwen2.5-7B-Instruct, Initial Retriever=BM252026.05 | 15.462 | — | |
| RankGPTCAR=true, Generator=Qwen2.5-7B-Instruct, Initial Retriever=BM252026.05 | 15.291 | 10.1 | |
| BM25CAR=true, Generator=Qwen2.5-7B-Instruct, Initial Retriever=BM252026.05 | 15.228 | 10.4 | |
| YesNoCAR=true, Generator=Qwen2.5-7B-Instruct, Initial Retriever=BM252026.05 | 15.192 | 17.1 | |
| RankGPTCAR=false, Generator=Qwen2.5-7B-Instruct, Initial Retriever=BM252026.05 | 13.886 | — | |
| BM25CAR=false, Generator=Qwen2.5-7B-Instruct, Initial Retriever=BM252026.05 | 13.789 | — | |
| YesNoCAR=false, Generator=Qwen2.5-7B-Instruct, Initial Retriever=BM252026.05 | 12.974 | — |