Candidate Selection on NewsRec-Chat Rand (test)
59.3Hit@1NewsRec-Chat
Evaluation results
| Method | Links | |
|---|---|---|
| NewsRec-ChatBackbone=Qwen2.5-7B-Instruct, SID Training=true2026.05 | 59.3 | |
| GPT-4 DirectBackbone=GPT-4, SID Training=false2026.05 | 34.4 | |
| GPT-4 + BM25Backbone=GPT-4, Retriever=BM252026.05 | 34.4 | |
| Qwen-7B DirectBackbone=Qwen-7B, SID Training=false2026.05 | 28.1 | |
| Qwen-7B + BM25Backbone=Qwen-7B, Retriever=BM252026.05 | 28.1 | |
| BM25Retriever=BM252026.05 | 23.5 | |
| Random2026.05 | 20 | |
| Popular2026.05 | 20 |