Candidate Selection on NewsRec-Chat Align (test)
30.9Hit@1GPT-4 Direct
Evaluation results
| Method | Links | |
|---|---|---|
| GPT-4 DirectBackbone=GPT-4, SID Training=false2026.05 | 30.9 | |
| GPT-4 + BM25Backbone=GPT-4, Retriever=BM252026.05 | 30.9 | |
| NewsRec-ChatBackbone=Qwen2.5-7B-Instruct, SID Training=true2026.05 | 30.8 | |
| Qwen-7B DirectBackbone=Qwen-7B, SID Training=false2026.05 | 26 | |
| Qwen-7B + BM25Backbone=Qwen-7B, Retriever=BM252026.05 | 26 | |
| BM25Retriever=BM252026.05 | 23.4 | |
| Random2026.05 | 20 | |
| Popular2026.05 | 20 |