Quotation Recommendation on NOVELQR-BENCH
3.81Novelty ScoreLR + Ours
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| LR + OursRetrieval Strategy=Label-enhanced Retrieval, Reranker=Ours2025.12 | 3.81 | 4.5 | 4.16 | 70 | 51 | 45 | |
| LR + GPTRetrieval Strategy=Label-enhanced Retrieval, Reranker=GPT2025.12 | 3.75 | 4.5 | 4.12 | 66 | 47 | 43 | |
| LR + Qwen3-ReRetrieval Strategy=Label-enhanced Retrieval, Reranker=Qwen3-Reranker2025.12 | 3.62 | 4.58 | 4.1 | 62 | 48 | 45 | |
| LR + Bge-largeRetrieval Strategy=Label-enhanced Retrieval, Reranker=Bge-large2025.12 | 3.61 | 4.54 | 4.08 | 56 | 39 | 33 | |
| LR + w/o RerankerRetrieval Strategy=Label-enhanced Retrieval, Reranker=None2025.12 | 3.4 | 4.55 | 3.98 | 55 | 44 | 40 | |
| LR + bm25Retrieval Strategy=Label-enhanced Retrieval, Reranker=bm252025.12 | 3.4 | 4.52 | 3.96 | 40 | 30 | 23 | |
| QuoteR (Bert-based)Model Category=Model-based Quotation Generation2025.12 | 3.21 | 3.88 | 3.54 | — | — | — | |
| QR + w/o RerankerRetrieval Strategy=Quote-based Retrieval, Reranker=None2025.12 | 3.14 | 3.99 | 3.57 | 35 | 26 | 24 | |
| QUILLRetrieval Strategy=Quote-based Retrieval2025.12 | 3.08 | 4.15 | 3.62 | 15 | 12 | 11 | |
| LLM (GPT-based)Model Category=Model-based Quotation Generation2025.12 | 2.85 | 2.99 | 2.92 | — | — | — |