# Quotation Recommendation on NOVELQR-BENCH

Source: [Quotation Recommendation on NOVELQR-BENCH](<https://www.sota2.com/research/sota/quotation-recommendation-on-novelqr-bench>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-04-09T23:58:09.585Z

Evaluation of Quotation Recommendation performance on the NOVELQR-BENCH dataset, measured using Novelty, Match, Average, HR, nDCG, and MRR scores.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Quotation Recommendation |
| Dataset (including any stated split) | NOVELQR-BENCH |
| Metric | Novelty Score |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 10 of 10 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Novelty Score](<https://www.sota2.com/research/sota/quotation-recommendation-on-novelqr-bench.md?metric=Novelty%20Score>): Higher is better; unit: SCALAR.

- [Match Score](<https://www.sota2.com/research/sota/quotation-recommendation-on-novelqr-bench.md?metric=Match%20Score>): Higher is better; unit: SCALAR.

- [Average Score](<https://www.sota2.com/research/sota/quotation-recommendation-on-novelqr-bench.md?metric=Average%20Score>): Higher is better; unit: SCALAR.

- [HR](<https://www.sota2.com/research/sota/quotation-recommendation-on-novelqr-bench.md?metric=HR>): Higher is better; unit: PERCENT.

- [nDCG](<https://www.sota2.com/research/sota/quotation-recommendation-on-novelqr-bench.md?metric=nDCG>): Higher is better; unit: PERCENT.

- [MRR](<https://www.sota2.com/research/sota/quotation-recommendation-on-novelqr-bench.md?metric=MRR>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Novelty Score | Result date | Report paper |
| --- | --- | --- | --- |
| LR + Ours | 3.81 | Not recorded | 69a124ff2d603e6de3e3c3f9 |
| LR + GPT | 3.75 | Not recorded | 69a124ff2d603e6de3e3c3f9 |
| LR + Qwen3-Re | 3.62 | Not recorded | 69a124ff2d603e6de3e3c3f9 |
| LR + Bge-large | 3.61 | Not recorded | 69a124ff2d603e6de3e3c3f9 |
| LR + w/o Reranker | 3.4 | Not recorded | 69a124ff2d603e6de3e3c3f9 |
| LR + bm25 | 3.4 | Not recorded | 69a124ff2d603e6de3e3c3f9 |
| QuoteR (Bert-based) | 3.21 | Not recorded | 69a124ff2d603e6de3e3c3f9 |
| QR + w/o Reranker | 3.14 | Not recorded | 69a124ff2d603e6de3e3c3f9 |
| QUILL | 3.08 | Not recorded | 69a124ff2d603e6de3e3c3f9 |
| LLM (GPT-based) | 2.85 | Not recorded | 69a124ff2d603e6de3e3c3f9 |

### LR + Ours

Novelty Score: 3.81. Result ID: 69d83ca547f34ce924c024a3.

[Reporting paper](<https://www.sota2.com/research/paper/69a124ff2d603e6de3e3c3f9.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69a124ff2d603e6de3e3c3f9.md>)

Recorded evaluation configuration: {"Retrieval Strategy":"Label-enhanced Retrieval","Reranker":"Ours"}. This record does not assert independent reproduction.

### LR + GPT

Novelty Score: 3.75. Result ID: 69d83ca547f34ce924c024a2.

[Reporting paper](<https://www.sota2.com/research/paper/69a124ff2d603e6de3e3c3f9.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76721e209131cea6d0b1.md>)

Recorded evaluation configuration: {"Retrieval Strategy":"Label-enhanced Retrieval","Reranker":"GPT"}. This record does not assert independent reproduction.

### LR + Qwen3-Re

Novelty Score: 3.62. Result ID: 69d83ca547f34ce924c024a1.

[Reporting paper](<https://www.sota2.com/research/paper/69a124ff2d603e6de3e3c3f9.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79601e209131cea7d516.md>)

Recorded evaluation configuration: {"Retrieval Strategy":"Label-enhanced Retrieval","Reranker":"Qwen3-Reranker"}. This record does not assert independent reproduction.

### LR + Bge-large

Novelty Score: 3.61. Result ID: 69d83ca547f34ce924c024a0.

[Reporting paper](<https://www.sota2.com/research/paper/69a124ff2d603e6de3e3c3f9.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74e31e209131cea64745.md>)

Recorded evaluation configuration: {"Retrieval Strategy":"Label-enhanced Retrieval","Reranker":"Bge-large"}. This record does not assert independent reproduction.

### LR + w/o Reranker

Novelty Score: 3.4. Result ID: 69d83ca547f34ce924c0249e.

[Reporting paper](<https://www.sota2.com/research/paper/69a124ff2d603e6de3e3c3f9.md>)

Recorded evaluation configuration: {"Retrieval Strategy":"Label-enhanced Retrieval","Reranker":"None"}. This record does not assert independent reproduction.

### LR + bm25

Novelty Score: 3.4. Result ID: 69d83ca547f34ce924c0249f.

[Reporting paper](<https://www.sota2.com/research/paper/69a124ff2d603e6de3e3c3f9.md>)

Recorded evaluation configuration: {"Retrieval Strategy":"Label-enhanced Retrieval","Reranker":"bm25"}. This record does not assert independent reproduction.

### QuoteR (Bert-based)

Novelty Score: 3.21. Result ID: 69d83ca547f34ce924c0249b.

[Reporting paper](<https://www.sota2.com/research/paper/69a124ff2d603e6de3e3c3f9.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6bff1e209131cea31894.md>)

[Implementation](<https://github.com/thunlp/QuoteR>)

Recorded evaluation configuration: {"Model Category":"Model-based Quotation Generation"}. This record does not assert independent reproduction.

### QR + w/o Reranker

Novelty Score: 3.14. Result ID: 69d83ca547f34ce924c0249c.

[Reporting paper](<https://www.sota2.com/research/paper/69a124ff2d603e6de3e3c3f9.md>)

Recorded evaluation configuration: {"Retrieval Strategy":"Quote-based Retrieval","Reranker":"None"}. This record does not assert independent reproduction.

### QUILL

Novelty Score: 3.08. Result ID: 69d83ca547f34ce924c0249d.

[Reporting paper](<https://www.sota2.com/research/paper/69a124ff2d603e6de3e3c3f9.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa77101e209131cea70e56.md>)

Recorded evaluation configuration: {"Retrieval Strategy":"Quote-based Retrieval"}. This record does not assert independent reproduction.

### LLM (GPT-based)

Novelty Score: 2.85. Result ID: 69d83ca547f34ce924c0249a.

[Reporting paper](<https://www.sota2.com/research/paper/69a124ff2d603e6de3e3c3f9.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75681e209131cea67a98.md>)

Recorded evaluation configuration: {"Model Category":"Model-based Quotation Generation"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
