# Quotation Recommendation on QuoteR

Source: [Quotation Recommendation on QuoteR](<https://www.sota2.com/research/sota/quotation-recommendation-on-quoter>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-04-09T23:58:09.528Z

Evaluation of Quotation Recommendation performance on the base QuoteR dataset, measured using Novelty, Match, and Average scores.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Quotation Recommendation |
| Dataset (including any stated split) | QuoteR |
| Metric | Novelty |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 10 of 10 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Novelty](<https://www.sota2.com/research/sota/quotation-recommendation-on-quoter.md?metric=Novelty>): Higher is better; unit: SCALAR.

- [Match Score](<https://www.sota2.com/research/sota/quotation-recommendation-on-quoter.md?metric=Match%20Score>): Higher is better; unit: SCALAR.

- [Average Score](<https://www.sota2.com/research/sota/quotation-recommendation-on-quoter.md?metric=Average%20Score>): Higher is better; unit: SCALAR.

## Recorded results

| Method | Novelty | Result date | Report paper |
| --- | --- | --- | --- |
| LR + GPT | 3.9 | Not recorded | 69a124ff2d603e6de3e3c3f9 |
| LR + Ours | 3.88 | Not recorded | 69a124ff2d603e6de3e3c3f9 |
| LR + Qwen3-Re | 3.85 | Not recorded | 69a124ff2d603e6de3e3c3f9 |
| LR + w/o Reranker | 3.78 | Not recorded | 69a124ff2d603e6de3e3c3f9 |
| LR + Bge-large | 3.75 | Not recorded | 69a124ff2d603e6de3e3c3f9 |
| LR + bm25 | 3.64 | Not recorded | 69a124ff2d603e6de3e3c3f9 |
| QR + w/o Reranker | 3.59 | Not recorded | 69a124ff2d603e6de3e3c3f9 |
| QuoteR (Bert-based) | 3.55 | Not recorded | 69a124ff2d603e6de3e3c3f9 |
| QUILL | 3.42 | Not recorded | 69a124ff2d603e6de3e3c3f9 |
| LLM (GPT-based) | 2.85 | Not recorded | 69a124ff2d603e6de3e3c3f9 |

### LR + GPT

Novelty: 3.9. Result ID: 69d83ca547f34ce924c0248e.

[Reporting paper](<https://www.sota2.com/research/paper/69a124ff2d603e6de3e3c3f9.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76721e209131cea6d0b1.md>)

Recorded evaluation configuration: {"Retrieval Strategy":"Label-enhanced Retrieval","Reranker":"GPT"}. This record does not assert independent reproduction.

### LR + Ours

Novelty: 3.88. Result ID: 69d83ca547f34ce924c0248f.

[Reporting paper](<https://www.sota2.com/research/paper/69a124ff2d603e6de3e3c3f9.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69a124ff2d603e6de3e3c3f9.md>)

Recorded evaluation configuration: {"Retrieval Strategy":"Label-enhanced Retrieval","Reranker":"Ours"}. This record does not assert independent reproduction.

### LR + Qwen3-Re

Novelty: 3.85. Result ID: 69d83ca547f34ce924c0248d.

[Reporting paper](<https://www.sota2.com/research/paper/69a124ff2d603e6de3e3c3f9.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79601e209131cea7d516.md>)

Recorded evaluation configuration: {"Retrieval Strategy":"Label-enhanced Retrieval","Reranker":"Qwen3-Reranker"}. This record does not assert independent reproduction.

### LR + w/o Reranker

Novelty: 3.78. Result ID: 69d83ca547f34ce924c0248a.

[Reporting paper](<https://www.sota2.com/research/paper/69a124ff2d603e6de3e3c3f9.md>)

Recorded evaluation configuration: {"Retrieval Strategy":"Label-enhanced Retrieval","Reranker":"None"}. This record does not assert independent reproduction.

### LR + Bge-large

Novelty: 3.75. Result ID: 69d83ca547f34ce924c0248c.

[Reporting paper](<https://www.sota2.com/research/paper/69a124ff2d603e6de3e3c3f9.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74e31e209131cea64745.md>)

Recorded evaluation configuration: {"Retrieval Strategy":"Label-enhanced Retrieval","Reranker":"Bge-large"}. This record does not assert independent reproduction.

### LR + bm25

Novelty: 3.64. Result ID: 69d83ca547f34ce924c0248b.

[Reporting paper](<https://www.sota2.com/research/paper/69a124ff2d603e6de3e3c3f9.md>)

Recorded evaluation configuration: {"Retrieval Strategy":"Label-enhanced Retrieval","Reranker":"bm25"}. This record does not assert independent reproduction.

### QR + w/o Reranker

Novelty: 3.59. Result ID: 69d83ca547f34ce924c02488.

[Reporting paper](<https://www.sota2.com/research/paper/69a124ff2d603e6de3e3c3f9.md>)

Recorded evaluation configuration: {"Retrieval Strategy":"Quote-based Retrieval","Reranker":"None"}. This record does not assert independent reproduction.

### QuoteR (Bert-based)

Novelty: 3.55. Result ID: 69d83ca547f34ce924c02487.

[Reporting paper](<https://www.sota2.com/research/paper/69a124ff2d603e6de3e3c3f9.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6bff1e209131cea31894.md>)

[Implementation](<https://github.com/thunlp/QuoteR>)

Recorded evaluation configuration: {"Model Category":"Model-based Quotation Generation"}. This record does not assert independent reproduction.

### QUILL

Novelty: 3.42. Result ID: 69d83ca547f34ce924c02489.

[Reporting paper](<https://www.sota2.com/research/paper/69a124ff2d603e6de3e3c3f9.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa77101e209131cea70e56.md>)

Recorded evaluation configuration: {"Retrieval Strategy":"Quote-based Retrieval"}. This record does not assert independent reproduction.

### LLM (GPT-based)

Novelty: 2.85. Result ID: 69d83ca547f34ce924c02486.

[Reporting paper](<https://www.sota2.com/research/paper/69a124ff2d603e6de3e3c3f9.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75681e209131cea67a98.md>)

Recorded evaluation configuration: {"Model Category":"Model-based Quotation Generation"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
