# Quote Retrieval on NOVELQR

Source: [Quote Retrieval on NOVELQR](<https://www.sota2.com/research/sota/quote-retrieval-on-novelqr>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-04-09T23:58:09.495Z

Evaluation of Quote Retrieval performance on the NOVELQR dataset, measured using delta ranking metrics (e.g., ΔHR@5, ΔnDCG@5).

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Quote Retrieval |
| Dataset (including any stated split) | NOVELQR |
| Metric | Delta HR@5 |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 15 of 15 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Delta HR@5](<https://www.sota2.com/research/sota/quote-retrieval-on-novelqr.md?metric=Delta%20HR%405>): Higher is better; unit: PERCENT.

- [Delta nDCG@5](<https://www.sota2.com/research/sota/quote-retrieval-on-novelqr.md?metric=Delta%20nDCG%405>): Higher is better; unit: PERCENT.

- [Delta MRR@5](<https://www.sota2.com/research/sota/quote-retrieval-on-novelqr.md?metric=Delta%20MRR%405>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Delta HR@5 | Result date | Report paper |
| --- | --- | --- | --- |
| NOVELQR | 55 | Not recorded | 69a124ff2d603e6de3e3c3f9 |
| NOVELQR | 35 | Not recorded | 69a124ff2d603e6de3e3c3f9 |
| NOVELQR | 30 | Not recorded | 69a124ff2d603e6de3e3c3f9 |
| NOVELQR | 20 | Not recorded | 69a124ff2d603e6de3e3c3f9 |
| NOVELQR | 20 | Not recorded | 69a124ff2d603e6de3e3c3f9 |
| NOVELQR | 15 | Not recorded | 69a124ff2d603e6de3e3c3f9 |
| NOVELQR | 15 | Not recorded | 69a124ff2d603e6de3e3c3f9 |
| NOVELQR | 14 | Not recorded | 69a124ff2d603e6de3e3c3f9 |
| NOVELQR | 9 | Not recorded | 69a124ff2d603e6de3e3c3f9 |
| NOVELQR | 9 | Not recorded | 69a124ff2d603e6de3e3c3f9 |
| NOVELQR | 8 | Not recorded | 69a124ff2d603e6de3e3c3f9 |
| NOVELQR | 8 | Not recorded | 69a124ff2d603e6de3e3c3f9 |
| NOVELQR | 7 | Not recorded | 69a124ff2d603e6de3e3c3f9 |
| NOVELQR | 5 | Not recorded | 69a124ff2d603e6de3e3c3f9 |
| NOVELQR | 4 | Not recorded | 69a124ff2d603e6de3e3c3f9 |

### NOVELQR

Delta HR@5: 55. Result ID: 69d83ca547f34ce924c02478.

[Reporting paper](<https://www.sota2.com/research/paper/69a124ff2d603e6de3e3c3f9.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69a124ff2d603e6de3e3c3f9.md>)

Recorded evaluation configuration: {"Baseline":"QUILL","Experiment":"Main Experiment"}. This record does not assert independent reproduction.

### NOVELQR

Delta HR@5: 35. Result ID: 69d83ca547f34ce924c02477.

[Reporting paper](<https://www.sota2.com/research/paper/69a124ff2d603e6de3e3c3f9.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69a124ff2d603e6de3e3c3f9.md>)

Recorded evaluation configuration: {"Baseline":"QR + w/o Re","Experiment":"Main Experiment"}. This record does not assert independent reproduction.

### NOVELQR

Delta HR@5: 30. Result ID: 69d83ca547f34ce924c0247a.

[Reporting paper](<https://www.sota2.com/research/paper/69a124ff2d603e6de3e3c3f9.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69a124ff2d603e6de3e3c3f9.md>)

Recorded evaluation configuration: {"Baseline":"LR + bm25","Experiment":"Main Experiment"}. This record does not assert independent reproduction.

### NOVELQR

Delta HR@5: 20. Result ID: 69d83ca547f34ce924c0247e.

[Reporting paper](<https://www.sota2.com/research/paper/69a124ff2d603e6de3e3c3f9.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69a124ff2d603e6de3e3c3f9.md>)

Recorded evaluation configuration: {"Baseline":"Self-BLEU","Experiment":"Novelty Ablation"}. This record does not assert independent reproduction.

### NOVELQR

Delta HR@5: 20. Result ID: 69d83ca547f34ce924c0247f.

[Reporting paper](<https://www.sota2.com/research/paper/69a124ff2d603e6de3e3c3f9.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69a124ff2d603e6de3e3c3f9.md>)

Recorded evaluation configuration: {"Baseline":"Embedding-Dis","Experiment":"Novelty Ablation"}. This record does not assert independent reproduction.

### NOVELQR

Delta HR@5: 15. Result ID: 69d83ca547f34ce924c02479.

[Reporting paper](<https://www.sota2.com/research/paper/69a124ff2d603e6de3e3c3f9.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69a124ff2d603e6de3e3c3f9.md>)

Recorded evaluation configuration: {"Baseline":"LR + w/o Re","Experiment":"Main Experiment"}. This record does not assert independent reproduction.

### NOVELQR

Delta HR@5: 15. Result ID: 69d83ca547f34ce924c02480.

[Reporting paper](<https://www.sota2.com/research/paper/69a124ff2d603e6de3e3c3f9.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69a124ff2d603e6de3e3c3f9.md>)

Recorded evaluation configuration: {"Baseline":"Surprisal","Experiment":"Novelty Ablation"}. This record does not assert independent reproduction.

### NOVELQR

Delta HR@5: 14. Result ID: 69d83ca547f34ce924c0247b.

[Reporting paper](<https://www.sota2.com/research/paper/69a124ff2d603e6de3e3c3f9.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69a124ff2d603e6de3e3c3f9.md>)

Recorded evaluation configuration: {"Baseline":"LR + Bge-large","Experiment":"Main Experiment"}. This record does not assert independent reproduction.

### NOVELQR

Delta HR@5: 9. Result ID: 69d83ca547f34ce924c02482.

[Reporting paper](<https://www.sota2.com/research/paper/69a124ff2d603e6de3e3c3f9.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69a124ff2d603e6de3e3c3f9.md>)

Recorded evaluation configuration: {"Baseline":"KL-Div","Experiment":"Novelty Ablation"}. This record does not assert independent reproduction.

### NOVELQR

Delta HR@5: 9. Result ID: 69d83ca547f34ce924c02483.

[Reporting paper](<https://www.sota2.com/research/paper/69a124ff2d603e6de3e3c3f9.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69a124ff2d603e6de3e3c3f9.md>)

Recorded evaluation configuration: {"Baseline":"KL-Div + NT","Experiment":"Novelty Ablation"}. This record does not assert independent reproduction.

### NOVELQR

Delta HR@5: 8. Result ID: 69d83ca547f34ce924c0247c.

[Reporting paper](<https://www.sota2.com/research/paper/69a124ff2d603e6de3e3c3f9.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69a124ff2d603e6de3e3c3f9.md>)

Recorded evaluation configuration: {"Baseline":"LR + Qwen3-Re","Experiment":"Main Experiment"}. This record does not assert independent reproduction.

### NOVELQR

Delta HR@5: 8. Result ID: 69d83ca547f34ce924c02481.

[Reporting paper](<https://www.sota2.com/research/paper/69a124ff2d603e6de3e3c3f9.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69a124ff2d603e6de3e3c3f9.md>)

Recorded evaluation configuration: {"Baseline":"Surprisal + NT","Experiment":"Novelty Ablation"}. This record does not assert independent reproduction.

### NOVELQR

Delta HR@5: 7. Result ID: 69d83ca547f34ce924c02484.

[Reporting paper](<https://www.sota2.com/research/paper/69a124ff2d603e6de3e3c3f9.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69a124ff2d603e6de3e3c3f9.md>)

Recorded evaluation configuration: {"Baseline":"Uniform Avg","Experiment":"Novelty Ablation"}. This record does not assert independent reproduction.

### NOVELQR

Delta HR@5: 5. Result ID: 69d83ca547f34ce924c02485.

[Reporting paper](<https://www.sota2.com/research/paper/69a124ff2d603e6de3e3c3f9.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69a124ff2d603e6de3e3c3f9.md>)

Recorded evaluation configuration: {"Baseline":"TopK Avg","Experiment":"Novelty Ablation"}. This record does not assert independent reproduction.

### NOVELQR

Delta HR@5: 4. Result ID: 69d83ca547f34ce924c0247d.

[Reporting paper](<https://www.sota2.com/research/paper/69a124ff2d603e6de3e3c3f9.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69a124ff2d603e6de3e3c3f9.md>)

Recorded evaluation configuration: {"Baseline":"LR + GPT","Experiment":"Main Experiment"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
