# Generative Recommendation on Book-Crossing (test)

Source: [Generative Recommendation on Book-Crossing (test)](<https://www.sota2.com/research/sota/generative-recommendation-on-book-crossing-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-03-25T14:16:48.587Z

Evaluation of Generative Recommendation performance on the test split of the Book-Crossing dataset, measured using ranking metrics like H@K and N@K.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Generative Recommendation |
| Dataset (including any stated split) | Book-Crossing (test) |
| Metric | H@10 |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 9 of 9 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [H@10](<https://www.sota2.com/research/sota/generative-recommendation-on-book-crossing-test.md?metric=H%4010>): Higher is better; unit: SCALAR.

- [N@10](<https://www.sota2.com/research/sota/generative-recommendation-on-book-crossing-test.md?metric=N%4010>): Higher is better; unit: PERCENT.

- [H@20](<https://www.sota2.com/research/sota/generative-recommendation-on-book-crossing-test.md?metric=H%4020>): Higher is better; unit: SCALAR.

- [N@20](<https://www.sota2.com/research/sota/generative-recommendation-on-book-crossing-test.md?metric=N%4020>): Higher is better; unit: SCALAR.

## Recorded results

| Method | H@10 | Result date | Report paper |
| --- | --- | --- | --- |
| CausalDPO | 1.77 | Not recorded | 69c36c1a0636e5bf4afc652a |
| SASRec | 1.7 | Not recorded | 69c36c1a0636e5bf4afc652a |
| BIGRec | 1.64 | Not recorded | 69c36c1a0636e5bf4afc652a |
| DMPO | 1.61 | Not recorded | 69c36c1a0636e5bf4afc652a |
| RosePO | 1.6 | Not recorded | 69c36c1a0636e5bf4afc652a |
| SDPO | 1.59 | Not recorded | 69c36c1a0636e5bf4afc652a |
| RW | 1.52 | Not recorded | 69c36c1a0636e5bf4afc652a |
| SPRec | 1.52 | Not recorded | 69c36c1a0636e5bf4afc652a |
| D3 | 1.48 | Not recorded | 69c36c1a0636e5bf4afc652a |

### CausalDPO

H@10: 1.77. Result ID: 69c3edf347f34ce924adb47f.

[Reporting paper](<https://www.sota2.com/research/paper/69c36c1a0636e5bf4afc652a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69c36c1a0636e5bf4afc652a.md>)

Recorded evaluation configuration: {"base model":"Llama-3.1-8B","epochs":"3","negative sampling":"random sampling","distribution":"IID"}. This record does not assert independent reproduction.

### SASRec

H@10: 1.7. Result ID: 69c3edf347f34ce924adb477.

[Reporting paper](<https://www.sota2.com/research/paper/69c36c1a0636e5bf4afc652a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa64c81e209131cea06918.md>)

Recorded evaluation configuration: {"embedding dimension":"32","dropout rate":"0.1","distribution":"IID"}. This record does not assert independent reproduction.

### BIGRec

H@10: 1.64. Result ID: 69c3edf347f34ce924adb478.

[Reporting paper](<https://www.sota2.com/research/paper/69c36c1a0636e5bf4afc652a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71a61e209131cea52518.md>)

Recorded evaluation configuration: {"base model":"Llama-3.1-8B","epochs":"3","distribution":"IID"}. This record does not assert independent reproduction.

### DMPO

H@10: 1.61. Result ID: 69c3edf347f34ce924adb47b.

[Reporting paper](<https://www.sota2.com/research/paper/69c36c1a0636e5bf4afc652a.md>)

Recorded evaluation configuration: {"base model":"Llama-3.1-8B","epochs":"3","negative samples":"single","distribution":"IID"}. This record does not assert independent reproduction.

### RosePO

H@10: 1.6. Result ID: 69c3edf347f34ce924adb47d.

[Reporting paper](<https://www.sota2.com/research/paper/69c36c1a0636e5bf4afc652a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa753f1e209131cea66ca3.md>)

Recorded evaluation configuration: {"base model":"Llama-3.1-8B","epochs":"3","negative samples":"single","distribution":"IID"}. This record does not assert independent reproduction.

### SDPO

H@10: 1.59. Result ID: 69c3edf347f34ce924adb47c.

[Reporting paper](<https://www.sota2.com/research/paper/69c36c1a0636e5bf4afc652a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa759c1e209131cea68f35.md>)

Recorded evaluation configuration: {"base model":"Llama-3.1-8B","epochs":"3","negative samples":"single","distribution":"IID"}. This record does not assert independent reproduction.

### RW

H@10: 1.52. Result ID: 69c3edf347f34ce924adb479.

[Reporting paper](<https://www.sota2.com/research/paper/69c36c1a0636e5bf4afc652a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72441e209131cea556a2.md>)

Recorded evaluation configuration: {"base model":"Llama-3.1-8B","epochs":"3","distribution":"IID"}. This record does not assert independent reproduction.

### SPRec

H@10: 1.52. Result ID: 69c3edf347f34ce924adb47e.

[Reporting paper](<https://www.sota2.com/research/paper/69c36c1a0636e5bf4afc652a.md>)

Recorded evaluation configuration: {"base model":"Llama-3.1-8B","epochs":"3","negative samples":"single-iteration SFT output","distribution":"IID"}. This record does not assert independent reproduction.

### D3

H@10: 1.48. Result ID: 69c3edf347f34ce924adb47a.

[Reporting paper](<https://www.sota2.com/research/paper/69c36c1a0636e5bf4afc652a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75881e209131cea686bc.md>)

Recorded evaluation configuration: {"base model":"Llama-3.1-8B","epochs":"3","distribution":"IID"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.