# Recommendation on Movies (HR/NDCG/OOD Metrics)

Source: [Recommendation on Movies (HR/NDCG/OOD Metrics)](<https://www.sota2.com/research/sota/recommendation-on-movies-hr-ndcg-ood-metrics>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-06-05T08:11:02.951Z

Evaluation of recommendation performance on the Movies dataset, reporting Hit Rate (HR@k), Normalized Discounted Cumulative Gain (NDCG@k), and Out-of-Distribution (OOD) metrics.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Recommendation |
| Dataset (including any stated split) | Movies |
| Metric | HR@10 |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 15 of 15 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [HR@10](<https://www.sota2.com/research/sota/recommendation-on-movies-hr-ndcg-ood-metrics.md?metric=HR%4010>): Higher is better; unit: SCALAR.

- [NDCG@10](<https://www.sota2.com/research/sota/recommendation-on-movies-hr-ndcg-ood-metrics.md?metric=NDCG%4010>): Higher is better; unit: SCALAR.

- [HR@5](<https://www.sota2.com/research/sota/recommendation-on-movies-hr-ndcg-ood-metrics.md?metric=HR%405>): Higher is better; unit: SCALAR.

- [NDCG@5](<https://www.sota2.com/research/sota/recommendation-on-movies-hr-ndcg-ood-metrics.md?metric=NDCG%405>): Higher is better; unit: SCALAR.

- [Repeat Rate@10](<https://www.sota2.com/research/sota/recommendation-on-movies-hr-ndcg-ood-metrics.md?metric=Repeat%20Rate%4010>): Higher is better; unit: PERCENT.

- [OOD@10](<https://www.sota2.com/research/sota/recommendation-on-movies-hr-ndcg-ood-metrics.md?metric=OOD%4010>): Higher is better; unit: PERCENT.

## Recorded results

| Method | HR@10 | Result date | Report paper |
| --- | --- | --- | --- |
| RecLM-token | 0.17 | Not recorded | 68fa786b1e209131cea7858b |
| LC-Rec | 0.1607 | Not recorded | 68fa786b1e209131cea7858b |
| SASRec | 0.151 | Not recorded | 68fa786b1e209131cea7858b |
| RecLM-cgen | 0.1467 | Not recorded | 68fa786b1e209131cea7858b |
| CtrlRec | 0.1347 | Not recorded | 68fa786b1e209131cea7858b |
| PALR | 0.1335 | Not recorded | 68fa786b1e209131cea7858b |
| IDGenRec | 0.1243 | Not recorded | 68fa786b1e209131cea7858b |
| LETTER | 0.1205 | Not recorded | 68fa786b1e209131cea7858b |
| RecLM-ret | 0.1145 | Not recorded | 68fa786b1e209131cea7858b |
| SETRec | 0.0929 | Not recorded | 68fa786b1e209131cea7858b |
| BIGRec | 0.0861 | Not recorded | 68fa786b1e209131cea7858b |
| GRU4Rec | 0.0722 | Not recorded | 68fa786b1e209131cea7858b |
| Llama3-cgen | 0.0246 | Not recorded | 68fa786b1e209131cea7858b |
| Llama3 | 0.0049 | Not recorded | 68fa786b1e209131cea7858b |
| GPT-4o | 0.0046 | Not recorded | 68fa786b1e209131cea7858b |

### RecLM-token

HR@10: 0.17. Result ID: 6a2283a8fbc373592c20611e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa786b1e209131cea7858b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa786b1e209131cea7858b.md>)

Recorded evaluation configuration: {"Method Type":"LLMs (ours)"}. This record does not assert independent reproduction.

### LC-Rec

HR@10: 0.1607. Result ID: 6a2283a8fbc373592c20611a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa786b1e209131cea7858b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72ed1e209131cea594c5.md>)

Recorded evaluation configuration: {"Method Type":"LLMs (item tokenizer)"}. This record does not assert independent reproduction.

### SASRec

HR@10: 0.151. Result ID: 6a2283a8fbc373592c206110.

[Reporting paper](<https://www.sota2.com/research/paper/68fa786b1e209131cea7858b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa64c81e209131cea06918.md>)

Recorded evaluation configuration: {"Method Type":"Traditional Recommenders"}. This record does not assert independent reproduction.

### RecLM-cgen

HR@10: 0.1467. Result ID: 6a2283a8fbc373592c20611d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa786b1e209131cea7858b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa786b1e209131cea7858b.md>)

Recorded evaluation configuration: {"Method Type":"LLMs (ours)"}. This record does not assert independent reproduction.

### CtrlRec

HR@10: 0.1347. Result ID: 6a2283a8fbc373592c206116.

[Reporting paper](<https://www.sota2.com/research/paper/68fa786b1e209131cea7858b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74651e209131cea61750.md>)

[Implementation](<https://github.com/microsoft/recai>)

Recorded evaluation configuration: {"Method Type":"LLMs (finetuned)"}. This record does not assert independent reproduction.

### PALR

HR@10: 0.1335. Result ID: 6a2283a8fbc373592c206117.

[Reporting paper](<https://www.sota2.com/research/paper/68fa786b1e209131cea7858b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f9b1e209131cea46936.md>)

Recorded evaluation configuration: {"Method Type":"LLMs (finetuned)"}. This record does not assert independent reproduction.

### IDGenRec

HR@10: 0.1243. Result ID: 6a2283a8fbc373592c206118.

[Reporting paper](<https://www.sota2.com/research/paper/68fa786b1e209131cea7858b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73311e209131cea5b081.md>)

Recorded evaluation configuration: {"Method Type":"LLMs (item tokenizer)"}. This record does not assert independent reproduction.

### LETTER

HR@10: 0.1205. Result ID: 6a2283a8fbc373592c20611b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa786b1e209131cea7858b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7c3c1e209131cea8d152.md>)

Recorded evaluation configuration: {"Method Type":"LLMs (item tokenizer)"}. This record does not assert independent reproduction.

### RecLM-ret

HR@10: 0.1145. Result ID: 6a2283a8fbc373592c20611c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa786b1e209131cea7858b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa786b1e209131cea7858b.md>)

Recorded evaluation configuration: {"Method Type":"LLMs (ours)"}. This record does not assert independent reproduction.

### SETRec

HR@10: 0.0929. Result ID: 6a2283a8fbc373592c206119.

[Reporting paper](<https://www.sota2.com/research/paper/68fa786b1e209131cea7858b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78c51e209131cea7a693.md>)

Recorded evaluation configuration: {"Method Type":"LLMs (item tokenizer)"}. This record does not assert independent reproduction.

### BIGRec

HR@10: 0.0861. Result ID: 6a2283a8fbc373592c206115.

[Reporting paper](<https://www.sota2.com/research/paper/68fa786b1e209131cea7858b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71a61e209131cea52518.md>)

Recorded evaluation configuration: {"Method Type":"LLMs (finetuned)"}. This record does not assert independent reproduction.

### GRU4Rec

HR@10: 0.0722. Result ID: 6a2283a8fbc373592c206111.

[Reporting paper](<https://www.sota2.com/research/paper/68fa786b1e209131cea7858b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa625d1e209131ce9f8cf7.md>)

Recorded evaluation configuration: {"Method Type":"Traditional Recommenders"}. This record does not assert independent reproduction.

### Llama3-cgen

HR@10: 0.0246. Result ID: 6a2283a8fbc373592c206114.

[Reporting paper](<https://www.sota2.com/research/paper/68fa786b1e209131cea7858b.md>)

Recorded evaluation configuration: {"Method Type":"LLMs (frozen)"}. This record does not assert independent reproduction.

### Llama3

HR@10: 0.0049. Result ID: 6a2283a8fbc373592c206113.

[Reporting paper](<https://www.sota2.com/research/paper/68fa786b1e209131cea7858b.md>)

Recorded evaluation configuration: {"Method Type":"LLMs (frozen)"}. This record does not assert independent reproduction.

### GPT-4o

HR@10: 0.0046. Result ID: 6a2283a8fbc373592c206112.

[Reporting paper](<https://www.sota2.com/research/paper/68fa786b1e209131cea7858b.md>)

Recorded evaluation configuration: {"Method Type":"LLMs (frozen)"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
