# Rating Prediction on MovieLens

Source: [Rating Prediction on MovieLens](<https://www.sota2.com/research/sota/rating-prediction-on-movielens>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-06-02T12:08:30.675Z

Evaluation of Rating Prediction performance on the generic MovieLens dataset, measured using RMSE and MAE.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Rating Prediction |
| Dataset (including any stated split) | MovieLens |
| Metric | RMSE |
| Unit | SCALAR |
| Direction | Lower is better |
| Results loaded | 18 of 18 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [RMSE](<https://www.sota2.com/research/sota/rating-prediction-on-movielens.md?metric=RMSE>): Lower is better; unit: SCALAR.

- [MAE](<https://www.sota2.com/research/sota/rating-prediction-on-movielens.md?metric=MAE>): Lower is better; unit: SCALAR.

## Recorded results

| Method | RMSE | Result date | Report paper |
| --- | --- | --- | --- |
| ALIGNUSER+ | 0.4292 | Not recorded | 695c96f553fdd5c361743590 |
| ContextSim | 0.451 | Not recorded | 69ddc9fc7d0172140ec798a8 |
| ALIGNUSER | 0.4693 | Not recorded | 695c96f553fdd5c361743590 |
| ContextSim(fs) | 0.478 | Not recorded | 69ddc9fc7d0172140ec798a8 |
| SimUSER | 0.502 | Not recorded | 695c96f553fdd5c361743590 |
| SimUSER | 0.502 | Not recorded | 69ddc9fc7d0172140ec798a8 |
| Agent4Rec | 0.761 | Not recorded | 69ddc9fc7d0172140ec798a8 |
| Agent4Rec | 0.7612 | Not recorded | 695c96f553fdd5c361743590 |
| ASADPREC | 0.916 | Not recorded | 6a1e6435dbd7150506f85845 |
| SyncMulti | 0.919 | Not recorded | 6a1e6435dbd7150506f85845 |
| SyncSingle | 0.93 | Not recorded | 6a1e6435dbd7150506f85845 |
| RecMind-SI | 1.0651 | Not recorded | 695c96f553fdd5c361743590 |
| RecAgent | 1.102 | Not recorded | 69ddc9fc7d0172140ec798a8 |
| RecAgent | 1.1021 | Not recorded | 695c96f553fdd5c361743590 |
| AFM | 1.176 | Not recorded | 69ddc9fc7d0172140ec798a8 |
| AFM | 1.1762 | Not recorded | 695c96f553fdd5c361743590 |
| MF | 1.214 | Not recorded | 69ddc9fc7d0172140ec798a8 |
| MF | 1.2142 | Not recorded | 695c96f553fdd5c361743590 |

### ALIGNUSER+

RMSE: 0.4292. Result ID: 6998b3335698665ec4161177.

[Reporting paper](<https://www.sota2.com/research/paper/695c96f553fdd5c361743590.md>)

[Method origin paper](<https://www.sota2.com/research/paper/695c96f553fdd5c361743590.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### ContextSim

RMSE: 0.451. Result ID: 69dde8cb47f34ce924c4e4a9.

[Reporting paper](<https://www.sota2.com/research/paper/69ddc9fc7d0172140ec798a8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69ddc9fc7d0172140ec798a8.md>)

Recorded evaluation configuration: {"Evaluation protocol":"default"}. This record does not assert independent reproduction.

### ALIGNUSER

RMSE: 0.4693. Result ID: 6998b3335698665ec4161176.

[Reporting paper](<https://www.sota2.com/research/paper/695c96f553fdd5c361743590.md>)

[Method origin paper](<https://www.sota2.com/research/paper/695c96f553fdd5c361743590.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### ContextSim(fs)

RMSE: 0.478. Result ID: 69dde8cb47f34ce924c4e4aa.

[Reporting paper](<https://www.sota2.com/research/paper/69ddc9fc7d0172140ec798a8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69ddc9fc7d0172140ec798a8.md>)

Recorded evaluation configuration: {"Evaluation protocol":"few-shot"}. This record does not assert independent reproduction.

### SimUSER

RMSE: 0.502. Result ID: 6998b3335698665ec4161175.

[Reporting paper](<https://www.sota2.com/research/paper/695c96f553fdd5c361743590.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78241e209131cea76fa8.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### SimUSER

RMSE: 0.502. Result ID: 69dde8cb47f34ce924c4e4a8.

[Reporting paper](<https://www.sota2.com/research/paper/69ddc9fc7d0172140ec798a8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78241e209131cea76fa8.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Agent4Rec

RMSE: 0.761. Result ID: 69dde8cb47f34ce924c4e4a7.

[Reporting paper](<https://www.sota2.com/research/paper/69ddc9fc7d0172140ec798a8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75a01e209131cea690b8.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Agent4Rec

RMSE: 0.7612. Result ID: 6998b3335698665ec4161174.

[Reporting paper](<https://www.sota2.com/research/paper/695c96f553fdd5c361743590.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75a01e209131cea690b8.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### ASADPREC

RMSE: 0.916. Result ID: 6a1ec7adfbc373592c1a4e84.

[Reporting paper](<https://www.sota2.com/research/paper/6a1e6435dbd7150506f85845.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a1e6435dbd7150506f85845.md>)

Recorded evaluation configuration: {"Throughput":"89","Speedup":"1.14"}. This record does not assert independent reproduction.

### SyncMulti

RMSE: 0.919. Result ID: 6a1ec7adfbc373592c1a4e83.

[Reporting paper](<https://www.sota2.com/research/paper/6a1e6435dbd7150506f85845.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### SyncSingle

RMSE: 0.93. Result ID: 6a1ec7adfbc373592c1a4e82.

[Reporting paper](<https://www.sota2.com/research/paper/6a1e6435dbd7150506f85845.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### RecMind-SI

RMSE: 1.0651. Result ID: 6998b3335698665ec4161173.

[Reporting paper](<https://www.sota2.com/research/paper/695c96f553fdd5c361743590.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72931e209131cea573b7.md>)

Recorded evaluation configuration: {"mode":"few-shot"}. This record does not assert independent reproduction.

### RecAgent

RMSE: 1.102. Result ID: 69dde8cb47f34ce924c4e4a6.

[Reporting paper](<https://www.sota2.com/research/paper/69ddc9fc7d0172140ec798a8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa723f1e209131cea55423.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### RecAgent

RMSE: 1.1021. Result ID: 6998b3335698665ec4161172.

[Reporting paper](<https://www.sota2.com/research/paper/695c96f553fdd5c361743590.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa723f1e209131cea55423.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### AFM

RMSE: 1.176. Result ID: 69dde8cb47f34ce924c4e4a5.

[Reporting paper](<https://www.sota2.com/research/paper/69ddc9fc7d0172140ec798a8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa63a01e209131ce9ffd0f.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### AFM

RMSE: 1.1762. Result ID: 6998b3335698665ec4161171.

[Reporting paper](<https://www.sota2.com/research/paper/695c96f553fdd5c361743590.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa63a01e209131ce9ffd0f.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### MF

RMSE: 1.214. Result ID: 69dde8cb47f34ce924c4e4a4.

[Reporting paper](<https://www.sota2.com/research/paper/69ddc9fc7d0172140ec798a8.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### MF

RMSE: 1.2142. Result ID: 6998b3335698665ec4161170.

[Reporting paper](<https://www.sota2.com/research/paper/695c96f553fdd5c361743590.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
