# Ad CTR Prediction on RELBENCH rel-avito (test)

Source: [Ad CTR Prediction on RELBENCH rel-avito (test)](<https://www.sota2.com/research/sota/ad-ctr-prediction-on-relbench-rel-avito-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-05-18T07:39:39.994Z

Evaluation of Ad Click-Through Rate (CTR) prediction performance on the test split of the RELBENCH rel-avito dataset, measured using Mean Absolute Error (MAE).

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | ad-ctr |
| Dataset (including any stated split) | RELBENCH rel-avito (test) |
| Metric | MAE |
| Unit | SCALAR |
| Direction | Lower is better |
| Results loaded | 16 of 16 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [MAE](<https://www.sota2.com/research/sota/ad-ctr-prediction-on-relbench-rel-avito-test.md?metric=MAE>): Lower is better; unit: SCALAR.

## Recorded results

| Method | MAE | Result date | Report paper |
| --- | --- | --- | --- |
| GelGT | 0.0362 | Not recorded | 6a0a9d1edbc836b87d82b481 |
| Rel-LLM | 0.037 | Not recorded | 68fa792c1e209131cea7c660 |
| LightGBM | 0.041 | Not recorded | 68fa792c1e209131cea7c660 |
| RDL | 0.041 | Not recorded | 68fa792c1e209131cea7c660 |
| RDL | 0.041 | Not recorded | 6a0a9d1edbc836b87d82b481 |
| LightGBM | 0.041 | Not recorded | 6a0a9d1edbc836b87d82b481 |
| RelGT | 0.042 | Not recorded | 6a0a9d1edbc836b87d82b481 |
| Global Median | 0.043 | Not recorded | 68fa792c1e209131cea7c660 |
| Griffin | 0.0433 | Not recorded | 6a0a9d1edbc836b87d82b481 |
| ICL + MLP | 0.0436 | Not recorded | 68fa792c1e209131cea7c660 |
| Entity Mean | 0.046 | Not recorded | 68fa792c1e209131cea7c660 |
| Entity Median | 0.046 | Not recorded | 68fa792c1e209131cea7c660 |
| HGT | 0.0462 | Not recorded | 6a0a9d1edbc836b87d82b481 |
| HGT+PE | 0.0483 | Not recorded | 6a0a9d1edbc836b87d82b481 |
| Global Mean | 0.051 | Not recorded | 68fa792c1e209131cea7c660 |
| Global Zero | 0.052 | Not recorded | 68fa792c1e209131cea7c660 |

### GelGT

MAE: 0.0362. Result ID: 6a0ac21f47f34ce924f09532.

[Reporting paper](<https://www.sota2.com/research/paper/6a0a9d1edbc836b87d82b481.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a0a9d1edbc836b87d82b481.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Rel-LLM

MAE: 0.037. Result ID: 6995cc523badfaffe6d09807.

[Reporting paper](<https://www.sota2.com/research/paper/68fa792c1e209131cea7c660.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa792c1e209131cea7c660.md>)

[Implementation](<https://github.com/smiles724/Rel-LLM>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### LightGBM

MAE: 0.041. Result ID: 6995cc523badfaffe6d09804.

[Reporting paper](<https://www.sota2.com/research/paper/68fa792c1e209131cea7c660.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### RDL

MAE: 0.041. Result ID: 6995cc523badfaffe6d09805.

[Reporting paper](<https://www.sota2.com/research/paper/68fa792c1e209131cea7c660.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### RDL

MAE: 0.041. Result ID: 6a0ac21f47f34ce924f0952c.

[Reporting paper](<https://www.sota2.com/research/paper/6a0a9d1edbc836b87d82b481.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74511e209131cea6101a.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### LightGBM

MAE: 0.041. Result ID: 6a0ac21f47f34ce924f09531.

[Reporting paper](<https://www.sota2.com/research/paper/6a0a9d1edbc836b87d82b481.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### RelGT

MAE: 0.042. Result ID: 6a0ac21f47f34ce924f09530.

[Reporting paper](<https://www.sota2.com/research/paper/6a0a9d1edbc836b87d82b481.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa789e1e209131cea79624.md>)

Recorded evaluation configuration: {"Reproduced with official code":"true"}. This record does not assert independent reproduction.

### Global Median

MAE: 0.043. Result ID: 6995cc523badfaffe6d09801.

[Reporting paper](<https://www.sota2.com/research/paper/68fa792c1e209131cea7c660.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Griffin

MAE: 0.0433. Result ID: 6a0ac21f47f34ce924f0952f.

[Reporting paper](<https://www.sota2.com/research/paper/6a0a9d1edbc836b87d82b481.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa795e1e209131cea7d4e7.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### ICL + MLP

MAE: 0.0436. Result ID: 6995cc523badfaffe6d09806.

[Reporting paper](<https://www.sota2.com/research/paper/68fa792c1e209131cea7c660.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75c61e209131cea69e75.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Entity Mean

MAE: 0.046. Result ID: 6995cc523badfaffe6d09802.

[Reporting paper](<https://www.sota2.com/research/paper/68fa792c1e209131cea7c660.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Entity Median

MAE: 0.046. Result ID: 6995cc523badfaffe6d09803.

[Reporting paper](<https://www.sota2.com/research/paper/68fa792c1e209131cea7c660.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### HGT

MAE: 0.0462. Result ID: 6a0ac21f47f34ce924f0952d.

[Reporting paper](<https://www.sota2.com/research/paper/6a0a9d1edbc836b87d82b481.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67241e209131cea14a25.md>)

[Implementation](<https://github.com/acbull/pyHGT>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### HGT+PE

MAE: 0.0483. Result ID: 6a0ac21f47f34ce924f0952e.

[Reporting paper](<https://www.sota2.com/research/paper/6a0a9d1edbc836b87d82b481.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67241e209131cea14a25.md>)

[Implementation](<https://github.com/acbull/pyHGT>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Global Mean

MAE: 0.051. Result ID: 6995cc523badfaffe6d09800.

[Reporting paper](<https://www.sota2.com/research/paper/68fa792c1e209131cea7c660.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Global Zero

MAE: 0.052. Result ID: 6995cc523badfaffe6d097ff.

[Reporting paper](<https://www.sota2.com/research/paper/68fa792c1e209131cea7c660.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
