# Item Sales on RELBENCH rel-hm (test)

Source: [Item Sales on RELBENCH rel-hm (test)](<https://www.sota2.com/research/sota/item-sales-on-relbench-rel-hm-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-05-18T07:39:40.297Z

Evaluation of item sales prediction performance on the test split of the RELBENCH rel-hm dataset, measured using MAE.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | item-sales |
| Dataset (including any stated split) | RELBENCH rel-hm (test) |
| Metric | MAE |
| Unit | SCALAR |
| Direction | Lower is better |
| Results loaded | 16 of 16 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [MAE](<https://www.sota2.com/research/sota/item-sales-on-relbench-rel-hm-test.md?metric=MAE>): Lower is better; unit: SCALAR.

## Recorded results

| Method | MAE | Result date | Report paper |
| --- | --- | --- | --- |
| Rel-LLM | 0.052 | Not recorded | 68fa792c1e209131cea7c660 |
| RDL | 0.056 | Not recorded | 68fa792c1e209131cea7c660 |
| RDL | 0.056 | Not recorded | 6a0a9d1edbc836b87d82b481 |
| GelGT | 0.056 | Not recorded | 6a0a9d1edbc836b87d82b481 |
| RelGT | 0.0563 | Not recorded | 6a0a9d1edbc836b87d82b481 |
| ICL + MLP | 0.057 | Not recorded | 68fa792c1e209131cea7c660 |
| Griffin | 0.0597 | Not recorded | 6a0a9d1edbc836b87d82b481 |
| HGT+PE | 0.0639 | Not recorded | 6a0a9d1edbc836b87d82b481 |
| HGT | 0.0641 | Not recorded | 6a0a9d1edbc836b87d82b481 |
| Global Zero | 0.076 | Not recorded | 68fa792c1e209131cea7c660 |
| Global Median | 0.076 | Not recorded | 68fa792c1e209131cea7c660 |
| LightGBM | 0.076 | Not recorded | 68fa792c1e209131cea7c660 |
| LightGBM | 0.076 | Not recorded | 6a0a9d1edbc836b87d82b481 |
| Entity Median | 0.078 | Not recorded | 68fa792c1e209131cea7c660 |
| Entity Mean | 0.111 | Not recorded | 68fa792c1e209131cea7c660 |
| Global Mean | 0.134 | Not recorded | 68fa792c1e209131cea7c660 |

### Rel-LLM

MAE: 0.052. Result ID: 6995cc523badfaffe6d0983a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa792c1e209131cea7c660.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa792c1e209131cea7c660.md>)

[Implementation](<https://github.com/smiles724/Rel-LLM>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### RDL

MAE: 0.056. Result ID: 6995cc523badfaffe6d09838.

[Reporting paper](<https://www.sota2.com/research/paper/68fa792c1e209131cea7c660.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### RDL

MAE: 0.056. Result ID: 6a0ac21f47f34ce924f0955d.

[Reporting paper](<https://www.sota2.com/research/paper/6a0a9d1edbc836b87d82b481.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74511e209131cea6101a.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### GelGT

MAE: 0.056. Result ID: 6a0ac21f47f34ce924f09563.

[Reporting paper](<https://www.sota2.com/research/paper/6a0a9d1edbc836b87d82b481.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a0a9d1edbc836b87d82b481.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### RelGT

MAE: 0.0563. Result ID: 6a0ac21f47f34ce924f09561.

[Reporting paper](<https://www.sota2.com/research/paper/6a0a9d1edbc836b87d82b481.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa789e1e209131cea79624.md>)

Recorded evaluation configuration: {"Reproduced with official code":"true"}. This record does not assert independent reproduction.

### ICL + MLP

MAE: 0.057. Result ID: 6995cc523badfaffe6d09839.

[Reporting paper](<https://www.sota2.com/research/paper/68fa792c1e209131cea7c660.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75c61e209131cea69e75.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Griffin

MAE: 0.0597. Result ID: 6a0ac21f47f34ce924f09560.

[Reporting paper](<https://www.sota2.com/research/paper/6a0a9d1edbc836b87d82b481.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa795e1e209131cea7d4e7.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### HGT+PE

MAE: 0.0639. Result ID: 6a0ac21f47f34ce924f0955f.

[Reporting paper](<https://www.sota2.com/research/paper/6a0a9d1edbc836b87d82b481.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67241e209131cea14a25.md>)

[Implementation](<https://github.com/acbull/pyHGT>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### HGT

MAE: 0.0641. Result ID: 6a0ac21f47f34ce924f0955e.

[Reporting paper](<https://www.sota2.com/research/paper/6a0a9d1edbc836b87d82b481.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67241e209131cea14a25.md>)

[Implementation](<https://github.com/acbull/pyHGT>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Global Zero

MAE: 0.076. Result ID: 6995cc523badfaffe6d09832.

[Reporting paper](<https://www.sota2.com/research/paper/68fa792c1e209131cea7c660.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Global Median

MAE: 0.076. Result ID: 6995cc523badfaffe6d09834.

[Reporting paper](<https://www.sota2.com/research/paper/68fa792c1e209131cea7c660.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### LightGBM

MAE: 0.076. Result ID: 6995cc523badfaffe6d09837.

[Reporting paper](<https://www.sota2.com/research/paper/68fa792c1e209131cea7c660.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### LightGBM

MAE: 0.076. Result ID: 6a0ac21f47f34ce924f09562.

[Reporting paper](<https://www.sota2.com/research/paper/6a0a9d1edbc836b87d82b481.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Entity Median

MAE: 0.078. Result ID: 6995cc523badfaffe6d09836.

[Reporting paper](<https://www.sota2.com/research/paper/68fa792c1e209131cea7c660.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Entity Mean

MAE: 0.111. Result ID: 6995cc523badfaffe6d09835.

[Reporting paper](<https://www.sota2.com/research/paper/68fa792c1e209131cea7c660.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Global Mean

MAE: 0.134. Result ID: 6995cc523badfaffe6d09833.

[Reporting paper](<https://www.sota2.com/research/paper/68fa792c1e209131cea7c660.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
