# user-attendance on RELBENCH rel-event (test)

Source: [user-attendance on RELBENCH rel-event (test)](<https://www.sota2.com/research/sota/user-attendance-on-relbench-rel-event-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-05-18T07:39:40.026Z

Evaluation of user-attendance performance on the test split of the RELBENCH rel-event dataset, measured using MAE.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | user-attendance |
| Dataset (including any stated split) | RELBENCH rel-event (test) |
| Metric | MAE |
| Unit | SCALAR |
| Direction | Lower is better |
| Results loaded | 16 of 16 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [MAE](<https://www.sota2.com/research/sota/user-attendance-on-relbench-rel-event-test.md?metric=MAE>): Lower is better; unit: SCALAR.

## Recorded results

| Method | MAE | Result date | Report paper |
| --- | --- | --- | --- |
| GelGT | 0.2423 | Not recorded | 6a0a9d1edbc836b87d82b481 |
| RelGT | 0.2502 | Not recorded | 6a0a9d1edbc836b87d82b481 |
| Rel-LLM | 0.251 | Not recorded | 68fa792c1e209131cea7c660 |
| RDL | 0.258 | Not recorded | 68fa792c1e209131cea7c660 |
| RDL | 0.258 | Not recorded | 6a0a9d1edbc836b87d82b481 |
| HGT+PE | 0.2611 | Not recorded | 6a0a9d1edbc836b87d82b481 |
| HGT | 0.2635 | Not recorded | 6a0a9d1edbc836b87d82b481 |
| Global Zero | 0.264 | Not recorded | 68fa792c1e209131cea7c660 |
| Global Median | 0.264 | Not recorded | 68fa792c1e209131cea7c660 |
| LightGBM | 0.264 | Not recorded | 68fa792c1e209131cea7c660 |
| LightGBM | 0.264 | Not recorded | 6a0a9d1edbc836b87d82b481 |
| Entity Median | 0.269 | Not recorded | 68fa792c1e209131cea7c660 |
| ICL + MLP | 0.293 | Not recorded | 68fa792c1e209131cea7c660 |
| Entity Mean | 0.304 | Not recorded | 68fa792c1e209131cea7c660 |
| Griffin | 0.3708 | Not recorded | 6a0a9d1edbc836b87d82b481 |
| Global Mean | 0.47 | Not recorded | 68fa792c1e209131cea7c660 |

### GelGT

MAE: 0.2423. Result ID: 6a0ac21f47f34ce924f09539.

[Reporting paper](<https://www.sota2.com/research/paper/6a0a9d1edbc836b87d82b481.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a0a9d1edbc836b87d82b481.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### RelGT

MAE: 0.2502. Result ID: 6a0ac21f47f34ce924f09537.

[Reporting paper](<https://www.sota2.com/research/paper/6a0a9d1edbc836b87d82b481.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa789e1e209131cea79624.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Rel-LLM

MAE: 0.251. Result ID: 6995cc523badfaffe6d09818.

[Reporting paper](<https://www.sota2.com/research/paper/68fa792c1e209131cea7c660.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa792c1e209131cea7c660.md>)

[Implementation](<https://github.com/smiles724/Rel-LLM>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### RDL

MAE: 0.258. Result ID: 6995cc523badfaffe6d09816.

[Reporting paper](<https://www.sota2.com/research/paper/68fa792c1e209131cea7c660.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### RDL

MAE: 0.258. Result ID: 6a0ac21f47f34ce924f09533.

[Reporting paper](<https://www.sota2.com/research/paper/6a0a9d1edbc836b87d82b481.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74511e209131cea6101a.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### HGT+PE

MAE: 0.2611. Result ID: 6a0ac21f47f34ce924f09535.

[Reporting paper](<https://www.sota2.com/research/paper/6a0a9d1edbc836b87d82b481.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67241e209131cea14a25.md>)

[Implementation](<https://github.com/acbull/pyHGT>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### HGT

MAE: 0.2635. Result ID: 6a0ac21f47f34ce924f09534.

[Reporting paper](<https://www.sota2.com/research/paper/6a0a9d1edbc836b87d82b481.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67241e209131cea14a25.md>)

[Implementation](<https://github.com/acbull/pyHGT>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Global Zero

MAE: 0.264. Result ID: 6995cc523badfaffe6d09810.

[Reporting paper](<https://www.sota2.com/research/paper/68fa792c1e209131cea7c660.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Global Median

MAE: 0.264. Result ID: 6995cc523badfaffe6d09812.

[Reporting paper](<https://www.sota2.com/research/paper/68fa792c1e209131cea7c660.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### LightGBM

MAE: 0.264. Result ID: 6995cc523badfaffe6d09815.

[Reporting paper](<https://www.sota2.com/research/paper/68fa792c1e209131cea7c660.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### LightGBM

MAE: 0.264. Result ID: 6a0ac21f47f34ce924f09538.

[Reporting paper](<https://www.sota2.com/research/paper/6a0a9d1edbc836b87d82b481.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Entity Median

MAE: 0.269. Result ID: 6995cc523badfaffe6d09814.

[Reporting paper](<https://www.sota2.com/research/paper/68fa792c1e209131cea7c660.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### ICL + MLP

MAE: 0.293. Result ID: 6995cc523badfaffe6d09817.

[Reporting paper](<https://www.sota2.com/research/paper/68fa792c1e209131cea7c660.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75c61e209131cea69e75.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Entity Mean

MAE: 0.304. Result ID: 6995cc523badfaffe6d09813.

[Reporting paper](<https://www.sota2.com/research/paper/68fa792c1e209131cea7c660.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Griffin

MAE: 0.3708. Result ID: 6a0ac21f47f34ce924f09536.

[Reporting paper](<https://www.sota2.com/research/paper/6a0a9d1edbc836b87d82b481.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa795e1e209131cea7d4e7.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Global Mean

MAE: 0.47. Result ID: 6995cc523badfaffe6d09811.

[Reporting paper](<https://www.sota2.com/research/paper/68fa792c1e209131cea7c660.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
