# Driver Position on RELBENCH rel-f1 (test)

Source: [Driver Position on RELBENCH rel-f1 (test)](<https://www.sota2.com/research/sota/driver-position-on-relbench-rel-f1-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-05-18T07:39:40.063Z

Evaluation of driver position prediction performance on the test split of the RELBENCH rel-f1 dataset, measured using Mean Absolute Error (MAE).

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | driver-position |
| Dataset (including any stated split) | RELBENCH rel-f1 (test) |
| Metric | MAE |
| Unit | SCALAR |
| Direction | Lower is better |
| Results loaded | 16 of 16 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [MAE](<https://www.sota2.com/research/sota/driver-position-on-relbench-rel-f1-test.md?metric=MAE>): Lower is better; unit: SCALAR.

## Recorded results

| Method | MAE | Result date | Report paper |
| --- | --- | --- | --- |
| ICL + MLP | 3.539 | Not recorded | 68fa792c1e209131cea7c660 |
| GelGT | 3.7345 | Not recorded | 6a0a9d1edbc836b87d82b481 |
| RelGT | 3.917 | Not recorded | 6a0a9d1edbc836b87d82b481 |
| Griffin | 3.9315 | Not recorded | 6a0a9d1edbc836b87d82b481 |
| Rel-LLM | 3.967 | Not recorded | 68fa792c1e209131cea7c660 |
| RDL | 4.022 | Not recorded | 68fa792c1e209131cea7c660 |
| RDL | 4.022 | Not recorded | 6a0a9d1edbc836b87d82b481 |
| LightGBM | 4.17 | Not recorded | 68fa792c1e209131cea7c660 |
| LightGBM | 4.17 | Not recorded | 6a0a9d1edbc836b87d82b481 |
| HGT | 4.2263 | Not recorded | 6a0a9d1edbc836b87d82b481 |
| HGT+PE | 4.3921 | Not recorded | 6a0a9d1edbc836b87d82b481 |
| Global Median | 4.399 | Not recorded | 68fa792c1e209131cea7c660 |
| Global Mean | 4.513 | Not recorded | 68fa792c1e209131cea7c660 |
| Entity Mean | 8.501 | Not recorded | 68fa792c1e209131cea7c660 |
| Entity Median | 8.519 | Not recorded | 68fa792c1e209131cea7c660 |
| Global Zero | 11.926 | Not recorded | 68fa792c1e209131cea7c660 |

### ICL + MLP

MAE: 3.539. Result ID: 6995cc523badfaffe6d09828.

[Reporting paper](<https://www.sota2.com/research/paper/68fa792c1e209131cea7c660.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75c61e209131cea69e75.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### GelGT

MAE: 3.7345. Result ID: 6a0ac21f47f34ce924f0952b.

[Reporting paper](<https://www.sota2.com/research/paper/6a0a9d1edbc836b87d82b481.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a0a9d1edbc836b87d82b481.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### RelGT

MAE: 3.917. Result ID: 6a0ac21f47f34ce924f09529.

[Reporting paper](<https://www.sota2.com/research/paper/6a0a9d1edbc836b87d82b481.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa789e1e209131cea79624.md>)

Recorded evaluation configuration: {"Reproduced with official code":"true"}. This record does not assert independent reproduction.

### Griffin

MAE: 3.9315. Result ID: 6a0ac21f47f34ce924f09528.

[Reporting paper](<https://www.sota2.com/research/paper/6a0a9d1edbc836b87d82b481.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa795e1e209131cea7d4e7.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Rel-LLM

MAE: 3.967. Result ID: 6995cc523badfaffe6d09829.

[Reporting paper](<https://www.sota2.com/research/paper/68fa792c1e209131cea7c660.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa792c1e209131cea7c660.md>)

[Implementation](<https://github.com/smiles724/Rel-LLM>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### RDL

MAE: 4.022. Result ID: 6995cc523badfaffe6d09827.

[Reporting paper](<https://www.sota2.com/research/paper/68fa792c1e209131cea7c660.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### RDL

MAE: 4.022. Result ID: 6a0ac21f47f34ce924f09525.

[Reporting paper](<https://www.sota2.com/research/paper/6a0a9d1edbc836b87d82b481.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74511e209131cea6101a.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### LightGBM

MAE: 4.17. Result ID: 6995cc523badfaffe6d09826.

[Reporting paper](<https://www.sota2.com/research/paper/68fa792c1e209131cea7c660.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### LightGBM

MAE: 4.17. Result ID: 6a0ac21f47f34ce924f0952a.

[Reporting paper](<https://www.sota2.com/research/paper/6a0a9d1edbc836b87d82b481.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### HGT

MAE: 4.2263. Result ID: 6a0ac21f47f34ce924f09526.

[Reporting paper](<https://www.sota2.com/research/paper/6a0a9d1edbc836b87d82b481.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67241e209131cea14a25.md>)

[Implementation](<https://github.com/acbull/pyHGT>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### HGT+PE

MAE: 4.3921. Result ID: 6a0ac21f47f34ce924f09527.

[Reporting paper](<https://www.sota2.com/research/paper/6a0a9d1edbc836b87d82b481.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67241e209131cea14a25.md>)

[Implementation](<https://github.com/acbull/pyHGT>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Global Median

MAE: 4.399. Result ID: 6995cc523badfaffe6d09823.

[Reporting paper](<https://www.sota2.com/research/paper/68fa792c1e209131cea7c660.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Global Mean

MAE: 4.513. Result ID: 6995cc523badfaffe6d09822.

[Reporting paper](<https://www.sota2.com/research/paper/68fa792c1e209131cea7c660.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Entity Mean

MAE: 8.501. Result ID: 6995cc523badfaffe6d09824.

[Reporting paper](<https://www.sota2.com/research/paper/68fa792c1e209131cea7c660.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Entity Median

MAE: 8.519. Result ID: 6995cc523badfaffe6d09825.

[Reporting paper](<https://www.sota2.com/research/paper/68fa792c1e209131cea7c660.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Global Zero

MAE: 11.926. Result ID: 6995cc523badfaffe6d09821.

[Reporting paper](<https://www.sota2.com/research/paper/68fa792c1e209131cea7c660.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
