# Ranking on rel-salt s-shipc

Source: [Ranking on rel-salt s-shipc](<https://www.sota2.com/research/sota/ranking-on-rel-salt-s-shipc>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-06-04T11:16:49.538Z

Evaluation of Ranking performance on the rel-salt s-shipc dataset, measured using metrics like MRR.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Ranking |
| Dataset (including any stated split) | rel-salt s-shipc |
| Metric | MRR |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 10 of 10 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [MRR](<https://www.sota2.com/research/sota/ranking-on-rel-salt-s-shipc.md?metric=MRR>): Higher is better; unit: SCALAR.

## Recorded results

| Method | MRR | Result date | Report paper |
| --- | --- | --- | --- |
| NBFNet | 0.733 | Not recorded | 6a2106d0c10484bac23f0439 |
| RDL-GNN | 0.73 | Not recorded | 6a2106d0c10484bac23f0439 |
| RelGNN | 0.73 | Not recorded | 6a2106d0c10484bac23f0439 |
| RelGT | 0.717 | Not recorded | 6a2106d0c10484bac23f0439 |
| KumoRFMv1 | 0.512 | Not recorded | 6a2106d0c10484bac23f0439 |
| OpenRFM (tabpfn) | 0.49 | Not recorded | 6a2106d0c10484bac23f0439 |
| OpenRFM (tabicl) | 0.466 | Not recorded | 6a2106d0c10484bac23f0439 |
| RDB-PFN | 0.465 | Not recorded | 6a2106d0c10484bac23f0439 |
| JUICE | 0.394 | Not recorded | 6a2106d0c10484bac23f0439 |
| JUICE (supp×8) | 0.362 | Not recorded | 6a2106d0c10484bac23f0439 |

### NBFNet

MRR: 0.733. Result ID: 6a215e8efbc373592c1e0928.

[Reporting paper](<https://www.sota2.com/research/paper/6a2106d0c10484bac23f0439.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ba71e209131cea2f97e.md>)

[Implementation](<https://github.com/DeepGraphLearning/NBFNet>)

Recorded evaluation configuration: {"Training Regime":"Training from Scratch"}. This record does not assert independent reproduction.

### RDL-GNN

MRR: 0.73. Result ID: 6a215e8efbc373592c1e0927.

[Reporting paper](<https://www.sota2.com/research/paper/6a2106d0c10484bac23f0439.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74511e209131cea6101a.md>)

Recorded evaluation configuration: {"Training Regime":"Training from Scratch"}. This record does not assert independent reproduction.

### RelGNN

MRR: 0.73. Result ID: 6a215e8efbc373592c1e092a.

[Reporting paper](<https://www.sota2.com/research/paper/6a2106d0c10484bac23f0439.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79431e209131cea7cf25.md>)

Recorded evaluation configuration: {"Training Regime":"Training from Scratch"}. This record does not assert independent reproduction.

### RelGT

MRR: 0.717. Result ID: 6a215e8efbc373592c1e0929.

[Reporting paper](<https://www.sota2.com/research/paper/6a2106d0c10484bac23f0439.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa789e1e209131cea79624.md>)

Recorded evaluation configuration: {"Training Regime":"Training from Scratch"}. This record does not assert independent reproduction.

### KumoRFMv1

MRR: 0.512. Result ID: 6a215e8efbc373592c1e092e.

[Reporting paper](<https://www.sota2.com/research/paper/6a2106d0c10484bac23f0439.md>)

Recorded evaluation configuration: {"Training Regime":"Training-based (Official)"}. This record does not assert independent reproduction.

### OpenRFM (tabpfn)

MRR: 0.49. Result ID: 6a215e8efbc373592c1e0930.

[Reporting paper](<https://www.sota2.com/research/paper/6a2106d0c10484bac23f0439.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a2106d0c10484bac23f0439.md>)

Recorded evaluation configuration: {"Training Regime":"Ours"}. This record does not assert independent reproduction.

### OpenRFM (tabicl)

MRR: 0.466. Result ID: 6a215e8efbc373592c1e092f.

[Reporting paper](<https://www.sota2.com/research/paper/6a2106d0c10484bac23f0439.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a2106d0c10484bac23f0439.md>)

Recorded evaluation configuration: {"Training Regime":"Ours"}. This record does not assert independent reproduction.

### RDB-PFN

MRR: 0.465. Result ID: 6a215e8efbc373592c1e092d.

[Reporting paper](<https://www.sota2.com/research/paper/6a2106d0c10484bac23f0439.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69a90e112d603e6de3e4083c.md>)

Recorded evaluation configuration: {"Training Regime":"Pre-trained Prior"}. This record does not assert independent reproduction.

### JUICE

MRR: 0.394. Result ID: 6a215e8efbc373592c1e092b.

[Reporting paper](<https://www.sota2.com/research/paper/6a2106d0c10484bac23f0439.md>)

Recorded evaluation configuration: {"Training Regime":"Training-free RFM"}. This record does not assert independent reproduction.

### JUICE (supp×8)

MRR: 0.362. Result ID: 6a215e8efbc373592c1e092c.

[Reporting paper](<https://www.sota2.com/research/paper/6a2106d0c10484bac23f0439.md>)

Recorded evaluation configuration: {"Training Regime":"Training-free RFM","Ensemble":"8 independent supports"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.