# Complex Query Answering on UNSW 100% Transductive

Source: [Complex Query Answering on UNSW 100% Transductive](<https://www.sota2.com/research/sota/complex-query-answering-on-unsw-100-percent-transductive>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-04-06T08:54:21.663Z

Evaluation of model performance on the UNSW 100% Transductive dataset for Complex Query Answering, reporting metrics such as Mean Rank (MR), Mean Reciprocal Rank (MRR), and Hits@K (H@1, H@3, H@10).

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Complex Query Answering |
| Dataset (including any stated split) | UNSW 100% Transductive |
| Metric | MR (Mean Rank) |
| Unit | SCALAR |
| Direction | Lower is better |
| Results loaded | 8 of 8 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [MR (Mean Rank)](<https://www.sota2.com/research/sota/complex-query-answering-on-unsw-100-percent-transductive.md?metric=MR%20(Mean%20Rank)>): Lower is better; unit: SCALAR.

- [MRR (Mean Reciprocal Rank)](<https://www.sota2.com/research/sota/complex-query-answering-on-unsw-100-percent-transductive.md?metric=MRR%20(Mean%20Reciprocal%20Rank)>): Higher is better; unit: SCALAR.

- [Hits@1](<https://www.sota2.com/research/sota/complex-query-answering-on-unsw-100-percent-transductive.md?metric=Hits%401>): Higher is better; unit: PERCENT.

- [Hits@3](<https://www.sota2.com/research/sota/complex-query-answering-on-unsw-100-percent-transductive.md?metric=Hits%403>): Higher is better; unit: PERCENT.

- [Hits@10](<https://www.sota2.com/research/sota/complex-query-answering-on-unsw-100-percent-transductive.md?metric=Hits%4010>): Higher is better; unit: PERCENT.

## Recorded results

| Method | MR (Mean Rank) | Result date | Report paper |
| --- | --- | --- | --- |
| HR-NBFNet-CQ | 2.135 | Not recorded | 69d33df37d0172140ec7363a |
| StarQE | 2.155 | Not recorded | 69d33df37d0172140ec7363a |
| StarQE | 3.365 | Not recorded | 69d33df37d0172140ec7363a |
| StarQE | 3.365 | Not recorded | 69d33df37d0172140ec7363a |
| StarQE | 3.645 | Not recorded | 69d33df37d0172140ec7363a |
| HR-NBFNet-CQ | 3.73 | Not recorded | 69d33df37d0172140ec7363a |
| HR-NBFNet-CQ | 3.925 | Not recorded | 69d33df37d0172140ec7363a |
| HR-NBFNet-CQ | 4.135 | Not recorded | 69d33df37d0172140ec7363a |

### HR-NBFNet-CQ

MR (Mean Rank): 2.135. Result ID: 69d374bb47f34ce924bb6c80.

[Reporting paper](<https://www.sota2.com/research/paper/69d33df37d0172140ec7363a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69d33df37d0172140ec7363a.md>)

Recorded evaluation configuration: {"Query":"2p"}. This record does not assert independent reproduction.

### StarQE

MR (Mean Rank): 2.155. Result ID: 69d374bb47f34ce924bb6c7c.

[Reporting paper](<https://www.sota2.com/research/paper/69d33df37d0172140ec7363a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6d5a1e209131cea3962f.md>)

Recorded evaluation configuration: {"Query":"2p"}. This record does not assert independent reproduction.

### StarQE

MR (Mean Rank): 3.365. Result ID: 69d374bb47f34ce924bb6c7b.

[Reporting paper](<https://www.sota2.com/research/paper/69d33df37d0172140ec7363a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6d5a1e209131cea3962f.md>)

Recorded evaluation configuration: {"Query":"1p"}. This record does not assert independent reproduction.

### StarQE

MR (Mean Rank): 3.365. Result ID: 69d374bb47f34ce924bb6c7e.

[Reporting paper](<https://www.sota2.com/research/paper/69d33df37d0172140ec7363a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6d5a1e209131cea3962f.md>)

Recorded evaluation configuration: {"Query":"2u"}. This record does not assert independent reproduction.

### StarQE

MR (Mean Rank): 3.645. Result ID: 69d374bb47f34ce924bb6c7d.

[Reporting paper](<https://www.sota2.com/research/paper/69d33df37d0172140ec7363a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6d5a1e209131cea3962f.md>)

Recorded evaluation configuration: {"Query":"2i"}. This record does not assert independent reproduction.

### HR-NBFNet-CQ

MR (Mean Rank): 3.73. Result ID: 69d374bb47f34ce924bb6c81.

[Reporting paper](<https://www.sota2.com/research/paper/69d33df37d0172140ec7363a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69d33df37d0172140ec7363a.md>)

Recorded evaluation configuration: {"Query":"2i"}. This record does not assert independent reproduction.

### HR-NBFNet-CQ

MR (Mean Rank): 3.925. Result ID: 69d374bb47f34ce924bb6c7f.

[Reporting paper](<https://www.sota2.com/research/paper/69d33df37d0172140ec7363a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69d33df37d0172140ec7363a.md>)

Recorded evaluation configuration: {"Query":"1p"}. This record does not assert independent reproduction.

### HR-NBFNet-CQ

MR (Mean Rank): 4.135. Result ID: 69d374bb47f34ce924bb6c82.

[Reporting paper](<https://www.sota2.com/research/paper/69d33df37d0172140ec7363a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69d33df37d0172140ec7363a.md>)

Recorded evaluation configuration: {"Query":"2u"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
