# Dungeon Level Generation on Dungeon Scenario 3

Source: [Dungeon Level Generation on Dungeon Scenario 3](<https://www.sota2.com/research/sota/dungeon-level-generation-on-dungeon-scenario-3>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-05-26T10:08:55.599Z

Evaluation of models generating dungeon levels using the 'Dungeon Scenario 3' dataset, assessed by metrics such as normalized mean score, p(ZS), and p(SA).

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Dungeon Level Generation |
| Dataset (including any stated split) | Dungeon Scenario 3 |
| Metric | Normalized Mean Score |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 14 of 14 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Normalized Mean Score](<https://www.sota2.com/research/sota/dungeon-level-generation-on-dungeon-scenario-3.md?metric=Normalized%20Mean%20Score>): Higher is better; unit: SCALAR.

- [p(ZS)](<https://www.sota2.com/research/sota/dungeon-level-generation-on-dungeon-scenario-3.md?metric=p(ZS)>): Higher is better; unit: SCALAR.

- [p(SA)](<https://www.sota2.com/research/sota/dungeon-level-generation-on-dungeon-scenario-3.md?metric=p(SA)>): Higher is better; unit: SCALAR.

## Recorded results

| Method | Normalized Mean Score | Result date | Report paper |
| --- | --- | --- | --- |
| GoT | 0.873 | Not recorded | 68fa76fd1e209131cea70456 |
| CoT | 0.793 | Not recorded | 68fa76fd1e209131cea70456 |
| CoT | 0.42 | Not recorded | 68fa76fd1e209131cea70456 |
| ToT | 0.413 | Not recorded | 68fa76fd1e209131cea70456 |
| GoT | 0.36 | Not recorded | 68fa76fd1e209131cea70456 |
| ToT | 0.187 | Not recorded | 68fa76fd1e209131cea70456 |
| ToT | 0.033 | Not recorded | 68fa76fd1e209131cea70456 |
| CoT | 0.027 | Not recorded | 68fa76fd1e209131cea70456 |
| GoT | 0.013 | Not recorded | 68fa76fd1e209131cea70456 |
| Human | 0.007 | Not recorded | 68fa76fd1e209131cea70456 |
| CoT | 0 | Not recorded | 68fa76fd1e209131cea70456 |
| ToT | 0 | Not recorded | 68fa76fd1e209131cea70456 |
| GoT | 0 | Not recorded | 68fa76fd1e209131cea70456 |
| Human | 0 | Not recorded | 68fa76fd1e209131cea70456 |

### GoT

Normalized Mean Score: 0.873. Result ID: 6a157114fbc373592c0d6580.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76fd1e209131cea70456.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76fd1e209131cea70456.md>)

Recorded evaluation configuration: {"Module ablation setting":"PCGRLLM"}. This record does not assert independent reproduction.

### CoT

Normalized Mean Score: 0.793. Result ID: 6a157114fbc373592c0d6578.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76fd1e209131cea70456.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76fd1e209131cea70456.md>)

Recorded evaluation configuration: {"Module ablation setting":"PCGRLLM"}. This record does not assert independent reproduction.

### CoT

Normalized Mean Score: 0.42. Result ID: 6a157114fbc373592c0d6576.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76fd1e209131cea70456.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76fd1e209131cea70456.md>)

Recorded evaluation configuration: {"Module ablation setting":"+Self-alignment (SA)"}. This record does not assert independent reproduction.

### ToT

Normalized Mean Score: 0.413. Result ID: 6a157114fbc373592c0d657c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76fd1e209131cea70456.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76fd1e209131cea70456.md>)

Recorded evaluation configuration: {"Module ablation setting":"PCGRLLM"}. This record does not assert independent reproduction.

### GoT

Normalized Mean Score: 0.36. Result ID: 6a157114fbc373592c0d657f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76fd1e209131cea70456.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76fd1e209131cea70456.md>)

Recorded evaluation configuration: {"Module ablation setting":"+Feedback (FB)"}. This record does not assert independent reproduction.

### ToT

Normalized Mean Score: 0.187. Result ID: 6a157114fbc373592c0d657a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76fd1e209131cea70456.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76fd1e209131cea70456.md>)

Recorded evaluation configuration: {"Module ablation setting":"+Self-alignment (SA)"}. This record does not assert independent reproduction.

### ToT

Normalized Mean Score: 0.033. Result ID: 6a157114fbc373592c0d657b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76fd1e209131cea70456.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76fd1e209131cea70456.md>)

Recorded evaluation configuration: {"Module ablation setting":"+Feedback (FB)"}. This record does not assert independent reproduction.

### CoT

Normalized Mean Score: 0.027. Result ID: 6a157114fbc373592c0d6577.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76fd1e209131cea70456.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76fd1e209131cea70456.md>)

Recorded evaluation configuration: {"Module ablation setting":"+Feedback (FB)"}. This record does not assert independent reproduction.

### GoT

Normalized Mean Score: 0.013. Result ID: 6a157114fbc373592c0d657d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76fd1e209131cea70456.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76fd1e209131cea70456.md>)

Recorded evaluation configuration: {"Module ablation setting":"Zero-shot (ZS)"}. This record does not assert independent reproduction.

### Human

Normalized Mean Score: 0.007. Result ID: 6a157114fbc373592c0d6582.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76fd1e209131cea70456.md>)

Recorded evaluation configuration: {"Module ablation setting":"PCGRLLM"}. This record does not assert independent reproduction.

### CoT

Normalized Mean Score: 0. Result ID: 6a157114fbc373592c0d6575.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76fd1e209131cea70456.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76fd1e209131cea70456.md>)

Recorded evaluation configuration: {"Module ablation setting":"Zero-shot (ZS)"}. This record does not assert independent reproduction.

### ToT

Normalized Mean Score: 0. Result ID: 6a157114fbc373592c0d6579.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76fd1e209131cea70456.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76fd1e209131cea70456.md>)

Recorded evaluation configuration: {"Module ablation setting":"Zero-shot (ZS)"}. This record does not assert independent reproduction.

### GoT

Normalized Mean Score: 0. Result ID: 6a157114fbc373592c0d657e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76fd1e209131cea70456.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76fd1e209131cea70456.md>)

Recorded evaluation configuration: {"Module ablation setting":"+Self-alignment (SA)"}. This record does not assert independent reproduction.

### Human

Normalized Mean Score: 0. Result ID: 6a157114fbc373592c0d6581.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76fd1e209131cea70456.md>)

Recorded evaluation configuration: {"Module ablation setting":"Zero-shot (ZS)"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
