# Action Prediction on Mini-grid 4x4

Source: [Action Prediction on Mini-grid 4x4](<https://www.sota2.com/research/sota/action-prediction-on-mini-grid-4x4>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-06-08T06:42:05.899Z

Evaluation of agent performance on predicting subsequent actions within the 4x4 variant of the MiniGrid environment, measured by Accuracy, Expected Calibration Error (ECE), Brier Score (BS), and Distributional Accuracy (DA).

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Action Prediction |
| Dataset (including any stated split) | Mini-grid 4x4 |
| Metric | Accuracy |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 4 of 4 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Accuracy](<https://www.sota2.com/research/sota/action-prediction-on-mini-grid-4x4.md?metric=Accuracy>): Higher is better; unit: PERCENT.

- [Expected Calibration Error](<https://www.sota2.com/research/sota/action-prediction-on-mini-grid-4x4.md?metric=Expected%20Calibration%20Error>): Lower is better; unit: PERCENT.

- [Brier Score](<https://www.sota2.com/research/sota/action-prediction-on-mini-grid-4x4.md?metric=Brier%20Score>): Lower is better; unit: PERCENT.

- [Distributional Accuracy](<https://www.sota2.com/research/sota/action-prediction-on-mini-grid-4x4.md?metric=Distributional%20Accuracy>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Accuracy | Result date | Report paper |
| --- | --- | --- | --- |
| Unguided RL (PPO) | 99.17 | Not recorded | 6a264c8a90966ade919be9ad |
| Uncalibrated LLM | 99.17 | Not recorded | 6a264c8a90966ade919be9ad |
| ULPS | 99.17 | Not recorded | 6a264c8a90966ade919be9ad |
| Shoaeinaeini and Harrison | 90 | Not recorded | 6a264c8a90966ade919be9ad |

### Unguided RL (PPO)

Accuracy: 99.17. Result ID: 6a2662e6fbc373592c227651.

[Reporting paper](<https://www.sota2.com/research/paper/6a264c8a90966ade919be9ad.md>)

Recorded evaluation configuration: {"Grid Size":"4x4"}. This record does not assert independent reproduction.

### Uncalibrated LLM

Accuracy: 99.17. Result ID: 6a2662e6fbc373592c227652.

[Reporting paper](<https://www.sota2.com/research/paper/6a264c8a90966ade919be9ad.md>)

Recorded evaluation configuration: {"Grid Size":"4x4"}. This record does not assert independent reproduction.

### ULPS

Accuracy: 99.17. Result ID: 6a2662e6fbc373592c227653.

[Reporting paper](<https://www.sota2.com/research/paper/6a264c8a90966ade919be9ad.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a264c8a90966ade919be9ad.md>)

Recorded evaluation configuration: {"Grid Size":"4x4"}. This record does not assert independent reproduction.

### Shoaeinaeini and Harrison

Accuracy: 90. Result ID: 6a2662e6fbc373592c227650.

[Reporting paper](<https://www.sota2.com/research/paper/6a264c8a90966ade919be9ad.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75dc1e209131cea6a4e3.md>)

Recorded evaluation configuration: {"Grid Size":"4x4"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.