# Dataset Diversity and Coverage Evaluation on MIRAGE 3-app overlap

Source: [Dataset Diversity and Coverage Evaluation on MIRAGE 3-app overlap](<https://www.sota2.com/research/sota/dataset-diversity-and-coverage-evaluation-on-mirage-3-app-overlap>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-05-28T09:01:56.920Z

Evaluation of model performance on the MIRAGE 3-app overlap subset, focusing on dataset diversity and coverage metrics like Goal-text entropy and Action coverage.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Dataset Diversity and Coverage Evaluation |
| Dataset (including any stated split) | MIRAGE 3-app overlap |
| Metric | Goal-Text Entropy |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 1 of 1 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Goal-Text Entropy](<https://www.sota2.com/research/sota/dataset-diversity-and-coverage-evaluation-on-mirage-3-app-overlap.md?metric=Goal-Text%20Entropy>): Higher is better; unit: SCALAR.

- [CLIP Pairwise Distance (per-base)](<https://www.sota2.com/research/sota/dataset-diversity-and-coverage-evaluation-on-mirage-3-app-overlap.md?metric=CLIP%20Pairwise%20Distance%20(per-base)>): Lower is better; unit: SCALAR.

- [Action Coverage Count](<https://www.sota2.com/research/sota/dataset-diversity-and-coverage-evaluation-on-mirage-3-app-overlap.md?metric=Action%20Coverage%20Count>): Higher is better; unit: SCALAR.

## Recorded results

| Method | Goal-Text Entropy | Result date | Report paper |
| --- | --- | --- | --- |
| MIRAGE (3-app overlap; 30 unique base) | 0.918 | Not recorded | 6a17cc01dbd7150506f8123a |

### MIRAGE (3-app overlap; 30 unique base)

Goal-Text Entropy: 0.918. Result ID: 6a18032ffbc373592c11e23e.

[Reporting paper](<https://www.sota2.com/research/paper/6a17cc01dbd7150506f8123a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a17cc01dbd7150506f8123a.md>)

Recorded evaluation configuration: {"n":"376"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
