# Search and Attack (SAA) on SAA Program Large Instances (UM Behavior)

Source: [Search and Attack (SAA) on SAA Program Large Instances (UM Behavior)](<https://www.sota2.com/research/sota/search-and-attack-saa-on-saa-program-large-instances-um-behavior>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-03-11T06:33:32.221Z

Evaluation of Search and Attack (SAA) performance on the Large Instances subset of the UM Behavior data, measured using VSS metrics.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Search and Attack (SAA) |
| Dataset (including any stated split) | SAA Program Large Instances (UM Behavior) |
| Metric | VSS |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 18 of 18 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [VSS](<https://www.sota2.com/research/sota/search-and-attack-saa-on-saa-program-large-instances-um-behavior.md?metric=VSS>): Higher is better; unit: SCALAR.

- [VSS-E](<https://www.sota2.com/research/sota/search-and-attack-saa-on-saa-program-large-instances-um-behavior.md?metric=VSS-E>): Higher is better; unit: SCALAR.

- [VSS-I](<https://www.sota2.com/research/sota/search-and-attack-saa-on-saa-program-large-instances-um-behavior.md?metric=VSS-I>): Higher is better; unit: SCALAR.

## Recorded results

| Method | VSS | Result date | Report paper |
| --- | --- | --- | --- |
| SAA Program (7) | 11.149 | Not recorded | 68fa5dc21e209131ce9dc920 |
| SAA Program (7) | 9.824 | Not recorded | 68fa5dc21e209131ce9dc920 |
| SAA Program (7) | 9.336 | Not recorded | 68fa5dc21e209131ce9dc920 |
| SAA Program (7) | 7.732 | Not recorded | 68fa5dc21e209131ce9dc920 |
| SAA Program (7) | 7.024 | Not recorded | 68fa5dc21e209131ce9dc920 |
| SAA Program (7) | 5.91 | Not recorded | 68fa5dc21e209131ce9dc920 |
| SAA Program (7) | 5.566 | Not recorded | 68fa5dc21e209131ce9dc920 |
| SAA Program (7) | 5.198 | Not recorded | 68fa5dc21e209131ce9dc920 |
| SAA Program (7) | 3.708 | Not recorded | 68fa5dc21e209131ce9dc920 |
| SAA Program (7) | 2.118 | Not recorded | 68fa5dc21e209131ce9dc920 |
| SAA Program (7) | 1.904 | Not recorded | 68fa5dc21e209131ce9dc920 |
| SAA Program (7) | 1.534 | Not recorded | 68fa5dc21e209131ce9dc920 |
| SAA Program (7) | 0.377 | Not recorded | 68fa5dc21e209131ce9dc920 |
| SAA Program (7) | 0.323 | Not recorded | 68fa5dc21e209131ce9dc920 |
| SAA Program (7) | 0.301 | Not recorded | 68fa5dc21e209131ce9dc920 |
| SAA Program (7) | 0.044 | Not recorded | 68fa5dc21e209131ce9dc920 |
| SAA Program (7) | 0.041 | Not recorded | 68fa5dc21e209131ce9dc920 |
| SAA Program (7) | 0.036 | Not recorded | 68fa5dc21e209131ce9dc920 |

### SAA Program (7)

VSS: 11.149. Result ID: 69b10ca56dbb7075b95abbf1.

[Reporting paper](<https://www.sota2.com/research/paper/68fa5dc21e209131ce9dc920.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa5dc21e209131ce9dc920.md>)

Recorded evaluation configuration: {"Budget (B)":"60","List size limit (K)":"4"}. This record does not assert independent reproduction.

### SAA Program (7)

VSS: 9.824. Result ID: 69b10ca56dbb7075b95abbf0.

[Reporting paper](<https://www.sota2.com/research/paper/68fa5dc21e209131ce9dc920.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa5dc21e209131ce9dc920.md>)

Recorded evaluation configuration: {"Budget (B)":"60","List size limit (K)":"3"}. This record does not assert independent reproduction.

### SAA Program (7)

VSS: 9.336. Result ID: 69b10ca56dbb7075b95abbee.

[Reporting paper](<https://www.sota2.com/research/paper/68fa5dc21e209131ce9dc920.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa5dc21e209131ce9dc920.md>)

Recorded evaluation configuration: {"Budget (B)":"45","List size limit (K)":"4"}. This record does not assert independent reproduction.

### SAA Program (7)

VSS: 7.732. Result ID: 69b10ca56dbb7075b95abbed.

[Reporting paper](<https://www.sota2.com/research/paper/68fa5dc21e209131ce9dc920.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa5dc21e209131ce9dc920.md>)

Recorded evaluation configuration: {"Budget (B)":"45","List size limit (K)":"3"}. This record does not assert independent reproduction.

### SAA Program (7)

VSS: 7.024. Result ID: 69b10ca56dbb7075b95abbef.

[Reporting paper](<https://www.sota2.com/research/paper/68fa5dc21e209131ce9dc920.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa5dc21e209131ce9dc920.md>)

Recorded evaluation configuration: {"Budget (B)":"60","List size limit (K)":"2"}. This record does not assert independent reproduction.

### SAA Program (7)

VSS: 5.91. Result ID: 69b10ca56dbb7075b95abbeb.

[Reporting paper](<https://www.sota2.com/research/paper/68fa5dc21e209131ce9dc920.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa5dc21e209131ce9dc920.md>)

Recorded evaluation configuration: {"Budget (B)":"30","List size limit (K)":"4"}. This record does not assert independent reproduction.

### SAA Program (7)

VSS: 5.566. Result ID: 69b10ca56dbb7075b95abbec.

[Reporting paper](<https://www.sota2.com/research/paper/68fa5dc21e209131ce9dc920.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa5dc21e209131ce9dc920.md>)

Recorded evaluation configuration: {"Budget (B)":"45","List size limit (K)":"2"}. This record does not assert independent reproduction.

### SAA Program (7)

VSS: 5.198. Result ID: 69b10ca56dbb7075b95abbea.

[Reporting paper](<https://www.sota2.com/research/paper/68fa5dc21e209131ce9dc920.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa5dc21e209131ce9dc920.md>)

Recorded evaluation configuration: {"Budget (B)":"30","List size limit (K)":"3"}. This record does not assert independent reproduction.

### SAA Program (7)

VSS: 3.708. Result ID: 69b10ca56dbb7075b95abbe9.

[Reporting paper](<https://www.sota2.com/research/paper/68fa5dc21e209131ce9dc920.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa5dc21e209131ce9dc920.md>)

Recorded evaluation configuration: {"Budget (B)":"30","List size limit (K)":"2"}. This record does not assert independent reproduction.

### SAA Program (7)

VSS: 2.118. Result ID: 69b10ca56dbb7075b95abbe8.

[Reporting paper](<https://www.sota2.com/research/paper/68fa5dc21e209131ce9dc920.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa5dc21e209131ce9dc920.md>)

Recorded evaluation configuration: {"Budget (B)":"15","List size limit (K)":"4"}. This record does not assert independent reproduction.

### SAA Program (7)

VSS: 1.904. Result ID: 69b10ca56dbb7075b95abbe7.

[Reporting paper](<https://www.sota2.com/research/paper/68fa5dc21e209131ce9dc920.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa5dc21e209131ce9dc920.md>)

Recorded evaluation configuration: {"Budget (B)":"15","List size limit (K)":"3"}. This record does not assert independent reproduction.

### SAA Program (7)

VSS: 1.534. Result ID: 69b10ca56dbb7075b95abbe6.

[Reporting paper](<https://www.sota2.com/research/paper/68fa5dc21e209131ce9dc920.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa5dc21e209131ce9dc920.md>)

Recorded evaluation configuration: {"Budget (B)":"15","List size limit (K)":"2"}. This record does not assert independent reproduction.

### SAA Program (7)

VSS: 0.377. Result ID: 69b10ca56dbb7075b95abbe4.

[Reporting paper](<https://www.sota2.com/research/paper/68fa5dc21e209131ce9dc920.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa5dc21e209131ce9dc920.md>)

Recorded evaluation configuration: {"Budget (B)":"5","List size limit (K)":"3"}. This record does not assert independent reproduction.

### SAA Program (7)

VSS: 0.323. Result ID: 69b10ca56dbb7075b95abbe3.

[Reporting paper](<https://www.sota2.com/research/paper/68fa5dc21e209131ce9dc920.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa5dc21e209131ce9dc920.md>)

Recorded evaluation configuration: {"Budget (B)":"5","List size limit (K)":"2"}. This record does not assert independent reproduction.

### SAA Program (7)

VSS: 0.301. Result ID: 69b10ca56dbb7075b95abbe5.

[Reporting paper](<https://www.sota2.com/research/paper/68fa5dc21e209131ce9dc920.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa5dc21e209131ce9dc920.md>)

Recorded evaluation configuration: {"Budget (B)":"5","List size limit (K)":"4"}. This record does not assert independent reproduction.

### SAA Program (7)

VSS: 0.044. Result ID: 69b10ca56dbb7075b95abbe0.

[Reporting paper](<https://www.sota2.com/research/paper/68fa5dc21e209131ce9dc920.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa5dc21e209131ce9dc920.md>)

Recorded evaluation configuration: {"Budget (B)":"1","List size limit (K)":"2"}. This record does not assert independent reproduction.

### SAA Program (7)

VSS: 0.041. Result ID: 69b10ca56dbb7075b95abbe1.

[Reporting paper](<https://www.sota2.com/research/paper/68fa5dc21e209131ce9dc920.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa5dc21e209131ce9dc920.md>)

Recorded evaluation configuration: {"Budget (B)":"1","List size limit (K)":"3"}. This record does not assert independent reproduction.

### SAA Program (7)

VSS: 0.036. Result ID: 69b10ca56dbb7075b95abbe2.

[Reporting paper](<https://www.sota2.com/research/paper/68fa5dc21e209131ce9dc920.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa5dc21e209131ce9dc920.md>)

Recorded evaluation configuration: {"Budget (B)":"1","List size limit (K)":"4"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
