# Agentic Sovereignty Resilience on SWE-bench

Source: [Agentic Sovereignty Resilience on SWE-bench](<https://www.sota2.com/research/sota/agentic-sovereignty-resilience-on-swe-bench>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-05-12T16:35:49.511Z

Evaluation of agent performance on Agentic Sovereignty Resilience tasks using the SWE-bench dataset, measured by metrics including Accuracy (A), Loafing (L), and Leakage (Lt).

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Agentic Sovereignty Resilience |
| Dataset (including any stated split) | SWE-bench |
| Metric | Accuracy (A) |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 15 of 15 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Accuracy (A)](<https://www.sota2.com/research/sota/agentic-sovereignty-resilience-on-swe-bench.md?metric=Accuracy%20(A)>): Higher is better; unit: PERCENT.

- [Loafing (L)](<https://www.sota2.com/research/sota/agentic-sovereignty-resilience-on-swe-bench.md?metric=Loafing%20(L)>): Lower is better; unit: PERCENT.

- [Leakage (Lt)](<https://www.sota2.com/research/sota/agentic-sovereignty-resilience-on-swe-bench.md?metric=Leakage%20(Lt)>): Lower is better; unit: PERCENT.

- [Ecd](<https://www.sota2.com/research/sota/agentic-sovereignty-resilience-on-swe-bench.md?metric=Ecd>): Lower is better; unit: SCALAR.

- [Eew](<https://www.sota2.com/research/sota/agentic-sovereignty-resilience-on-swe-bench.md?metric=Eew>): Lower is better; unit: SCALAR.

- [Eij](<https://www.sota2.com/research/sota/agentic-sovereignty-resilience-on-swe-bench.md?metric=Eij>): Lower is better; unit: SCALAR.

- [Adopted Rate](<https://www.sota2.com/research/sota/agentic-sovereignty-resilience-on-swe-bench.md?metric=Adopted%20Rate>): Higher is better; unit: PERCENT.

- [Rejected Rate](<https://www.sota2.com/research/sota/agentic-sovereignty-resilience-on-swe-bench.md?metric=Rejected%20Rate>): Lower is better; unit: PERCENT.

- [Ignored Rate](<https://www.sota2.com/research/sota/agentic-sovereignty-resilience-on-swe-bench.md?metric=Ignored%20Rate>): Lower is better; unit: PERCENT.

- [Unknown Rate](<https://www.sota2.com/research/sota/agentic-sovereignty-resilience-on-swe-bench.md?metric=Unknown%20Rate>): Lower is better; unit: PERCENT.

## Recorded results

| Method | Accuracy (A) | Result date | Report paper |
| --- | --- | --- | --- |
| Propagator C | 100 | Not recorded | 6a02b4abdbc836b87d824ee2 |
| Propagator C | 100 | Not recorded | 6a02b4abdbc836b87d824ee2 |
| Propagator C | 100 | Not recorded | 6a02b4abdbc836b87d824ee2 |
| Propagator C | 100 | Not recorded | 6a02b4abdbc836b87d824ee2 |
| Propagator C | 100 | Not recorded | 6a02b4abdbc836b87d824ee2 |
| Propagator G | 100 | Not recorded | 6a02b4abdbc836b87d824ee2 |
| Propagator G | 100 | Not recorded | 6a02b4abdbc836b87d824ee2 |
| Propagator P | 100 | Not recorded | 6a02b4abdbc836b87d824ee2 |
| Propagator P | 97 | Not recorded | 6a02b4abdbc836b87d824ee2 |
| Propagator G | 95 | Not recorded | 6a02b4abdbc836b87d824ee2 |
| Propagator G | 95 | Not recorded | 6a02b4abdbc836b87d824ee2 |
| Propagator G | 83 | Not recorded | 6a02b4abdbc836b87d824ee2 |
| Propagator P | 37 | Not recorded | 6a02b4abdbc836b87d824ee2 |
| Propagator P | 30 | Not recorded | 6a02b4abdbc836b87d824ee2 |
| Propagator P | 23 | Not recorded | 6a02b4abdbc836b87d824ee2 |

### Propagator C

Accuracy (A): 100. Result ID: 6a0356cc47f34ce924e8d868.

[Reporting paper](<https://www.sota2.com/research/paper/6a02b4abdbc836b87d824ee2.md>)

Recorded evaluation configuration: {"Prop.":"C","n":"0"}. This record does not assert independent reproduction.

### Propagator C

Accuracy (A): 100. Result ID: 6a0356cc47f34ce924e8d869.

[Reporting paper](<https://www.sota2.com/research/paper/6a02b4abdbc836b87d824ee2.md>)

Recorded evaluation configuration: {"Prop.":"C","n":"1"}. This record does not assert independent reproduction.

### Propagator C

Accuracy (A): 100. Result ID: 6a0356cc47f34ce924e8d86a.

[Reporting paper](<https://www.sota2.com/research/paper/6a02b4abdbc836b87d824ee2.md>)

Recorded evaluation configuration: {"Prop.":"C","n":"2"}. This record does not assert independent reproduction.

### Propagator C

Accuracy (A): 100. Result ID: 6a0356cc47f34ce924e8d86b.

[Reporting paper](<https://www.sota2.com/research/paper/6a02b4abdbc836b87d824ee2.md>)

Recorded evaluation configuration: {"Prop.":"C","n":"3"}. This record does not assert independent reproduction.

### Propagator C

Accuracy (A): 100. Result ID: 6a0356cc47f34ce924e8d86c.

[Reporting paper](<https://www.sota2.com/research/paper/6a02b4abdbc836b87d824ee2.md>)

Recorded evaluation configuration: {"Prop.":"C","n":"5"}. This record does not assert independent reproduction.

### Propagator G

Accuracy (A): 100. Result ID: 6a0356cc47f34ce924e8d86d.

[Reporting paper](<https://www.sota2.com/research/paper/6a02b4abdbc836b87d824ee2.md>)

Recorded evaluation configuration: {"Prop.":"G","n":"0"}. This record does not assert independent reproduction.

### Propagator G

Accuracy (A): 100. Result ID: 6a0356cc47f34ce924e8d86e.

[Reporting paper](<https://www.sota2.com/research/paper/6a02b4abdbc836b87d824ee2.md>)

Recorded evaluation configuration: {"Prop.":"G","n":"1"}. This record does not assert independent reproduction.

### Propagator P

Accuracy (A): 100. Result ID: 6a0356cc47f34ce924e8d872.

[Reporting paper](<https://www.sota2.com/research/paper/6a02b4abdbc836b87d824ee2.md>)

Recorded evaluation configuration: {"Prop.":"P","n":"0"}. This record does not assert independent reproduction.

### Propagator P

Accuracy (A): 97. Result ID: 6a0356cc47f34ce924e8d873.

[Reporting paper](<https://www.sota2.com/research/paper/6a02b4abdbc836b87d824ee2.md>)

Recorded evaluation configuration: {"Prop.":"P","n":"1"}. This record does not assert independent reproduction.

### Propagator G

Accuracy (A): 95. Result ID: 6a0356cc47f34ce924e8d870.

[Reporting paper](<https://www.sota2.com/research/paper/6a02b4abdbc836b87d824ee2.md>)

Recorded evaluation configuration: {"Prop.":"G","n":"3"}. This record does not assert independent reproduction.

### Propagator G

Accuracy (A): 95. Result ID: 6a0356cc47f34ce924e8d871.

[Reporting paper](<https://www.sota2.com/research/paper/6a02b4abdbc836b87d824ee2.md>)

Recorded evaluation configuration: {"Prop.":"G","n":"5"}. This record does not assert independent reproduction.

### Propagator G

Accuracy (A): 83. Result ID: 6a0356cc47f34ce924e8d86f.

[Reporting paper](<https://www.sota2.com/research/paper/6a02b4abdbc836b87d824ee2.md>)

Recorded evaluation configuration: {"Prop.":"G","n":"2"}. This record does not assert independent reproduction.

### Propagator P

Accuracy (A): 37. Result ID: 6a0356cc47f34ce924e8d876.

[Reporting paper](<https://www.sota2.com/research/paper/6a02b4abdbc836b87d824ee2.md>)

Recorded evaluation configuration: {"Prop.":"P","n":"5"}. This record does not assert independent reproduction.

### Propagator P

Accuracy (A): 30. Result ID: 6a0356cc47f34ce924e8d875.

[Reporting paper](<https://www.sota2.com/research/paper/6a02b4abdbc836b87d824ee2.md>)

Recorded evaluation configuration: {"Prop.":"P","n":"3"}. This record does not assert independent reproduction.

### Propagator P

Accuracy (A): 23. Result ID: 6a0356cc47f34ce924e8d874.

[Reporting paper](<https://www.sota2.com/research/paper/6a02b4abdbc836b87d824ee2.md>)

Recorded evaluation configuration: {"Prop.":"P","n":"2"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
