# Model Reconstruction on COMPAS

Source: [Model Reconstruction on COMPAS](<https://www.sota2.com/research/sota/model-reconstruction-on-compas>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-06-29T07:14:14.948Z

Evaluation of Model Reconstruction performance on the COMPAS dataset, typically measured using Average fidelity.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Model Reconstruction |
| Dataset (including any stated split) | COMPAS |
| Metric | Avg Fidelity |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 19 of 19 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Avg Fidelity](<https://www.sota2.com/research/sota/model-reconstruction-on-compas.md?metric=Avg%20Fidelity>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Avg Fidelity | Result date | Report paper |
| --- | --- | --- | --- |
| Counterfactual-Aware Wasserstein Prototypes | 96 | Not recorded | 693ba17f6cfd488761a55200 |
| Baseline 2 | 94 | Not recorded | 693ba17f6cfd488761a55200 |
| Counterfactual-Aware Wasserstein Prototypes | 94 | Not recorded | 693ba17f6cfd488761a55200 |
| Counterfactual-Aware Wasserstein Prototypes | 94 | Not recorded | 693ba17f6cfd488761a55200 |
| Baseline 1 | 92 | Not recorded | 693ba17f6cfd488761a55200 |
| Baseline 2 | 92 | Not recorded | 693ba17f6cfd488761a55200 |
| Baseline 1 | 90 | Not recorded | 693ba17f6cfd488761a55200 |
| Baseline 2 | 90 | Not recorded | 693ba17f6cfd488761a55200 |
| Baseline 1 | 88 | Not recorded | 693ba17f6cfd488761a55200 |
| RECAST | 86.9 | Not recorded | 6a41fbeb206542251d7cca03 |
| RECAST | 85.5 | Not recorded | 6a41fbeb206542251d7cca03 |
| TRA | 82.6 | Not recorded | 6a41fbeb206542251d7cca03 |
| RECAST | 82.1 | Not recorded | 6a41fbeb206542251d7cca03 |
| CCA | 78.5 | Not recorded | 6a41fbeb206542251d7cca03 |
| CCA | 76.5 | Not recorded | 6a41fbeb206542251d7cca03 |
| CCA | 65.7 | Not recorded | 6a41fbeb206542251d7cca03 |
| SAMPLES | 54.3 | Not recorded | 6a41fbeb206542251d7cca03 |
| SAMPLES | 41.5 | Not recorded | 6a41fbeb206542251d7cca03 |
| SAMPLES | 39.6 | Not recorded | 6a41fbeb206542251d7cca03 |

### Counterfactual-Aware Wasserstein Prototypes

Avg Fidelity: 96. Result ID: 69996d545698665ec4db225e.

[Reporting paper](<https://www.sota2.com/research/paper/693ba17f6cfd488761a55200.md>)

[Method origin paper](<https://www.sota2.com/research/paper/693ba17f6cfd488761a55200.md>)

Recorded evaluation configuration: {"Query Size":"500"}. This record does not assert independent reproduction.

### Baseline 2

Avg Fidelity: 94. Result ID: 69996d545698665ec4db225d.

[Reporting paper](<https://www.sota2.com/research/paper/693ba17f6cfd488761a55200.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa5c951e209131ce9d23b4.md>)

Recorded evaluation configuration: {"Query Size":"500"}. This record does not assert independent reproduction.

### Counterfactual-Aware Wasserstein Prototypes

Avg Fidelity: 94. Result ID: 69996d545698665ec4db2261.

[Reporting paper](<https://www.sota2.com/research/paper/693ba17f6cfd488761a55200.md>)

[Method origin paper](<https://www.sota2.com/research/paper/693ba17f6cfd488761a55200.md>)

Recorded evaluation configuration: {"Query Size":"400"}. This record does not assert independent reproduction.

### Counterfactual-Aware Wasserstein Prototypes

Avg Fidelity: 94. Result ID: 69996d545698665ec4db2264.

[Reporting paper](<https://www.sota2.com/research/paper/693ba17f6cfd488761a55200.md>)

[Method origin paper](<https://www.sota2.com/research/paper/693ba17f6cfd488761a55200.md>)

Recorded evaluation configuration: {"Query Size":"300"}. This record does not assert independent reproduction.

### Baseline 1

Avg Fidelity: 92. Result ID: 69996d545698665ec4db225c.

[Reporting paper](<https://www.sota2.com/research/paper/693ba17f6cfd488761a55200.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa68451e209131cea1aee8.md>)

Recorded evaluation configuration: {"Query Size":"500"}. This record does not assert independent reproduction.

### Baseline 2

Avg Fidelity: 92. Result ID: 69996d545698665ec4db2260.

[Reporting paper](<https://www.sota2.com/research/paper/693ba17f6cfd488761a55200.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa5c951e209131ce9d23b4.md>)

Recorded evaluation configuration: {"Query Size":"400"}. This record does not assert independent reproduction.

### Baseline 1

Avg Fidelity: 90. Result ID: 69996d545698665ec4db225f.

[Reporting paper](<https://www.sota2.com/research/paper/693ba17f6cfd488761a55200.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa68451e209131cea1aee8.md>)

Recorded evaluation configuration: {"Query Size":"400"}. This record does not assert independent reproduction.

### Baseline 2

Avg Fidelity: 90. Result ID: 69996d545698665ec4db2263.

[Reporting paper](<https://www.sota2.com/research/paper/693ba17f6cfd488761a55200.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa5c951e209131ce9d23b4.md>)

Recorded evaluation configuration: {"Query Size":"300"}. This record does not assert independent reproduction.

### Baseline 1

Avg Fidelity: 88. Result ID: 69996d545698665ec4db2262.

[Reporting paper](<https://www.sota2.com/research/paper/693ba17f6cfd488761a55200.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa68451e209131cea1aee8.md>)

Recorded evaluation configuration: {"Query Size":"300"}. This record does not assert independent reproduction.

### RECAST

Avg Fidelity: 86.9. Result ID: 6a421b3dfbc373592c871e63.

[Reporting paper](<https://www.sota2.com/research/paper/6a41fbeb206542251d7cca03.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a41fbeb206542251d7cca03.md>)

Recorded evaluation configuration: {"Target Model":"DT","Query Size":"100","CF Generation Method":"MCCF"}. This record does not assert independent reproduction.

### RECAST

Avg Fidelity: 85.5. Result ID: 6a421b3dfbc373592c871e5d.

[Reporting paper](<https://www.sota2.com/research/paper/6a41fbeb206542251d7cca03.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a41fbeb206542251d7cca03.md>)

Recorded evaluation configuration: {"Target Model":"MLP","Query Size":"100","CF Generation Method":"MCCF"}. This record does not assert independent reproduction.

### TRA

Avg Fidelity: 82.6. Result ID: 6a421b3dfbc373592c871e64.

[Reporting paper](<https://www.sota2.com/research/paper/6a41fbeb206542251d7cca03.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79ef1e209131cea80192.md>)

Recorded evaluation configuration: {"Target Model":"DT","Query Size":"100","CF Generation Method":"MCCF"}. This record does not assert independent reproduction.

### RECAST

Avg Fidelity: 82.1. Result ID: 6a421b3dfbc373592c871e60.

[Reporting paper](<https://www.sota2.com/research/paper/6a41fbeb206542251d7cca03.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a41fbeb206542251d7cca03.md>)

Recorded evaluation configuration: {"Target Model":"LR","Query Size":"100","CF Generation Method":"MCCF"}. This record does not assert independent reproduction.

### CCA

Avg Fidelity: 78.5. Result ID: 6a421b3dfbc373592c871e5f.

[Reporting paper](<https://www.sota2.com/research/paper/6a41fbeb206542251d7cca03.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa5c951e209131ce9d23b4.md>)

Recorded evaluation configuration: {"Target Model":"LR","Query Size":"100","CF Generation Method":"MCCF"}. This record does not assert independent reproduction.

### CCA

Avg Fidelity: 76.5. Result ID: 6a421b3dfbc373592c871e5c.

[Reporting paper](<https://www.sota2.com/research/paper/6a41fbeb206542251d7cca03.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa5c951e209131ce9d23b4.md>)

Recorded evaluation configuration: {"Target Model":"MLP","Query Size":"100","CF Generation Method":"MCCF"}. This record does not assert independent reproduction.

### CCA

Avg Fidelity: 65.7. Result ID: 6a421b3dfbc373592c871e62.

[Reporting paper](<https://www.sota2.com/research/paper/6a41fbeb206542251d7cca03.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa5c951e209131ce9d23b4.md>)

Recorded evaluation configuration: {"Target Model":"DT","Query Size":"100","CF Generation Method":"MCCF"}. This record does not assert independent reproduction.

### SAMPLES

Avg Fidelity: 54.3. Result ID: 6a421b3dfbc373592c871e5e.

[Reporting paper](<https://www.sota2.com/research/paper/6a41fbeb206542251d7cca03.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa68451e209131cea1aee8.md>)

Recorded evaluation configuration: {"Target Model":"LR","Query Size":"100","CF Generation Method":"MCCF"}. This record does not assert independent reproduction.

### SAMPLES

Avg Fidelity: 41.5. Result ID: 6a421b3dfbc373592c871e5b.

[Reporting paper](<https://www.sota2.com/research/paper/6a41fbeb206542251d7cca03.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa68451e209131cea1aee8.md>)

Recorded evaluation configuration: {"Target Model":"MLP","Query Size":"100","CF Generation Method":"MCCF"}. This record does not assert independent reproduction.

### SAMPLES

Avg Fidelity: 39.6. Result ID: 6a421b3dfbc373592c871e61.

[Reporting paper](<https://www.sota2.com/research/paper/6a41fbeb206542251d7cca03.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa68451e209131cea1aee8.md>)

Recorded evaluation configuration: {"Target Model":"DT","Query Size":"100","CF Generation Method":"MCCF"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
