# Privacy Protection Analysis on MedMCQA (test)

Source: [Privacy Protection Analysis on MedMCQA (test)](<https://www.sota2.com/research/sota/privacy-protection-analysis-on-medmcqa-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-03-12T08:25:38.483Z

Evaluation of privacy protection mechanisms on the test split of the MedMCQA dataset, focusing on membership inference attack scores (MIA), privacy risk assessment, differential privacy strength, and generalization metrics.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Privacy Protection Analysis |
| Dataset (including any stated split) | MedMCQA (test) |
| Metric | MIA Score |
| Unit | SCALAR |
| Direction | Lower is better |
| Results loaded | 6 of 6 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [MIA Score](<https://www.sota2.com/research/sota/privacy-protection-analysis-on-medmcqa-test.md?metric=MIA%20Score>): Lower is better; unit: SCALAR.

- [Privacy Risk](<https://www.sota2.com/research/sota/privacy-protection-analysis-on-medmcqa-test.md?metric=Privacy%20Risk>): Lower is better; unit: SCALAR.

- [DP Strength](<https://www.sota2.com/research/sota/privacy-protection-analysis-on-medmcqa-test.md?metric=DP%20Strength>): Higher is better; unit: SCALAR.

- [AUC](<https://www.sota2.com/research/sota/privacy-protection-analysis-on-medmcqa-test.md?metric=AUC>): Higher is better; unit: PERCENT.

- [Epsilon (ε)](<https://www.sota2.com/research/sota/privacy-protection-analysis-on-medmcqa-test.md?metric=Epsilon%20(%CE%B5)>): Lower is better; unit: SCALAR.

## Recorded results

| Method | MIA Score | Result date | Report paper |
| --- | --- | --- | --- |
| Original Model | 0.52 | Not recorded | 69268969d6b0dd3342930255 |
| Gradient Ascent | 0.71 | Not recorded | 69268969d6b0dd3342930255 |
| SUGD | 0.74 | Not recorded | 69268969d6b0dd3342930255 |
| AILS-NTUA | 0.82 | Not recorded | 69268969d6b0dd3342930255 |
| DuoLearn (Dual-Strategy) | 0.89 | Not recorded | 69268969d6b0dd3342930255 |
| Complete Retraining | 0.95 | Not recorded | 69268969d6b0dd3342930255 |

### Original Model

MIA Score: 0.52. Result ID: 69b278696dbb7075b95d0a9f.

[Reporting paper](<https://www.sota2.com/research/paper/69268969d6b0dd3342930255.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Gradient Ascent

MIA Score: 0.71. Result ID: 69b278696dbb7075b95d0aa1.

[Reporting paper](<https://www.sota2.com/research/paper/69268969d6b0dd3342930255.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa732f1e209131cea5af82.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### SUGD

MIA Score: 0.74. Result ID: 69b278696dbb7075b95d0aa2.

[Reporting paper](<https://www.sota2.com/research/paper/69268969d6b0dd3342930255.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### AILS-NTUA

MIA Score: 0.82. Result ID: 69b278696dbb7075b95d0aa3.

[Reporting paper](<https://www.sota2.com/research/paper/69268969d6b0dd3342930255.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a561e209131cea82962.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### DuoLearn (Dual-Strategy)

MIA Score: 0.89. Result ID: 69b278696dbb7075b95d0aa4.

[Reporting paper](<https://www.sota2.com/research/paper/69268969d6b0dd3342930255.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69268969d6b0dd3342930255.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Complete Retraining

MIA Score: 0.95. Result ID: 69b278696dbb7075b95d0aa0.

[Reporting paper](<https://www.sota2.com/research/paper/69268969d6b0dd3342930255.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75011e209131cea652f5.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.