Training Data Exposure Detection on PMC-OA vs ROCO (train/non-train)
66.5AUCGradAudit
Evaluation results
| Method | Links | ||
|---|---|---|---|
| GradAuditModel=BiomedCLIP, Architecture=Contrastive, Params=200M, Training Stage=Pretrain2026.06 | 66.5 | 23.8 | |
| GradAuditModel=LLaVA-Med, Architecture=Generation, Params=7.3B, Training Stage=Pretrain2026.06 | 66.1 | 13.5 | |
| DC-PDDModel=LLaVA-Med, Architecture=Generation, Params=7.3B, Training Stage=Pretrain2026.06 | 63.9 | 12.9 | |
| ZlibModel=LLaVA-Med, Architecture=Generation, Params=7.3B, Training Stage=Pretrain2026.06 | 61.6 | 6.45 | |
| ZlibModel=BiomedCLIP, Architecture=Contrastive, Params=200M, Training Stage=Pretrain2026.06 | 60.9 | 2.3 | |
| M4IModel=LLaVA-Med, Architecture=Generation, Params=7.3B, Training Stage=Pretrain2026.06 | 60.2 | 12.8 | |
| Min-K++Model=LLaVA-Med, Architecture=Generation, Params=7.3B, Training Stage=Pretrain2026.06 | 59.3 | 1.4 | |
| SimilarityModel=BiomedCLIP, Architecture=Contrastive, Params=200M, Training Stage=Pretrain2026.06 | 59.3 | 4.2 | |
| Min-KModel=LLaVA-Med, Architecture=Generation, Params=7.3B, Training Stage=Pretrain2026.06 | 59 | 5.61 | |
| EntropyModel=LLaVA-Med, Architecture=Generation, Params=7.3B, Training Stage=Pretrain2026.06 | 58.2 | 8.31 | |
| EntropyModel=BiomedCLIP, Architecture=Contrastive, Params=200M, Training Stage=Pretrain2026.06 | 57.9 | 19.3 | |
| LossModel=LLaVA-Med, Architecture=Generation, Params=7.3B, Training Stage=Pretrain2026.06 | 57.3 | 12.5 | |
| ModRenyiModel=BiomedCLIP, Architecture=Contrastive, Params=200M, Training Stage=Pretrain2026.06 | 55.9 | 2.9 | |
| Min-K++Model=BiomedCLIP, Architecture=Contrastive, Params=200M, Training Stage=Pretrain2026.06 | 53.5 | 23.5 | |
| LossModel=BiomedCLIP, Architecture=Contrastive, Params=200M, Training Stage=Pretrain2026.06 | 53.2 | 20 | |
| DC-PDDModel=BiomedCLIP, Architecture=Contrastive, Params=200M, Training Stage=Pretrain2026.06 | 53.2 | 11.9 | |
| M4IModel=BiomedCLIP, Architecture=Contrastive, Params=200M, Training Stage=Pretrain2026.06 | 52.8 | 8.9 | |
| Min-KModel=BiomedCLIP, Architecture=Contrastive, Params=200M, Training Stage=Pretrain2026.06 | 52.7 | 4.3 | |
| SimilarityModel=LLaVA-Med, Architecture=Generation, Params=7.3B, Training Stage=Pretrain2026.06 | 51.8 | 7.41 | |
| ModRenyiModel=LLaVA-Med, Architecture=Generation, Params=7.3B, Training Stage=Pretrain2026.06 | 51.1 | 5.46 | |
| GradNormModel=BiomedCLIP, Architecture=Contrastive, Params=200M, Training Stage=Pretrain2026.06 | 50.5 | 17.3 | |
| GradNormModel=LLaVA-Med, Architecture=Generation, Params=7.3B, Training Stage=Pretrain2026.06 | 43.2 | 3.1 |