Concept Awakening on ImageNette & Harmful Concepts Quantitative Assessment (200 images per concept)
95AccuracyOriginal Diffusion Model
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Original Diffusion ModelMLLM=GPT-5, Concept=Golf Ball, Erasure Context=None2026.05 | 95 | 33.18 | |
| Original Diffusion ModelMLLM=Gemini 3.0, Concept=Average, Erasure Context=None2026.05 | 90 | 31.46 | |
| Original Diffusion ModelMLLM=GPT-5, Concept=Average, Erasure Context=None2026.05 | 90 | 31.46 | |
| ConceptAgentMLLM=Qwen-7B, Concept=Pistol, Erasure Context=RECE2026.05 | 87.5 | 28.21 | |
| ConceptAgentMLLM=Qwen-7B, Concept=Pistol, Erasure Context=SPEED2026.05 | 87.5 | 27.79 | |
| ConceptAgentMLLM=Qwen-7B, Concept=Pistol, Erasure Context=UCE2026.05 | 85 | 28.89 | |
| ConceptAgentMLLM=Gemini 3.0, Concept=Average, Erasure Context=UCE2026.05 | 83.6 | 30.06 | |
| ConceptAgentMLLM=GPT-5, Concept=Average, Erasure Context=UCE2026.05 | 83.6 | 29.69 | |
| ConceptAgentMLLM=Gemini 3.0, Concept=Average, Erasure Context=SPEED2026.05 | 82.9 | 30.12 | |
| ConceptAgentMLLM=GPT-5, Concept=Golf Ball, Erasure Context=UCE2026.05 | 79.5 | 30.62 | |
| ConceptAgentMLLM=GPT-5, Concept=Golf Ball, Erasure Context=RECE2026.05 | 77 | 30.63 | |
| ConceptAgentMLLM=GPT-5, Concept=Average, Erasure Context=SPEED2026.05 | 76.9 | 29.73 | |
| ConceptAgentMLLM=Gemini 3.0, Concept=Average, Erasure Context=RECE2026.05 | 76.4 | 29.6 | |
| ConceptAgentMLLM=GPT-5, Concept=Golf Ball, Erasure Context=SPEED2026.05 | 75.5 | 31.59 | |
| ConceptAgentMLLM=GPT-5, Concept=Average, Erasure Context=RECE2026.05 | 74.8 | 29.28 | |
| SPEEDMLLM=GPT-5, Concept=Golf Ball, Erasure Context=SPEED2026.05 | 31 | 18.89 | |
| SPEEDMLLM=GPT-5, Concept=Average, Erasure Context=SPEED2026.05 | 21.9 | 20.06 | |
| UCEMLLM=GPT-5, Concept=Average, Erasure Context=UCE2026.05 | 5.3 | 18.57 | |
| UCEMLLM=GPT-5, Concept=Golf Ball, Erasure Context=UCE2026.05 | 0.5 | 18.33 | |
| RECEMLLM=GPT-5, Concept=Golf Ball, Erasure Context=RECE2026.05 | 0 | 18.09 | |
| RECEMLLM=GPT-5, Concept=Average, Erasure Context=RECE2026.05 | 0 | 18.57 |