Hierarchical Unlearning on MedForget 1.0 (Retain)
99.65Generation ScoreVanilla
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| VanillaHierarchy=Patient2025.12 | 99.65 | 100 | 100 | 0.82 | |
| VanillaHierarchy=Study2025.12 | 99.27 | 100 | 100 | -0.2 | |
| VanillaHierarchy=Section2025.12 | 99.23 | 100 | 100 | -0.61 | |
| VanillaHierarchy=Institution2025.12 | 98.97 | 100 | 100 | -0.28 | |
| KL Min.Hierarchy=Section2025.12 | 53.52 | 98.86 | 99.81 | 9.99 | |
| CHIPHierarchy=Institution2025.12 | 51.96 | 97.06 | 73.16 | 12.6 | |
| KL Min.Hierarchy=Patient2025.12 | 51.49 | 95.03 | 99 | 8.3 | |
| KL Min.Hierarchy=Institution2025.12 | 51.49 | 98.56 | 98.92 | 10.81 | |
| NPOHierarchy=Institution2025.12 | 50.79 | 99.77 | 99.92 | 7.99 | |
| NPOHierarchy=Patient2025.12 | 50.72 | 98.81 | 99.96 | 5.91 | |
| NPOHierarchy=Section2025.12 | 50.66 | 96.72 | 99.68 | 6.04 | |
| Grad. Diff.Hierarchy=Institution2025.12 | 50.27 | 94.94 | 96.38 | 9.8 | |
| CHIPHierarchy=Study2025.12 | 50.14 | 96.31 | 78.77 | 9.86 | |
| NPOHierarchy=Study2025.12 | 50.08 | 98.89 | 99.94 | 5.88 | |
| Grad. Diff.Hierarchy=Study2025.12 | 49.83 | 95.58 | 99.61 | 4.91 | |
| Grad. Diff.Hierarchy=Section2025.12 | 48.38 | 97.62 | 99.64 | 3.14 | |
| CHIPHierarchy=Patient2025.12 | 48.12 | 97.46 | 75.55 | 9.11 | |
| MANUHierarchy=Section2025.12 | 47.81 | 99.97 | 86.07 | 3 | |
| MANUHierarchy=Study2025.12 | 47.45 | 98.74 | 83.12 | 3.7 | |
| MANUHierarchy=Institution2025.12 | 47.24 | 96.82 | 80.46 | 5.76 | |
| CHIPHierarchy=Section2025.12 | 47.2 | 97.11 | 78.57 | 6.56 | |
| Grad. Diff.Hierarchy=Patient2025.12 | 46.45 | 95.54 | 97.14 | 6.93 | |
| KL Min.Hierarchy=Study2025.12 | 45.7 | 99.16 | 99.47 | 2.84 | |
| MANUHierarchy=Patient2025.12 | 44.84 | 96.55 | 80.44 | 4.86 |