Privacy and Utility Evaluation on PasswordEval
100Privacy ScoreRANA
Evaluation results
| Method | Links | ||
|---|---|---|---|
| RANAFamily=Qwen3, Size=142026.02 | 100 | 65.45 | |
| RANAFamily=Qwen 3, Size=142026.02 | 100 | 65.45 | |
| RANAFamily=Qwen3, Size=82026.02 | 99.85 | 70.55 | |
| RANAFamily=Qwen 3, Size=82026.02 | 99.85 | 70.55 | |
| RANAFamily=Qwen3, Size=42026.02 | 99.82 | 67.85 | |
| RANAFamily=Qwen 3, Size=42026.02 | 99.82 | 67.85 | |
| RANAFamily=Phi 4, Size=142026.02 | 99.49 | 48.7 | |
| RANAFamily=Phi 4, Size=142026.02 | 99.49 | 48.7 | |
| RANAFamily=Qwen3, Size=1.72026.02 | 98.23 | 50.8 | |
| RANAFamily=Qwen 3, Size=1.72026.02 | 98.23 | 50.8 | |
| Staged DecodingFamily=Qwen3, Size=142026.02 | 93.07 | 83.05 | |
| Staged DecodingFamily=Qwen 3, Size=142026.02 | 93.07 | 83.05 | |
| RANAFamily=Phi 4, Size=3.82026.02 | 92.68 | 56.7 | |
| RANAFamily=Phi 4, Size=3.82026.02 | 92.68 | 56.7 | |
| Staged DecodingFamily=Phi 4, Size=142026.02 | 90.43 | 49.85 | |
| Staged DecodingFamily=Phi 4, Size=142026.02 | 90.43 | 49.85 | |
| Staged DecodingFamily=Qwen3, Size=82026.02 | 85.11 | 80.55 | |
| Staged DecodingFamily=Qwen 3, Size=82026.02 | 85.11 | 80.55 | |
| BaselineFamily=Phi 4, Size=142026.02 | 74.41 | 48.7 | |
| BaselineFamily=Phi 4, Size=142026.02 | 74.41 | 48.7 | |
| Staged DecodingFamily=Qwen3, Size=42026.02 | 54.13 | 61.55 | |
| Staged DecodingFamily=Qwen 3, Size=42026.02 | 54.13 | 61.55 | |
| Staged DecodingFamily=Phi 4, Size=3.82026.02 | 51.68 | 59.8 | |
| Staged DecodingFamily=Phi 4, Size=3.82026.02 | 51.68 | 59.8 | |
| BaselineFamily=Qwen3, Size=1.72026.02 | 42.13 | 56 | |
| BaselineFamily=Qwen 3, Size=1.72026.02 | 42.13 | 56 | |
| BaselineFamily=Qwen3, Size=42026.02 | 41.16 | 78.35 | |
| BaselineFamily=Qwen3, Size=142026.02 | 41.16 | 73.25 | |
| BaselineFamily=Qwen 3, Size=42026.02 | 41.16 | 78.35 | |
| BaselineFamily=Qwen 3, Size=142026.02 | 41.16 | 73.25 | |
| BaselineFamily=Qwen3, Size=82026.02 | 41.11 | 80.05 | |
| BaselineFamily=Qwen 3, Size=82026.02 | 41.11 | 80.05 | |
| BaselineFamily=Phi 4, Size=3.82026.02 | 27.14 | 64.35 | |
| BaselineFamily=Phi 4, Size=3.82026.02 | 27.14 | 64.35 | |
| Staged DecodingFamily=Qwen3, Size=1.72026.02 | 22.6 | 57 | |
| Staged DecodingFamily=Qwen 3, Size=1.72026.02 | 22.6 | 57 |