Privacy Evaluation on PasswordEval
92.34Privacy Rate (RT)Staged Decoding
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Staged DecodingFamily=Phi 4, Size (B)=142026.02 | 92.34 | 86.61 | 90.43 | |
| IF-RT chkpt.Family=Phi 4, Size (B)=142026.02 | 92.27 | 84.37 | 89.64 | |
| Staged DecodingFamily=Qwen 3, Size (B)=142026.02 | 90.03 | 99.15 | 93.07 | |
| IF-RT chkpt.Family=Qwen 3, Size (B)=142026.02 | 89.46 | 97.42 | 92.11 | |
| Staged DecodingFamily=Qwen 3, Size (B)=82026.02 | 78.96 | 97.41 | 85.11 | |
| BaselineFamily=Phi 4, Size (B)=142026.02 | 74.61 | 74.02 | 74.41 | |
| IF-FA chkpt.Family=Phi 4, Size (B)=142026.02 | 74.57 | 73.28 | 74.14 | |
| Avg. IF chkpt.*Family=Phi 4, Size (B)=142026.02 | 74.53 | 73.64 | 74.23 | |
| IF-RT chkpt.Family=Qwen 3, Size (B)=82026.02 | 71.22 | 91.48 | 77.98 | |
| Staged DecodingFamily=Phi 4, Size (B)=3.82026.02 | 54.4 | 46.22 | 51.68 | |
| IF-RT chkpt.Family=Phi 4, Size (B)=3.82026.02 | 54.39 | 46.29 | 51.69 | |
| Staged DecodingFamily=Qwen 3, Size (B)=42026.02 | 45.33 | 71.75 | 54.13 | |
| IF-RT chkpt.Family=Qwen 3, Size (B)=42026.02 | 45.29 | 40.73 | 43.77 | |
| IF-FA chkpt.Family=Qwen 3, Size (B)=1.72026.02 | 27.7 | 72.73 | 42.71 | |
| Avg. IF chkpt.*Family=Qwen 3, Size (B)=1.72026.02 | 27.7 | 72.73 | 42.71 | |
| BaselineFamily=Qwen 3, Size (B)=1.72026.02 | 26.1 | 74.17 | 42.13 | |
| Staged DecodingFamily=Qwen 3, Size (B)=1.72026.02 | 22.25 | 23.3 | 22.6 | |
| IF-RT chkpt.Family=Qwen 3, Size (B)=1.72026.02 | 21.69 | 19.74 | 21.04 | |
| BaselineFamily=Qwen 3, Size (B)=42026.02 | 14.08 | 95.32 | 41.16 | |
| IF-FA chkpt.Family=Qwen 3, Size (B)=42026.02 | 13.75 | 93.52 | 40.34 | |
| Avg. IF chkpt.*Family=Qwen 3, Size (B)=42026.02 | 13.75 | 93.52 | 40.34 | |
| BaselineFamily=Qwen 3, Size (B)=82026.02 | 13.28 | 96.78 | 41.11 | |
| IF-FA chkpt.Family=Qwen 3, Size (B)=82026.02 | 12.12 | 95.61 | 39.95 | |
| Avg. IF chkpt.*Family=Qwen 3, Size (B)=82026.02 | 12.12 | 95.61 | 39.95 | |
| BaselineFamily=Qwen 3, Size (B)=142026.02 | 11.79 | 99.89 | 41.16 | |
| IF-FA chkpt.Family=Phi 4, Size (B)=3.82026.02 | 11.76 | 57.61 | 27.04 | |
| Avg. IF chkpt.*Family=Phi 4, Size (B)=3.82026.02 | 11.76 | 57.61 | 27.04 | |
| BaselineFamily=Phi 4, Size (B)=3.82026.02 | 11.67 | 58.06 | 27.14 | |
| IF-FA chkpt.Family=Qwen 3, Size (B)=142026.02 | 10.77 | 99.95 | 40.49 | |
| Avg. IF chkpt.*Family=Qwen 3, Size (B)=142026.02 | 10.54 | 99.95 | 40.34 |