Privacy Evaluation on PEEP
85.63Privacy RTStaged Decoding
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Staged DecodingFamily=Qwen 3, Size (B)=142026.02 | 85.63 | 90.07 | 87.85 | |
| IF-RT chkpt.Family=Qwen 3, Size (B)=142026.02 | 85.37 | 88.19 | 86.78 | |
| Staged DecodingFamily=Phi 4, Size (B)=3.82026.02 | 73.17 | 74.8 | 73.99 | |
| IF-RT chkpt.Family=Phi 4, Size (B)=3.82026.02 | 72.8 | 75.79 | 74.29 | |
| IF-RT chkpt.Family=Phi 4, Size (B)=142026.02 | 71.94 | 72.32 | 72.13 | |
| Staged DecodingFamily=Phi 4, Size (B)=142026.02 | 71.64 | 81.87 | 76.76 | |
| IF-RT chkpt.Family=Qwen 3, Size (B)=42026.02 | 61.4 | 64.74 | 63.07 | |
| Staged DecodingFamily=Qwen 3, Size (B)=42026.02 | 60.53 | 73.54 | 67.04 | |
| Staged DecodingFamily=Qwen 3, Size (B)=82026.02 | 54.46 | 76.89 | 65.68 | |
| IF-RT chkpt.Family=Qwen 3, Size (B)=82026.02 | 53.14 | 68.37 | 60.75 | |
| Staged DecodingFamily=Qwen 3, Size (B)=1.72026.02 | 42.41 | 44.4 | 43.41 | |
| IF-RT chkpt.Family=Qwen 3, Size (B)=1.72026.02 | 39.09 | 41.81 | 40.45 | |
| IF-FA chkpt.Family=Qwen 3, Size (B)=1.72026.02 | 21.84 | 49.56 | 35.7 | |
| Avg. IF chkpt.*Family=Qwen 3, Size (B)=1.72026.02 | 21.84 | 49.56 | 35.7 | |
| IF-FA chkpt.Family=Qwen 3, Size (B)=82026.02 | 20.72 | 83.91 | 52.32 | |
| Avg. IF chkpt.*Family=Qwen 3, Size (B)=82026.02 | 20.72 | 83.91 | 52.32 | |
| BaselineFamily=Qwen 3, Size (B)=82026.02 | 20.25 | 84.72 | 52.49 | |
| BaselineFamily=Qwen 3, Size (B)=1.72026.02 | 19.43 | 50.73 | 35.08 | |
| BaselineFamily=Qwen 3, Size (B)=142026.02 | 17.98 | 94.78 | 56.38 | |
| Avg. IF chkpt.*Family=Qwen 3, Size (B)=142026.02 | 17.74 | 94.3 | 56.02 | |
| IF-FA chkpt.Family=Qwen 3, Size (B)=142026.02 | 17.49 | 94.21 | 55.85 | |
| BaselineFamily=Phi 4, Size (B)=3.82026.02 | 16.51 | 63.57 | 40.04 | |
| IF-FA chkpt.Family=Phi 4, Size (B)=3.82026.02 | 14.93 | 66.2 | 40.56 | |
| Avg. IF chkpt.*Family=Phi 4, Size (B)=3.82026.02 | 14.93 | 66.2 | 40.56 | |
| IF-FA chkpt.Family=Qwen 3, Size (B)=42026.02 | 14.35 | 77.49 | 45.92 | |
| Avg. IF chkpt.*Family=Qwen 3, Size (B)=42026.02 | 14.35 | 77.49 | 45.92 | |
| BaselineFamily=Qwen 3, Size (B)=42026.02 | 14 | 78.2 | 46.1 | |
| Avg. IF chkpt.*Family=Phi 4, Size (B)=142026.02 | 0.53 | 96.6 | 48.57 | |
| BaselineFamily=Phi 4, Size (B)=142026.02 | 0.36 | 96.56 | 48.46 | |
| IF-FA chkpt.Family=Phi 4, Size (B)=142026.02 | 0.36 | 96.64 | 48.5 |