Classification on BoolQ (test)
67.4AccuracyMeZO (non-private)
Evaluation results
| Method | Links | |
|---|---|---|
| MeZO (non-private)Model=OPT-6.7B, Few-shot=k = 1000, Privacy=non-private2025.06 | 67.4 | |
| DPZeroModel=OPT-6.7B, Few-shot=k = 1000, epsilon=62025.06 | 66.8 | |
| DPZeroModel=OPT-2.7B, Few-shot=k = 1000, epsilon=62025.06 | 65.4 | |
| MeZO (non-private)Model=OPT-2.7B, Few-shot=k = 1000, Privacy=non-private2025.06 | 65.3 | |
| DPZeroModel=OPT-2.7B, Few-shot=k = 1000, epsilon=22025.06 | 63.7 | |
| DPZeroModel=OPT-6.7B, Few-shot=k = 1000, epsilon=22025.06 | 63.7 | |
| DP-GRAPEModel=OPT-6.7B, Few-shot=k = 1000, epsilon=22025.06 | 63.7 | |
| DP-GRAPEModel=OPT-6.7B, Few-shot=k = 1000, epsilon=62025.06 | 63.4 | |
| MeZO (non-private)Model=OPT-1.3B, Few-shot=k = 1000, Privacy=non-private2025.06 | 63.2 | |
| DP-AdamModel=OPT-2.7B, Few-shot=k = 1000, epsilon=62025.06 | 62.9 | |
| DP-GRAPEModel=OPT-2.7B, Few-shot=k = 1000, epsilon=62025.06 | 62.7 | |
| DP-GRAPEModel=OPT-1.3B, Few-shot=k = 1000, epsilon=62025.06 | 62.5 | |
| DP-AdamModel=OPT-2.7B, Few-shot=k = 1000, epsilon=22025.06 | 62.5 | |
| DPZeroModel=OPT-1.3B, Few-shot=k = 1000, epsilon=62025.06 | 62.4 | |
| DP-AdamModel=OPT-1.3B, Few-shot=k = 1000, epsilon=62025.06 | 62.3 | |
| DP-GRAPEModel=OPT-1.3B, Few-shot=k = 1000, epsilon=22025.06 | 62 | |
| DPZeroModel=OPT-1.3B, Few-shot=k = 1000, epsilon=22025.06 | 61.6 | |
| DP-GRAPEModel=OPT-2.7B, Few-shot=k = 1000, epsilon=22025.06 | 61.6 | |
| DP-AdamModel=OPT-1.3B, Few-shot=k = 1000, epsilon=22025.06 | 59.8 | |
| Zero-ShotModel=OPT-6.7B2025.06 | 59.4 | |
| Zero-ShotModel=OPT-2.7B2025.06 | 47.7 | |
| Zero-ShotModel=OPT-1.3B2025.06 | 45.3 |