Theory of Mind for privacy control on ConfAIde Tier 3 (test)
95.444FR (E) Scorebase
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| baseBackbone=Mistral-7B, Zero-shot transfer=true2026.02 | 95.444 | 88.407 | 0.741 | 88.407 | 80.704 | 1.481 | 80.333 | |
| baseBackbone=Llama-3B, Zero-shot transfer=true2026.02 | 87.593 | 92.148 | 0.37 | 92.148 | 94.333 | 0.593 | 94.333 | |
| PrivAct (Verifier)Backbone=Llama-3B, Zero-shot transfer=true2026.02 | 86.037 | 92.407 | 0.37 | 92.407 | 91.926 | 0.37 | 91.926 | |
| PrivAct (Verifier)Backbone=Llama-8B, Zero-shot transfer=true2026.02 | 85.481 | 75.444 | 3.519 | 72.296 | 51.481 | 1.481 | 50.37 | |
| PrivAct (Refiner)Backbone=Llama-3B, Zero-shot transfer=true2026.02 | 85.37 | 91.481 | 0.37 | 91.481 | 92.148 | 0.63 | 92.148 | |
| PrivAct (Refiner)Backbone=Mistral-7B, Zero-shot transfer=true2026.02 | 83.704 | 76.556 | 4.222 | 72.481 | 52.37 | 1.63 | 50.741 | |
| baseBackbone=Llama-8B, Zero-shot transfer=true2026.02 | 83.37 | 76.407 | 4.444 | 72.333 | 52.074 | 1.63 | 50.444 | |
| PrivAct (Refiner)Backbone=Llama-8B, Zero-shot transfer=true2026.02 | 82.37 | 74.037 | 1.481 | 72.926 | 54.741 | 0.667 | 54.444 | |
| PrivAct (Verifier)Backbone=Mistral-7B, Zero-shot transfer=true2026.02 | 80 | 77.333 | 4.444 | 73.259 | 55.185 | 1.444 | 53.963 | |
| PrivAct (Verifier)Backbone=Qwen-4B, Zero-shot transfer=true2026.02 | 74.407 | 71.296 | 1.37 | 69.963 | 63.185 | 0.519 | 62.963 | |
| PrivAct (Refiner)Backbone=Qwen-4B, Zero-shot transfer=true2026.02 | 72.259 | 76.407 | 1.63 | 75.074 | 64.926 | 0.889 | 64.407 | |
| baseBackbone=Qwen-4B, Zero-shot transfer=true2026.02 | 72 | 73.444 | 2.741 | 70.704 | 61.333 | 0.556 | 61.185 |