Question Answering on Movielens
70.8AccuracyRAG
Evaluation Results
| Method | Links | |
|---|---|---|
| RAGModel=Llama-3.1-8B, Privacy Budget=εtotal = ∞2025.10 | 70.8 | |
| RAGModel=Phi-4-mini, Privacy Budget=εtotal = ∞2025.10 | 67.8 | |
| DP-RAGModel=Llama-3.1-8B, Privacy Budget=εquery = 10 (εtotal ≈ 5000)2025.10 | 56.8 | |
| RAGModel=Gemma-2-2B, Privacy Budget=εtotal = ∞2025.10 | 54.6 | |
| DP-SynRAGModel=Llama-3.1-8B, Privacy Budget=εtotal = 102025.10 | 54.12 | |
| DP-SynthModel=Llama-3.1-8B, Privacy Budget=εtotal = 102025.10 | 46.12 | |
| Aug-PEModel=Llama-3.1-8B, Privacy Budget=εtotal = 102025.10 | 44.96 | |
| Non-RAGModel=Llama-3.1-8B, Privacy Budget=εtotal = 02025.10 | 43.6 | |
| DP-SynRAGModel=Phi-4-mini, Privacy Budget=εtotal = 102025.10 | 42.56 | |
| DP-SynRAGModel=Gemma-2-2B, Privacy Budget=εtotal = 102025.10 | 41.08 | |
| DP-RAGModel=Gemma-2-2B, Privacy Budget=εquery = 10 (εtotal ≈ 5000)2025.10 | 40.48 | |
| DP-SynthModel=Phi-4-mini, Privacy Budget=εtotal = 102025.10 | 37.6 | |
| Aug-PEModel=Phi-4-mini, Privacy Budget=εtotal = 102025.10 | 36.16 | |
| DP-RAGModel=Phi-4-mini, Privacy Budget=εquery = 10 (εtotal ≈ 5000)2025.10 | 34.72 | |
| Non-RAGModel=Gemma-2-2B, Privacy Budget=εtotal = 02025.10 | 34 | |
| Aug-PEModel=Gemma-2-2B, Privacy Budget=εtotal = 102025.10 | 26.04 | |
| Non-RAGModel=Phi-4-mini, Privacy Budget=εtotal = 02025.10 | 22.6 | |
| DP-SynthModel=Gemma-2-2B, Privacy Budget=εtotal = 102025.10 | 16.64 |