Untargeted Dialogue State Extraction on MultiWOZ
42State PrecisionVanilla Sampling
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Vanilla SamplingMembership Inference Measure=DC-PPL2026.03 | 42 | 70.27 | |
| Beam SamplingMembership Inference Measure=DC-PPL2026.03 | 40 | 76.34 | |
| Beam SamplingMembership Inference Measure=C-PPL2026.03 | 29 | 70.19 | |
| Vanilla SamplingMembership Inference Measure=PPL2026.03 | 26 | 60.52 | |
| Vanilla SamplingMembership Inference Measure=PPL-zlib2026.03 | 26 | 54.9 | |
| Vanilla SamplingMembership Inference Measure=C-PPL2026.03 | 24 | 55 | |
| Temperature SamplingMembership Inference Measure=DC-PPL2026.03 | 23 | 46.45 | |
| Beam SamplingMembership Inference Measure=PPL2026.03 | 23 | 66.97 | |
| Beam SamplingMembership Inference Measure=PPL-zlib2026.03 | 21 | 68.1 | |
| Temperature SamplingMembership Inference Measure=PPL2026.03 | 19 | 38.56 | |
| Vanilla SamplingMembership Inference Measure=None2026.03 | 14.37 | 15 | |
| Temperature SamplingMembership Inference Measure=C-PPL2026.03 | 14 | 36.95 | |
| Beam SamplingMembership Inference Measure=None2026.03 | 11.95 | 10.73 | |
| Temperature SamplingMembership Inference Measure=PPL-zlib2026.03 | 11 | 33 | |
| Temperature SamplingMembership Inference Measure=None2026.03 | 4.59 | 5.76 |