Membership Inference Attack on TÜLU
85N-Gram Coverage (Cov.)N-GRAM COVERAGE ATTACK
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| N-GRAM COVERAGE ATTACKTarget Model=TÜLU-65B2025.08 | 85 | 86 | 80 | 80 | — | — | — | — | — | |
| N-GRAM COVERAGE ATTACKTarget Model=TÜLU-30B2025.08 | 82 | 82 | 76 | 77 | — | — | — | — | — | |
| N-GRAM COVERAGE ATTACKTarget Model=TÜLU-13B2025.08 | 80 | 80 | 74 | 76 | — | — | — | — | — | |
| N-GRAM COVERAGE ATTACKTarget Model=TÜLU-7B2025.08 | 79 | 79 | 73 | 74 | — | — | — | — | — | |
| N-GRAM COVERAGE ATTACKTarget Model=TÜLU-1.1-70B2025.08 | 79 | 78 | 75 | 77 | — | — | — | — | — | |
| N-GRAM COVERAGE ATTACKTarget Model=TÜLU-1.1-13B2025.08 | 76 | 75 | 71 | 72 | — | — | — | — | — | |
| N-GRAM COVERAGE ATTACKTarget Model=TÜLU-1.1-7B2025.08 | 72 | 73 | 70 | 71 | — | — | — | — | — | |
| DE-COPTarget Model=TÜLU-7B2025.08 | — | — | — | — | 0.48 | — | — | — | — | |
| DE-COPTarget Model=TÜLU-13B2025.08 | — | — | — | — | 0.47 | — | — | — | — | |
| DE-COPTarget Model=TÜLU-30B2025.08 | — | — | — | — | 0.52 | — | — | — | — | |
| DE-COPTarget Model=TÜLU-65B2025.08 | — | — | — | — | 0.45 | — | — | — | — | |
| DE-COPTarget Model=TÜLU-1.1-7B2025.08 | — | — | — | — | 0.47 | — | — | — | — | |
| DE-COPTarget Model=TÜLU-1.1-13B2025.08 | — | — | — | — | 0.43 | — | — | — | — | |
| DE-COPTarget Model=TÜLU-1.1-70B2025.08 | — | — | — | — | 0.45 | — | — | — | — | |
| White-Box AttackTarget Model=TÜLU-7B2025.08 | — | — | — | — | — | 0.84 | — | 0.81 | 0.84 | |
| White-Box AttackTarget Model=TÜLU-13B2025.08 | — | — | — | — | — | 0.87 | 0.63 | 0.83 | 0.87 | |
| White-Box AttackTarget Model=TÜLU-30B2025.08 | — | — | — | — | — | 0.87 | 0.54 | 0.84 | 0.87 | |
| White-Box AttackTarget Model=TÜLU-65B2025.08 | — | — | — | — | — | 0.92 | 0.68 | 0.9 | 0.92 | |
| White-Box AttackTarget Model=TÜLU-1.1-7B2025.08 | — | — | — | — | — | 0.77 | — | 0.74 | 0.76 | |
| White-Box AttackTarget Model=TÜLU-1.1-13B2025.08 | — | — | — | — | — | 0.81 | 0.58 | 0.78 | 0.81 | |
| White-Box AttackTarget Model=TÜLU-1.1-70B2025.08 | — | — | — | — | — | 0.86 | 0.64 | 0.84 | 0.86 |