Access Control on TOFU
98.13AccuracySUDOLM
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| SUDOLMBackbone=Llama2 13b2024.10 | 98.13 | 99.88 | 98.07 | 98.97 | |
| SUDOLMBackbone=Llama2 7b2024.10 | 96.09 | 98.26 | 97.43 | 97.84 | |
| SUDOLMBackbone=Llama32024.10 | 94.75 | 98.88 | 95.3 | 97.06 | |
| VanillaDescription=Vanilla LLM responding to all queries2024.10 | 90.91 | 90.91 | 100 | 95.24 | |
| AnchorDescription=Refuses all privileged queries regardless of key2024.10 | 90.91 | 100 | 90 | 94.74 |