IPI Detection on FIPI (test)
99.58AccuracyRENNERVATE
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| RENNERVATETarget LLM=Falcon2025.12 | 99.58 | 0.54 | 0.3 | |
| RENNERVATETarget LLM=LLaMA22025.12 | 99.43 | 0.46 | 0.68 | |
| RENNERVATETarget LLM=LLaMA32025.12 | 99.37 | 0.84 | 0.42 | |
| RENNERVATETarget LLM=ChatGLM2025.12 | 99.05 | 1.2 | 0.7 | |
| RENNERVATETarget LLM=Dolly2025.12 | 97.88 | 2.42 | 1.82 | |
| TaskTrackerTarget LLM=LLaMA32025.12 | 95.07 | 3.74 | 6.12 | |
| DS-RespTarget LLM=LLaMA32025.12 | 91.71 | 0.76 | 15.83 | |
| DS-RespTarget LLM=Dolly2025.12 | 91.52 | 4.34 | 12.62 | |
| DS-RespTarget LLM=Falcon2025.12 | 89.5 | 2.3 | 18.7 | |
| DS-RespTarget LLM=ChatGLM2025.12 | 89.04 | 0.72 | 21.2 | |
| DS-RespTarget LLM=LLaMA22025.12 | 87.93 | 0.38 | 23.76 | |
| GPT-RespTarget LLM=ChatGLM2025.12 | 85.15 | 6.46 | 23.24 | |
| GPT-RespTarget LLM=Dolly2025.12 | 85.12 | 6.96 | 22.8 | |
| GPT-RespTarget LLM=LLaMA22025.12 | 85.08 | 6.76 | 23.08 | |
| GPT-RespTarget LLM=Falcon2025.12 | 84.58 | 7.18 | 23.66 | |
| GPT-NaiveTarget LLM=ChatGLM2025.12 | 84.4 | 7.1 | 24.11 | |
| GPT-NaiveTarget LLM=Dolly2025.12 | 84.4 | 7.1 | 24.11 | |
| GPT-NaiveTarget LLM=Falcon2025.12 | 84.4 | 7.1 | 24.11 | |
| GPT-NaiveTarget LLM=LLaMA22025.12 | 84.4 | 7.1 | 24.11 | |
| GPT-NaiveTarget LLM=LLaMA32025.12 | 84.4 | 7.1 | 24.11 | |
| Attention TrackerTarget LLM=LLaMA32025.12 | 83.23 | 14.04 | 19.5 | |
| GPT-RespTarget LLM=LLaMA32025.12 | 82.55 | 18.06 | 16.83 | |
| DS-NaiveTarget LLM=ChatGLM2025.12 | 81.14 | 1.78 | 35.94 | |
| DS-NaiveTarget LLM=Dolly2025.12 | 81.14 | 1.78 | 35.94 | |
| DS-NaiveTarget LLM=Falcon2025.12 | 81.14 | 1.78 | 35.94 | |
| DS-NaiveTarget LLM=LLaMA22025.12 | 81.14 | 1.78 | 35.94 | |
| DS-NaiveTarget LLM=LLaMA32025.12 | 81.14 | 1.78 | 35.94 | |
| ProtectAI-v2Target LLM=ChatGLM2025.12 | 75.48 | 2.52 | 46.52 | |
| ProtectAI-v2Target LLM=Dolly2025.12 | 75.48 | 2.52 | 46.52 | |
| ProtectAI-v2Target LLM=Falcon2025.12 | 75.48 | 2.52 | 46.52 | |
| ProtectAI-v2Target LLM=LLaMA22025.12 | 75.48 | 2.52 | 46.52 | |
| ProtectAI-v2Target LLM=LLaMA32025.12 | 75.48 | 2.52 | 46.52 | |
| Know-AnswerTarget LLM=LLaMA22025.12 | 73.33 | 9.52 | 43.82 | |
| Know-AnswerTarget LLM=ChatGLM2025.12 | 71.68 | 7.88 | 48.76 | |
| Prompt-GuardTarget LLM=ChatGLM2025.12 | 64.43 | 69.94 | 1.2 | |
| Prompt-GuardTarget LLM=Dolly2025.12 | 64.43 | 69.94 | 1.2 | |
| Prompt-GuardTarget LLM=Falcon2025.12 | 64.43 | 69.94 | 1.2 | |
| Prompt-GuardTarget LLM=LLaMA22025.12 | 64.43 | 69.94 | 1.2 | |
| Prompt-GuardTarget LLM=LLaMA32025.12 | 64.43 | 69.94 | 1.2 | |
| Know-AnswerTarget LLM=Falcon2025.12 | 57.23 | 81.78 | 3.76 | |
| Know-AnswerTarget LLM=Dolly2025.12 | 55.26 | 81.08 | 8.4 | |
| Know-AnswerTarget LLM=LLaMA32025.12 | 50.24 | 0 | 99.52 |