PII Extraction on Private data (test)
70.36Pass@1SPORE
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| SPORETarget Model=Claude Opus 4.62026.04 | 70.36 | 75.54 | 78.04 | 79.46 | 80.18 | |
| SPORETarget Model=GPT-5.42026.04 | 69.46 | 83.75 | 90.89 | 93.21 | 93.93 | |
| ICATarget Model=GPT-5.4-mini2026.04 | 63.04 | 77.5 | 82.14 | 87.14 | 89.11 | |
| SPORETarget Model=GPT-5.4-mini2026.04 | 60.54 | 79.11 | 84.82 | 88.21 | 89.64 | |
| SPORETarget Model=Qwen3.6-Plus2026.04 | 35 | 49.46 | 55.36 | 59.82 | 62.86 | |
| SPORETarget Model=Qwen3.5-397b-A17B2026.04 | 21.96 | 34.11 | 40.89 | 44.29 | 49.11 | |
| MEXTRATarget Model=GPT-5.42026.04 | 19.64 | 36.07 | 43.21 | 49.64 | 53.75 | |
| ICATarget Model=GPT-5.42026.04 | 10 | 17.14 | 22.5 | 24.64 | 28.39 | |
| ICATarget Model=Qwen3.6-Plus2026.04 | 4.64 | 8.39 | 11.61 | 13.04 | 16.07 | |
| MEXTRATarget Model=Qwen3.6-Plus2026.04 | 3.39 | 5.71 | 8.39 | 10.71 | 11.79 | |
| ICATarget Model=Qwen3.5-397b-A17B2026.04 | 2.86 | 3.93 | 6.61 | 7.5 | 9.29 | |
| MEXTRATarget Model=GPT-5.4-mini2026.04 | 1.25 | 1.96 | 2.86 | 3.93 | 5 | |
| MEXTRATarget Model=Qwen3.5-397b-A17B2026.04 | 0.36 | 0.71 | 0.71 | 0.89 | 1.07 | |
| ICATarget Model=Claude Opus 4.62026.04 | 0 | 0 | 0 | 0 | 0 | |
| MEXTRATarget Model=Claude Opus 4.62026.04 | 0 | 0 | 0 | 0 | 0 |