Backdoor Detection on Howdy! Backdoor Attack
99.6AUPRC (Top-5)RISE_{128/24/128}
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| RISE_{128/24/128}Model=Pythia-1B, Disk=60.8 MB, Build=44s, GPU Mem=6.7 GB, Query=17.6 ms, CountSketch dimensions (Kr/Kh/Kg)=128/24/1282026.04 | 99.6 | 99.7 | 98.5 | 99 | 93.9 | 96.7 | |
| RISE_{48/64/16}Model=OLMo-3-32B, Disk=41.9 MB, Build=4.6m, GPU Mem=72.8 GB, Query=80.0 ms, CountSketch dimensions (Kr/Kh/Kg)=48/64/162026.04 | 99.3 | 99.5 | 98.8 | 99.3 | 97.3 | 98.4 | |
| RISE_{24/8/35}Model=OLMo-3-32B, Disk=7.4 MB, Build=5.0m, GPU Mem=72.8 GB, Query=54.6 ms, CountSketch dimensions (Kr/Kh/Kg)=24/8/352026.04 | 98.8 | 99.2 | 97.5 | 98.4 | 90 | 94.8 | |
| RISE_{64/12/64}Model=Pythia-1B, Disk=16.9 MB, Build=42s, GPU Mem=6.7 GB, Query=17.4 ms, CountSketch dimensions (Kr/Kh/Kg)=64/12/642026.04 | 96.5 | 98.2 | 94.5 | 97 | 86.5 | 93.6 | |
| RISE_{16/8/28}Model=OLMo-3-32B, Disk=6.2 MB, Build=4.3m, GPU Mem=72.8 GB, Query=64.4 ms, CountSketch dimensions (Kr/Kh/Kg)=16/8/282026.04 | 96.2 | 97.7 | 94 | 96.6 | 86.4 | 93.3 | |
| TrackStarModel=Pythia-1B, Disk=163 MB, Build=116s, GPU Mem=3.6 GB, Query=590 ms2026.04 | 65.3 | 82 | 74 | 88.9 | 81.4 | 92.5 | |
| TrackStarModel=OLMo-3-32B, Disk=1.1 GB, Build=11m, GPU Mem=76.7 GB, Query=3.7 s2026.04 | 37.9 | 58.6 | 51.7 | 72.6 | 78.3 | 90.9 | |
| ZO-InfModel=Pythia-1B, Disk=1.6 GB, Build=36m, GPU Mem=14.0 GB, Query=8.0 s2026.04 | 34.1 | 49.2 | 23.1 | 50.7 | 12.3 | 48 | |
| RapidInModel=Pythia-1B, Disk=1.6 GB, Build=27m, GPU Mem=14.2 GB, Query=8.0 s2026.04 | 19 | 24 | 12 | 28 | 11.5 | 30.8 |