BEC Detection on BEC dataset
1AUCDistilBERT (semantic)
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| DistilBERT (semantic)Latency (ms)=7.403 (P95 10.873) GPU, Notes=GPU inference2025.11 | 1 | 99.81 | 100 | 99.63 | |
| TF–IDF + LogReg (baseline)Latency (ms)=0.067 (P95 0.114) CPU, Expected Cost=$2.52, Notes=fastest baseline2025.11 | 1 | 99.68 | 99.62 | 99.74 | |
| Char n-gram + SVM (baseline)Latency (ms)=3.663 (P95 11.664) CPU, Expected Cost=$0.36, Notes=obfuscation-resistant2025.11 | 1 | 99.75 | 99.87 | 99.62 | |
| CatBoost (forensic, +ψ)Latency (ms)=0.855 (P95 1.919) CPU, Expected Cost=$13.57, Notes=engineered features2025.11 | 0.986 | 93.82 | 93.76 | 93.88 |