Bot detection on Cresci-15
98.7AccuracyHeterogeneous motifs (All)
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Heterogeneous motifs (All)Classifier=XGBoost, motif_type=Heterogeneous2025.12 | 98.7 | 98.8 | — | 97.6 | 100 | |
| Heterogeneous motifs (AUC'_{upper} > 0.7)Classifier=XGBoost, motif_type=Heterogeneous, Selection criteria=AUC'_upper > 0.72025.12 | 98.7 | 98.8 | — | 97.6 | 100 | |
| BICText Modality=true, Graph Modality=true, Modality Interaction=true2022.08 | 98.35 | 98.71 | — | — | — | |
| CACLBackbone=SAGE2024.05 | 97.65 | 98.12 | 95.1 | — | — | |
| BotRGCNClassifier=XGBoost2025.12 | 97.3 | 83.7 | — | 84.5 | 83.4 | |
| RGTClassifier=XGBoost2025.12 | 97.3 | 85.1 | — | 86.9 | 84 | |
| BIC w/o GraphText Modality=true, Graph Modality=false, Modality Interaction=false2022.08 | 97.16 | 97.8 | — | — | — | |
| RGTText Modality=true, Graph Modality=true, Modality Interaction=false2022.08 | 97.15 | 97.78 | — | — | — | |
| RoBERTa2024.05 | 97.01 | 95.86 | 89.55 | — | — | |
| BIC w/o TextText Modality=false, Graph Modality=true, Modality Interaction=false2022.08 | 96.86 | 97.57 | — | — | — | |
| BotRGCNText Modality=false, Graph Modality=true, Modality Interaction=false2022.08 | 96.52 | 97.3 | — | — | — | |
| RGT2024.05 | 96.27 | 97.04 | 92.25 | — | — | |
| Wei et al.Text Modality=true, Graph Modality=false, Modality Interaction=false2022.08 | 96.18 | 82.65 | — | — | — | |
| CACLBackbone=HGT2024.05 | 95.88 | 96.74 | 91.45 | — | — | |
| BotRGCN2024.05 | 94.71 | 95.85 | 89.06 | — | — | |
| CACLBackbone=GAT2024.05 | 94.51 | 95.42 | 88.71 | — | — | |
| Homogeneous motifs (All)Classifier=XGBoost, motif_type=Homogeneous2025.12 | 94.1 | 94.3 | — | 90.6 | 98.4 | |
| SAGE2024.05 | 93.92 | 95.26 | 87.48 | — | — | |
| GAT2024.05 | 93.52 | 94.99 | 86.78 | — | — | |
| SATARText Modality=true, Graph Modality=true, Modality Interaction=true2022.08 | 93.42 | 95.05 | — | — | — | |
| SimpleHGN2024.05 | 93.13 | 94.68 | 85.91 | — | — | |
| SATAR2024.05 | 92.71 | 94.55 | 85.61 | — | — | |
| HGT2024.05 | 92.24 | 94.27 | 84.83 | — | — | |
| EvolveBot2024.05 | 92.18 | 90.07 | 72.77 | — | — | |
| SybilSCARClassifier=XGBoost2025.12 | 90.2 | 87.9 | — | 99 | 78.4 | |
| T5Classifier=XGBoost2025.12 | 89.8 | 85 | — | 86.3 | 84.5 | |
| Alhossini et al.Text Modality=false, Graph Modality=true, Modality Interaction=false2022.08 | 89.57 | 92.17 | — | — | — | |
| BGSRD2024.05 | 87.78 | 90.8 | 74.92 | — | — | |
| FPClassifier=XGBoost2025.12 | 87.4 | 80.9 | — | 79.6 | 83.2 | |
| DeeProBotClassifier=XGBoost2025.12 | 85.5 | 79 | — | 79.7 | 78.8 | |
| ARGClassifier=XGBoost2025.12 | 80.5 | 83.5 | — | 84.3 | 82.9 | |
| BotometerClassifier=XGBoost2025.12 | 77.2 | 81.7 | — | 80.9 | 82.9 | |
| Yang et al.Text Modality=false, Graph Modality=false, Modality Interaction=false2022.08 | 77.08 | 77.91 | — | — | — | |
| Kudugunta et al.Text Modality=true, Graph Modality=false, Modality Interaction=false2022.08 | 75.33 | 75.74 | — | — | — | |
| DeeProBot2024.05 | 72.35 | 81.61 | 44.26 | — | — | |
| BotometerText Modality=false, Graph Modality=false, Modality Interaction=false2022.08 | 57.92 | 66.9 | — | — | — | |
| IsingClassifier=XGBoost2025.12 | 55.4 | 69.1 | — | 52.8 | 100 | |
| SybilWalkClassifier=XGBoost2025.12 | 54.9 | 71 | — | 55 | 99.8 |