Bot Detection on Twibot-22
87.4AccuracyHeterogeneous motifs (All)
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Heterogeneous motifs (All)Classifier=XGBoost, motif_type=Heterogeneous2025.12 | 87.4 | 87.2 | — | 87 | 87.3 | |
| Heterogeneous motifs (AUC'_{upper} > 0.7)Classifier=XGBoost, motif_type=Heterogeneous, Selection criteria=AUC'_upper > 0.72025.12 | 85.7 | 85.4 | — | 85.2 | 85.6 | |
| RGTClassifier=XGBoost2025.12 | 85.2 | 82.7 | — | 84.5 | 81.5 | |
| BotRGCNClassifier=XGBoost2025.12 | 85.1 | 75.9 | — | 71.5 | 80.8 | |
| T5Classifier=XGBoost2025.12 | 84.6 | 82.8 | — | 84 | 82 | |
| Homogeneous motifs (All)Classifier=XGBoost, motif_type=Homogeneous2025.12 | 83.6 | 83.1 | — | 83.3 | 83 | |
| DeeProBotClassifier=XGBoost2025.12 | 83.3 | 80.7 | — | 78.3 | 84.1 | |
| FPClassifier=XGBoost2025.12 | 81.1 | 83.2 | — | 83 | 84.1 | |
| ARGClassifier=XGBoost2025.12 | 80.1 | 83.5 | — | 85.2 | 82.4 | |
| ChatGPTModality=ENSEMBLE, Instruction Tuning=true2024.02 | 76.9 | 79.2 | — | 69.6 | 91.8 | |
| BOTOMETERMetadata (M)=true2024.02 | 75.5 | 58.5 | — | 44 | 87.3 | |
| CACLBackbone=SAGE2024.05 | 75.38 | 47.45 | 32.27 | — | — | |
| HGT2024.05 | 75.07 | 43.13 | 29.18 | — | — | |
| CACLBackbone=HGT2024.05 | 75.07 | 48.27 | 32.39 | — | — | |
| BotometerClassifier=XGBoost2025.12 | 75 | 82.5 | — | 82 | 83.7 | |
| CACLBackbone=GAT2024.05 | 74.5 | 44.27 | 28.94 | — | — | |
| RGT2024.05 | 74.49 | 45.36 | 29.64 | — | — | |
| SAGE2024.05 | 74.39 | 46.47 | 30.25 | — | — | |
| GAT2024.05 | 74.17 | 43.75 | 28.12 | — | — | |
| DeeProBot2024.05 | 74.11 | 12.73 | 14.12 | — | — | |
| BotRGCN2024.05 | 73.9 | 48.3 | 31.01 | — | — | |
| ChatGPTModality=ENSEMBLE, Instruction Tuning=false2024.02 | 73.5 | 70.6 | — | 79.4 | 63.5 | |
| BOTPERCENTMetadata (M)=true, Texts (T)=true, Neighborhoods (N)=true2024.02 | 73.1 | 72.6 | — | 73.8 | 71.4 | |
| SimpleHGN2024.05 | 72.53 | 49.59 | 30.74 | — | — | |
| RoBERTa2024.05 | 72.07 | 20.53 | 19.35 | — | — | |
| BGSRD2024.05 | 71.88 | 21.14 | 20.32 | — | — | |
| EvolveBot2024.05 | 71.09 | 14.09 | 13.38 | — | — | |
| LLAMA2-70BModality=ENSEMBLE, Instruction Tuning=false2024.02 | 66.8 | 68.5 | — | 65.1 | 72.4 | |
| ROBERTATexts (T)=true2024.02 | 63.3 | 43.2 | — | 95.5 | 28 | |
| BOTBUSTERMetadata (M)=true, Texts (T)=true2024.02 | 62.7 | 43.9 | — | 88.2 | 29.2 | |
| LLAMA2-70BModality=METADATA, Instruction Tuning=false2024.02 | 62.7 | 71.3 | — | 58.1 | 92.4 | |
| SGBOTNeighborhoods (N)=true2024.02 | 62.3 | 39.5 | — | 100 | 24.7 | |
| Mistral-7BModality=ENSEMBLE, Instruction Tuning=false2024.02 | 58.2 | 53.3 | — | 60.5 | 47.7 | |
| LOBOMetadata (M)=true, Texts (T)=true2024.02 | 55.2 | 19.8 | — | 94.4 | 11 | |
| SybilWalkClassifier=XGBoost2025.12 | 53.7 | 69.9 | — | 53.7 | 100 | |
| RGTMetadata (M)=true, Texts (T)=true, Neighborhoods (N)=true2024.02 | 50.9 | 50.9 | — | 32.3 | 85.4 | |
| IsingClassifier=XGBoost2025.12 | 49.3 | 61.5 | — | 49.1 | 82.3 | |
| SybilSCARClassifier=XGBoost2025.12 | 48.1 | 65 | — | 51 | 89.7 |