Binary deficiency detection on gold-labeled ICLR (test)
86AccuracyTADDLE (Qwen3-30B-A3B + 9B integrator)
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| TADDLE (Qwen3-30B-A3B + 9B integrator)Family=Ours, Backbone=Qwen3-30B-A3B, Integrator=9B2026.05 | 86 | 91.54 | 74.76 | 82.3 | |
| Longformer-base-4096Family=PLM2026.05 | 83.33 | 88.08 | 52.86 | 66.07 | |
| BERT-base-uncasedFamily=PLM2026.05 | 77.33 | 73.08 | 39.05 | 50.9 | |
| RottenReviews (LR)Family=Review-quality detector2026.05 | 68 | 69.23 | 95.24 | 80.18 | |
| ReviewGuard (Llama-3.1-8B)Family=Review-quality detector2026.05 | 66 | 46.92 | 73.81 | 57.37 | |
| RottenReviews (Llama-3-8B FT)Family=Review-quality detector, Fine-tuned=true2026.05 | 65.33 | 71.15 | 82.38 | 76.36 | |
| ReviewGuard (Qwen3-8B)Family=Review-quality detector2026.05 | 63.33 | 43.08 | 57.14 | 49.12 | |
| GLM 4.7Family=Few-shot LLM2026.05 | 61.56 | 73.46 | 61.43 | 66.91 | |
| RottenReviews (XGBoost)Family=Review-quality detector2026.05 | 60.22 | 74.62 | 61.9 | 67.67 | |
| RottenReviews (Random Forest)Family=Review-quality detector2026.05 | 58.89 | 72.31 | 66.19 | 69.11 | |
| Qwen3.5-PlusFamily=Few-shot LLM2026.05 | 55.33 | 74.23 | 45.71 | 56.58 | |
| Qwen3-30BFamily=Few-shot LLM2026.05 | 54.44 | 68.85 | 51.9 | 59.19 | |
| DeepSeek V3.2Family=Few-shot LLM2026.05 | 49.78 | 87.31 | 24.76 | 38.58 | |
| BigBird-RoBERTa-baseFamily=PLM2026.05 | 46 | 33.08 | 69.52 | 44.83 | |
| RottenReviews (MLP)Family=Review-quality detector2026.05 | 31.11 | 0 | 0 | 0 | |
| RottenReviews (Qwen3-8B 0-shot)Family=Review-quality detector, Shot-count=0-shot2026.05 | 31.11 | 0 | 0 | 0 |