Readback Anomaly Detection on APCP
91.05AccuracySCOPE
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| SCOPEBackbone=Qwen3-14B, Shots=4-shot2026.05 | 91.05 | 91.01 | |
| SCOPEBackbone=Qwen3-14B, Shots=3-shot2026.05 | 90.61 | 90.58 | |
| SCOPEBackbone=Qwen3-14B, Shots=2-shot2026.05 | 89.56 | 89.54 | |
| SCOPEBackbone=Qwen3-14B, Shots=1-shot2026.05 | 88.51 | 88.53 | |
| DeBERTaType=Supervised Learning, Shots=Overall2026.05 | 87.02 | 86.79 | |
| SCOPEBackbone=Qwen3-14B, Shots=0-shot2026.05 | 86.69 | 86.25 | |
| SuperICLBackbone=Qwen3-14B, Shots=4-shot2026.05 | 84.12 | 83.61 | |
| SuperICLBackbone=Qwen3-14B, Shots=3-shot2026.05 | 83.86 | 83.19 | |
| SuperICLBackbone=Qwen3-14B, Shots=1-shot2026.05 | 80.88 | 79.75 | |
| SuperICLBackbone=Qwen3-14B, Shots=2-shot2026.05 | 80.88 | 79.77 | |
| MilTOODType=Supervised Learning, Shots=Overall2026.05 | 78.33 | 79.08 | |
| DICLBackbone=Qwen3-14B, Shots=3-shot2026.05 | 70.96 | 67.96 | |
| DICLBackbone=Qwen3-14B, Shots=2-shot2026.05 | 69.47 | 66.25 | |
| DICLBackbone=Qwen3-14B, Shots=1-shot2026.05 | 67.98 | 63.79 | |
| ICLBackbone=Qwen3-14B, Shots=3-shot2026.05 | 67.81 | 65.41 | |
| DICLBackbone=Qwen3-14B, Shots=4-shot2026.05 | 67.19 | 63.36 | |
| GenICLBackbone=Qwen3-14B, Shots=2-shot2026.05 | 66.93 | 63.64 | |
| GenICLBackbone=Qwen3-14B, Shots=3-shot2026.05 | 66.58 | 62.92 | |
| SuperICLBackbone=Qwen3-14B, Shots=0-shot2026.05 | 66.23 | 62.61 | |
| ICLBackbone=Qwen3-14B, Shots=2-shot2026.05 | 66.05 | 63.05 | |
| GenICLBackbone=Qwen3-14B, Shots=1-shot2026.05 | 65.88 | 61.46 | |
| ICLBackbone=Qwen3-14B, Shots=4-shot2026.05 | 65.7 | 66.3 | |
| ICLBackbone=Qwen3-14B, Shots=1-shot2026.05 | 65.61 | 61.52 | |
| GenICLBackbone=Qwen3-14B, Shots=4-shot2026.05 | 64.74 | 60.24 | |
| ICLBackbone=Qwen3-14B, Shots=0-shot2026.05 | 47.98 | 31.12 | |
| DICLBackbone=Qwen3-14B, Shots=0-shot2026.05 | 47.98 | 31.12 | |
| GenICLBackbone=Qwen3-14B, Shots=0-shot2026.05 | 47.98 | 31.12 | |
| ManualType=LLM-based ICL, Backbone=Qwen3-14B, Shots=Overall2026.05 | 42.63 | 50.11 | |
| N-gramType=Rule-based, Shots=Overall2026.05 | 25.96 | 25.46 | |
| RegexType=Rule-based, Shots=Overall2026.05 | 25.61 | 25.44 |