Fault Types Classification on Dataset A
69.4Micro PrecisionmABC+STAR
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| mABC+STARModel=GPT-52026.05 | 69.4 | 66.4 | 74.9 | 71.1 | 72.04 | 68.67 | |
| mABC+STARModel=Qwen3-max2026.05 | 68.9 | 66.3 | 74.2 | 72.1 | 71.45 | 69.08 | |
| mABC+STARModel=Gemini-2.5pro2026.05 | 67.6 | 65.1 | 73.1 | 69.9 | 70.24 | 67.41 | |
| RCAgent+STARModel=GPT-52026.05 | 62.6 | 59.3 | 68.8 | 64.2 | 65.55 | 61.65 | |
| RCAgent+STARModel=Qwen3-max2026.05 | 62.1 | 58.9 | 68.1 | 64.5 | 64.96 | 61.57 | |
| RCAgent+STARModel=Gemini-2.5pro2026.05 | 60.8 | 57.7 | 66.7 | 62.6 | 63.61 | 60.08 | |
| mABCModel=GPT-52026.05 | 48.7 | 45.8 | 53.6 | 49.7 | 51.03 | 47.67 | |
| mABCModel=Qwen3-max2026.05 | 48.4 | 45.4 | 52.4 | 48.7 | 50.32 | 46.99 | |
| mABCModel=Gemini-2.5pro2026.05 | 47.2 | 44.6 | 51.8 | 48.7 | 49.39 | 46.56 | |
| RCAgentModel=GPT-52026.05 | 34.7 | 32 | 40.9 | 36.4 | 37.55 | 34.06 | |
| RCAgentModel=Qwen3-max2026.05 | 34.4 | 31.6 | 39.7 | 35.4 | 36.86 | 33.39 | |
| RCAgentModel=Gemini-2.5pro2026.05 | 33.2 | 30.8 | 40.1 | 35.4 | 36.33 | 32.94 |