List your company
ResearchFormerly WizWand

Diagnostic Troubleshooting on Forum-based Troubleshooting Dataset Electrical 1.0 (test)

69.12Diagnostic ScoreSIA-all
26.854437.827248.859.7728Jun 11, 2026
Updated 4mo ago

Evaluation results

MethodLinks
SIA-allBackbone=gemini-3.5, Diagnostic Configuration=SIA-all2026.0669.12
SIA-allBackbone=gpt-5.5, Diagnostic Configuration=SIA-all2026.0666.13
SIA-topBackbone=gemini-3.5, Diagnostic Configuration=SIA-top2026.0663.46
SIA-topBackbone=gpt-5.5, Diagnostic Configuration=SIA-top2026.0659.02
THKBackbone=gpt-5.5, Diagnostic Configuration=THK2026.0638.53
THKBackbone=gemini-3.5, Diagnostic Configuration=THK2026.0636.5
BASBackbone=gpt-5.5, Diagnostic Configuration=BAS2026.0631.12
BASBackbone=gemini-3.5, Diagnostic Configuration=BAS2026.0628.48