List your company
ResearchFormerly WizWand

Diagnostic Troubleshooting on Forum-based Troubleshooting Dataset Mechanical 1.0 (test)

71.58Diagnostic ScoreSIA-all
35.54444.899554.25563.6105Jun 11, 2026
Updated 4mo ago

Evaluation results

MethodLinks
SIA-allBackbone=gemini-3.5, Diagnostic Configuration=SIA-all2026.0671.58
SIA-allBackbone=gpt-5.5, Diagnostic Configuration=SIA-all2026.0670.02
SIA-topBackbone=gemini-3.5, Diagnostic Configuration=SIA-top2026.0665.42
SIA-topBackbone=gpt-5.5, Diagnostic Configuration=SIA-top2026.0664.41
THKBackbone=gpt-5.5, Diagnostic Configuration=THK2026.0649.52
THKBackbone=gemini-3.5, Diagnostic Configuration=THK2026.0647.83
BASBackbone=gpt-5.5, Diagnostic Configuration=BAS2026.0637.8
BASBackbone=gemini-3.5, Diagnostic Configuration=BAS2026.0636.93