List your company
ResearchFormerly WizWand

Diagnostic Troubleshooting on Forum-based Troubleshooting Dataset Hydraulic 1.0 (test)

73.94Diagnostic ScoreSIA-all
32.18443.024553.86564.7055Jun 11, 2026
Updated 4mo ago

Evaluation results

MethodLinks
SIA-allBackbone=gpt-5.5, Diagnostic Configuration=SIA-all2026.0673.94
SIA-allBackbone=gemini-3.5, Diagnostic Configuration=SIA-all2026.0673.06
SIA-topBackbone=gpt-5.5, Diagnostic Configuration=SIA-top2026.0668.43
SIA-topBackbone=gemini-3.5, Diagnostic Configuration=SIA-top2026.0668.1
THKBackbone=gpt-5.5, Diagnostic Configuration=THK2026.0644.01
THKBackbone=gemini-3.5, Diagnostic Configuration=THK2026.0642.17
BASBackbone=gpt-5.5, Diagnostic Configuration=BAS2026.0635.63
BASBackbone=gemini-3.5, Diagnostic Configuration=BAS2026.0633.79