List your company

Circuit Reasoning on SpecEval-QA

1Signal-Module Config Loc (Avg)ChipMind
0.54240.66120.780.8988Dec 5, 2025

Evaluation results

MethodLinks
ChipMindModel Type=KG-augmented Reasoning, Base LLM=DeepSeek-R12025.12100.840.150.930.020.970.06100.95
HippoRAG 2Model Type=KG-based RAG2025.120.940.130.730.250.780.190.680.350.720.180.76
ReActModel Type=Reasoning-augmented Framework2025.120.940.130.670.160.730.120.720.30.90.110.79
Llama-4-scoutModel Type=Vector RAG2025.120.930.150.490.250.60.220.60.190.60.320.64
IRCoTModel Type=Reasoning-augmented Framework2025.120.930.150.590.210.880.120.830.180.790.160.81
DeepSeek-R1Model Type=Vector RAG2025.120.860.180.60.260.720.130.890.180.640.30.78
GPT-4.1Model Type=Vector RAG2025.120.820.150.630.260.870.040.850.210.780.170.79
Claude-4Model Type=Vector RAG2025.120.760.210.560.380.820.090.820.190.710.310.73
Search-o1Model Type=Reasoning-augmented Framework2025.120.760.430.590.410.680.240.710.290.740.170.7
LightRAGModel Type=KG-based RAG2025.120.680.420.380.150.690.20.630.210.550.180.61
GraphRAGModel Type=KG-based RAG2025.120.560.520.450.480.760.110.40.420.770.170.55