Feedback Loop Identification on AMS 1.0 (Hard (>40 transistors))
93.7F1 ScoreHeaRT
Evaluation Results
| Method | Links | |
|---|---|---|
| HeaRTLLM Backbone=Claude-4.6-Sonnet, Approach=HeaRT2025.11 | 93.7 | |
| HeaRTLLM Backbone=GPT-5, Approach=HeaRT2025.11 | 90.6 | |
| HeaRTLLM Backbone=DeepSeek-V3.2, Approach=HeaRT2025.11 | 89.2 | |
| HeaRTLLM Backbone=Gemini-2.5 Pro, Approach=HeaRT2025.11 | 87.6 | |
| Few-shot (Text)LLM Backbone=Claude-4.6-Sonnet, Approach=Few-shot (Text)2025.11 | 61.4 | |
| Few-shot (Image)LLM Backbone=Claude-4.6-Sonnet, Approach=Few-shot (Image)2025.11 | 58.1 | |
| Few-shot (Text)LLM Backbone=GPT-5, Approach=Few-shot (Text)2025.11 | 52.3 | |
| Few-shot (Text)LLM Backbone=DeepSeek-V3.2, Approach=Few-shot (Text)2025.11 | 49.7 | |
| Few-shot (Image)LLM Backbone=GPT-5, Approach=Few-shot (Image)2025.11 | 47.8 | |
| Few-shot (Image)LLM Backbone=DeepSeek-V3.2, Approach=Few-shot (Image)2025.11 | 46.4 | |
| Few-shot (Text)LLM Backbone=Gemini-2.5 Pro, Approach=Few-shot (Text)2025.11 | 41.4 | |
| Few-shot (Image)LLM Backbone=Gemini-2.5 Pro, Approach=Few-shot (Image)2025.11 | 39.7 | |
| HeaRTLLM Backbone=LLaMA-3.3-70B-Instruct†, Approach=HeaRT2025.11 | 19.1 | |
| Few-shot (Text)LLM Backbone=LLaMA-3.3-70B-Instruct†, Approach=Few-shot (Text)2025.11 | 13.5 |