Causal graph annotation accuracy on Synthetic causal graphs Phase 1 generator
100F1 Score (Graph)Template-based
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| Template-basedn=32026.04 | 100 | 0 | 0 | |
| Template-basedn=42026.04 | 100 | 0 | 0 | |
| Template-basedn=52026.04 | 100 | 0 | 0 | |
| Template-basedn=62026.04 | 100 | 0 | 0 | |
| Template-basedn=72026.04 | 100 | 0 | 0 | |
| Template-basedn=82026.04 | 100 | 0 | 0 | |
| Template-basedn=92026.04 | 100 | 0 | 0 | |
| Template-basedn=102026.04 | 100 | 0 | 0 | |
| iTAGn=32026.04 | 98 | 0.4 | 0.2 | |
| iTAGn=42026.04 | 97 | 0.6 | 0.3 | |
| iTAGn=52026.04 | 96 | 0.8 | 0.4 | |
| iTAGn=62026.04 | 95 | 1 | 0.5 | |
| iTAGn=72026.04 | 94 | 1.2 | 0.6 | |
| iTAGn=82026.04 | 94 | 1.4 | 0.7 | |
| iTAGn=92026.04 | 93 | 1.6 | 0.8 | |
| iTAGn=102026.04 | 92 | 1.9 | 0.9 | |
| LLM+IDn=32026.04 | 79 | 2.8 | 2.3 | |
| LLM+CAn=32026.04 | 77 | 3 | 2.5 | |
| LLM+IDn=42026.04 | 75 | 3.8 | 3.4 | |
| LLM+CAn=42026.04 | 73 | 4 | 3.6 | |
| LLM-dependentn=32026.04 | 72 | 3.5 | 3 | |
| LLM+IDn=52026.04 | 71 | 5.1 | 4.7 | |
| LLM+CAn=52026.04 | 69 | 5.4 | 4.9 | |
| LLM-dependentn=42026.04 | 68 | 4.7 | 4.1 | |
| LLM+IDn=62026.04 | 68 | 6.3 | 5.9 | |
| LLM+CAn=62026.04 | 66 | 6.6 | 6.1 | |
| LLM+IDn=72026.04 | 65 | 7.7 | 7.2 | |
| LLM-dependentn=52026.04 | 64 | 6 | 5.5 | |
| LLM+CAn=72026.04 | 63 | 8 | 7.5 | |
| LLM+IDn=82026.04 | 62 | 9.1 | 8.6 | |
| LLM-dependentn=62026.04 | 60 | 7.3 | 6.8 | |
| LLM+CAn=82026.04 | 60 | 9.4 | 8.9 | |
| LLM+IDn=92026.04 | 59 | 10.3 | 9.8 | |
| LLM-dependentn=72026.04 | 57 | 8.7 | 8.2 | |
| LLM+CAn=92026.04 | 57 | 10.7 | 10.2 | |
| LLM+IDn=102026.04 | 56 | 11.8 | 11.2 | |
| LLM-dependentn=82026.04 | 54 | 10.1 | 9.7 | |
| LLM+CAn=102026.04 | 54 | 12.1 | 11.6 | |
| LLM-dependentn=92026.04 | 51 | 11.5 | 11 | |
| LLM-dependentn=102026.04 | 48 | 13 | 12.5 |