Causal Graph Discovery on Asia causal graph
88AccuracyBFS with LLMs
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| BFS with LLMsMethod Category=LLM Methods, Number of Samples=02024.02 | 88 | 100 | 88 | 93 | 7 | 0.016 | 0.23 | 6.7 | |
| BFS with LLMsMethod Category=LLM Methods, Number of Samples=10002024.02 | 80 | 80 | 100 | 89 | 10 | 0.031 | 0.28 | 11 | |
| BFS with LLMsMethod Category=LLM Methods, Number of Samples=100002024.02 | 80 | 80 | 100 | 89 | 10 | 0.031 | 0.28 | 11 | |
| GESMethod Category=Numerical Methods, Number of Samples=100002024.02 | 70 | 78 | 88 | 82 | 9 | 0.06 | 0.35 | 18 | |
| GESMethod Category=Numerical Methods, Number of Samples=10002024.02 | 67 | 86 | 75 | 80 | 7 | 0.06 | 0.31 | 20 | |
| PCMethod Category=Numerical Methods, Number of Samples=100002024.02 | 55 | 67 | 75 | 71 | 9 | 0.1 | 0.35 | 29 | |
| NOTEARSMethod Category=Numerical Methods, Number of Samples=100, Lambda (λ)=0.022024.02 | 50 | 100 | 50 | 67 | 4 | 0.11 | 0.33 | 33 | |
| PCMethod Category=Numerical Methods, Number of Samples=10002024.02 | 50 | 71 | 63 | 67 | 7 | 0.1 | 0.31 | 33 | |
| DAGMAMethod Category=Numerical Methods, Number of Samples=1000, Lambda (λ)=0.012024.02 | 50 | 100 | 50 | 67 | 4 | 0.11 | 0.33 | 33 | |
| DAGMAMethod Category=Numerical Methods, Number of Samples=10000, Lambda (λ)=0.0052024.02 | 50 | 100 | 50 | 67 | 4 | 0.11 | 0.33 | 33 | |
| PairwiseMethod Category=LLM Methods, Number of Samples=100002024.02 | 47 | 47 | 100 | 64 | 17 | 0.14 | 0.39 | 36 | |
| NOTEARSMethod Category=Numerical Methods, Number of Samples=1000, Lambda (λ)=0.0052024.02 | 44 | 80 | 50 | 62 | 5 | 0.1 | 0.27 | 38 | |
| NOTEARSMethod Category=Numerical Methods, Number of Samples=10000, Lambda (λ)=0.0052024.02 | 44 | 80 | 50 | 62 | 5 | 0.14 | 0.36 | 38 | |
| PairwiseMethod Category=LLM Methods, Number of Samples=10002024.02 | 38 | 43 | 75 | 54 | 14 | 0.2 | 0.45 | 45 | |
| PCMethod Category=Numerical Methods, Number of Samples=1002024.02 | 33 | 75 | 38 | 50 | 4 | 0.24 | 0.48 | 50 | |
| PairwiseMethod Category=LLM Methods, Number of Samples=02024.02 | 33 | 35 | 88 | 50 | 20 | 0.22 | 0.44 | 50 | |
| GESMethod Category=Numerical Methods, Number of Samples=1002024.02 | 23 | 38 | 38 | 38 | 8 | 0.28 | 0.44 | 63 | |
| DAGMAMethod Category=Numerical Methods, Number of Samples=100, Lambda (λ)=0.022024.02 | 22 | 67 | 25 | 36 | 3 | 0.28 | 0.44 | 64 |