Causal Graph Discovery on Child (20 nodes, 25 edges)
46AccuracyBFS with LLMs
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| BFS with LLMs# of Samples=100002024.02 | 46 | 63 | 25 | 37 | — | — | — | — | — | |
| BFS with LLMsObservational Statistics=10000 samples, Method Category=LLM Methods2024.02 | 46 | 63 | 25 | — | 59 | 68 | 5.5 | 15 | 37 | |
| GES# of Samples=100002024.02 | 42 | 58 | 47 | 42 | — | — | — | — | — | |
| GESNumber of Samples=10000, Method Category=Numerical Methods2024.02 | 42 | 58 | 47 | — | 45 | 84 | 8 | 18 | 42 | |
| Pairwise# of Samples=10002024.02 | 40 | 57 | 24 | 43 | — | — | — | — | — | |
| BFS with LLMs# of Samples=10002024.02 | 40 | 57 | 24 | 43 | — | — | — | — | — | |
| BFS with LLMsObservational Statistics=1000 samples, Method Category=LLM Methods2024.02 | 40 | 57 | 24 | — | 58 | 56 | 6.5 | 15 | 43 | |
| GES# of Samples=10002024.02 | 31 | 44 | 34 | 53 | — | — | — | — | — | |
| GESNumber of Samples=1000, Method Category=Numerical Methods2024.02 | 31 | 44 | 34 | — | 41 | 47 | 8 | 15 | 53 | |
| Pairwise# of Samples=1002024.02 | 30 | 46 | 27 | 54 | — | — | — | — | — | |
| BFS with LLMs# of Samples=1002024.02 | 30 | 46 | 27 | 54 | — | — | — | — | — | |
| BFS with LLMsObservational Statistics=None, Method Category=LLM Methods2024.02 | 30 | 46 | 27 | — | 44 | 48 | 7 | 13 | 54 | |
| PC# of Samples=10002024.02 | 29 | 45 | 37 | 55 | — | — | — | — | — | |
| PCNumber of Samples=1000, Method Category=Numerical Methods2024.02 | 29 | 45 | 37 | — | 38 | 56 | 8.5 | 15.5 | 55 | |
| PC# of Samples=100002024.02 | 26 | 42 | 47 | 58 | — | — | — | — | — | |
| PCNumber of Samples=10000, Method Category=Numerical Methods2024.02 | 26 | 42 | 47 | — | 32 | 60 | 10.1 | 18 | 58 | |
| GES# of Samples=1002024.02 | 24 | 38 | 22 | 62 | — | — | — | — | — | |
| DAGMA# of Samples=10002024.02 | 24 | 39 | 21 | 61 | — | — | — | — | — | |
| GESNumber of Samples=100, Method Category=Numerical Methods2024.02 | 24 | 38 | 22 | — | 41 | 36 | 11 | 18 | 62 | |
| DAGMANumber of Samples=1000, Method Category=Numerical Methods, Lambda (λ)=0.0052024.02 | 24 | 39 | 21 | — | 43 | 36 | 7 | 12 | 61 | |
| DAGMA# of Samples=100002024.02 | 22 | 36 | 20 | 64 | — | — | — | — | — | |
| DAGMANumber of Samples=10000, Method Category=Numerical Methods, Lambda (λ)=02024.02 | 22 | 36 | 20 | — | 40 | 32 | 8 | 12 | 64 | |
| NOTEARS# of Samples=10002024.02 | 20 | 33 | 17 | 67 | — | — | — | — | — | |
| NOTEARSNumber of Samples=1000, Method Category=Numerical Methods, Lambda (λ)=0.0052024.02 | 20 | 33 | 17 | — | 41 | 28 | 8.6 | 13 | 67 | |
| PC# of Samples=1002024.02 | 19 | 32 | 19 | 68 | — | — | — | — | — | |
| NOTEARS# of Samples=100002024.02 | 19 | 32 | 19 | 68 | — | — | — | — | — | |
| PCNumber of Samples=100, Method Category=Numerical Methods2024.02 | 19 | 32 | 19 | — | 37 | 28 | 12 | 17 | 68 | |
| NOTEARSNumber of Samples=10000, Method Category=Numerical Methods, Lambda (λ)=0.0052024.02 | 19 | 32 | 19 | — | 37 | 28 | 9.3 | 14 | 68 | |
| PairwiseObservational Statistics=1000 samples, Method Category=LLM Methods2024.02 | 16 | 28 | 25 | — | 19 | 52 | 17 | 24 | 72 | |
| NOTEARS# of Samples=1002024.02 | 14 | 25 | 23 | 75 | — | — | — | — | — | |
| DAGMA# of Samples=1002024.02 | 14 | 24 | 41 | 76 | — | — | — | — | — | |
| Pairwise# of Samples=100002024.02 | 14 | 25 | 86 | 75 | — | — | — | — | — | |
| NOTEARSNumber of Samples=100, Method Category=Numerical Methods, Lambda (λ)=0.012024.02 | 14 | 25 | 23 | — | 26 | 24 | 10 | 13 | 75 | |
| DAGMANumber of Samples=100, Method Category=Numerical Methods, Lambda (λ)=0.0052024.02 | 14 | 24 | 41 | — | 20 | 32 | 13 | 17 | 76 | |
| PairwiseObservational Statistics=10000 samples, Method Category=LLM Methods2024.02 | 14 | 25 | 86 | — | 16 | 56 | 21 | 28 | 75 | |
| PairwiseObservational Statistics=None, Method Category=LLM Methods2024.02 | 13 | 23 | 61 | — | 16 | 40 | 16.5 | 21.5 | 76 |