Counterfactual Reasoning on Twin-EventLog Smallville context
100Joint Accuracy (A ∧ B)substrate
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| substrateReasoning=Correct by construction2026.05 | 100 | 100 | 100 | 500 | |
| Llama-3.1-8B directPrompting strategy=prompted with the full Smallville context2026.05 | 81.2 | 88 | 86.4 | 500 | |
| Concordia-styleInterface=Concordia's LanguageModel agent-step interface, Action space=constrained action space2026.05 | 35 | — | 79 | 100 |