List your company

ResearchFormerly WizWand

Counterfactual Policy Evaluation

Benchmarks

DatasetSOTA methodMetricTrendResultsLast updated

Aircraft Catastrophic Path

-776Lowest Cumulative Reward

2

Mar 4, 2026

Aircraft Almost Catastrophic

-776Lowest Cumulative Reward

2

Mar 4, 2026

Aircraft Slightly Suboptimal Path

231Lowest Cumulative Reward

2

Mar 4, 2026

Frozen Lake Catastrophic Path

-87Lowest Cumulative Reward

2

Mar 4, 2026

Frozen Lake Almost Catastrophic

-68Lowest Cumulative Reward

2

Mar 4, 2026

Frozen Lake Slightly Suboptimal Path

41Lowest Cumulative Reward

2

Mar 4, 2026

Sepsis Catastrophic Path

-9,050Lowest Cumulative Reward

2

Mar 4, 2026

Sepsis Almost Catastrophic

100Lowest Cumulative Reward

2

Mar 4, 2026

Sepsis Slightly Suboptimal Path

8,000Lowest Cumulative Reward

2

Mar 4, 2026

GridWorld p = 0.4 Catastrophic Path

-698Lowest Cumulative Reward

2

Mar 4, 2026

GridWorld (p = 0.4) - Almost Catastrophic

14Lowest Cumulative Reward

2

Mar 4, 2026

GridWorld p = 0.4 Slightly Suboptimal Path

19Lowest Cumulative Reward

2

Mar 4, 2026

GridWorld (p = 0.9) Catastrophic Path

-698Lowest Cumulative Reward

2

Mar 4, 2026

GridWorld (p = 0.9) - Almost Catastrophic

-697Cumulative Reward (Lowest)

2

Mar 4, 2026

GridWorld (p = 0.9) Slightly Suboptimal Path

-495Lowest Cumulative Reward

2

Mar 4, 2026

221Avg Worst-Case V(s0)

2

Mar 4, 2026

37.3Average Worst-Case V(s0)

2

Mar 4, 2026

1,660Average Worst-Case Counterfactual V(s0)

2

Mar 4, 2026

GridWorld p = 0.4

230Worst-Case Counterfactual V(s0)

2

Mar 4, 2026

GridWorld p = 0.9

346Avg Worst-Case Counterfactual V(s0)

2

Mar 4, 2026