Off-policy evaluation on OBP library avg over 50 datasets
0.735Cumulative RewardHD-CBREAL
Evaluation Results
| Method | Links | |
|---|---|---|
| HD-CBREALN (Number of actions)=15, d (Context dimensionality)=52026.05 | 0.735 | |
| HD-CBREALN (Number of actions)=20, d (Context dimensionality)=52026.05 | 0.733 | |
| HD-CBPROBN (Number of actions)=20, d (Context dimensionality)=5, Precision (bits)=3 bits2026.05 | 0.728 | |
| HD-CBREALN (Number of actions)=20, d (Context dimensionality)=102026.05 | 0.724 | |
| HD-CBPROBN (Number of actions)=15, d (Context dimensionality)=5, Precision (bits)=3 bits2026.05 | 0.718 | |
| HD-CBPROBN (Number of actions)=20, d (Context dimensionality)=5, Precision (bits)=4 bits2026.05 | 0.718 | |
| LinEPSN (Number of actions)=20, d (Context dimensionality)=52026.05 | 0.716 | |
| LinEPSN (Number of actions)=15, d (Context dimensionality)=52026.05 | 0.711 | |
| HD-CBREALN (Number of actions)=15, d (Context dimensionality)=102026.05 | 0.708 | |
| LinEPSN (Number of actions)=20, d (Context dimensionality)=102026.05 | 0.708 | |
| HD-CBPROBN (Number of actions)=15, d (Context dimensionality)=5, Precision (bits)=2 bits2026.05 | 0.707 | |
| HD-CBPROBN (Number of actions)=15, d (Context dimensionality)=5, Precision (bits)=4 bits2026.05 | 0.705 | |
| LinEPSN (Number of actions)=15, d (Context dimensionality)=102026.05 | 0.703 | |
| HD-CBPROBN (Number of actions)=20, d (Context dimensionality)=5, Precision (bits)=2 bits2026.05 | 0.7 | |
| LinEPSN (Number of actions)=20, d (Context dimensionality)=152026.05 | 0.69 | |
| HD-CBREALN (Number of actions)=10, d (Context dimensionality)=52026.05 | 0.687 | |
| HD-CBPROBN (Number of actions)=20, d (Context dimensionality)=10, Precision (bits)=3 bits2026.05 | 0.685 | |
| HD-CBREALN (Number of actions)=10, d (Context dimensionality)=102026.05 | 0.684 | |
| LinEPSN (Number of actions)=10, d (Context dimensionality)=102026.05 | 0.683 | |
| HD-CBBINN (Number of actions)=15, d (Context dimensionality)=5, Precision (bits)=4 bits2026.05 | 0.682 | |
| HD-CBPROBN (Number of actions)=10, d (Context dimensionality)=5, Precision (bits)=3 bits2026.05 | 0.681 | |
| HD-CBREALN (Number of actions)=20, d (Context dimensionality)=152026.05 | 0.681 | |
| LinEPSN (Number of actions)=15, d (Context dimensionality)=152026.05 | 0.678 | |
| HD-CBBINN (Number of actions)=20, d (Context dimensionality)=5, Precision (bits)=4 bits2026.05 | 0.677 | |
| HD-CBPROBN (Number of actions)=10, d (Context dimensionality)=5, Precision (bits)=4 bits2026.05 | 0.675 | |
| HD-CBPROBN (Number of actions)=15, d (Context dimensionality)=10, Precision (bits)=3 bits2026.05 | 0.671 | |
| LinEPSN (Number of actions)=10, d (Context dimensionality)=52026.05 | 0.665 | |
| HD-CBREALN (Number of actions)=15, d (Context dimensionality)=152026.05 | 0.664 | |
| LinEPSN (Number of actions)=10, d (Context dimensionality)=152026.05 | 0.663 | |
| HD-CBBINN (Number of actions)=15, d (Context dimensionality)=5, Precision (bits)=3 bits2026.05 | 0.663 | |
| HD-CBPROBN (Number of actions)=20, d (Context dimensionality)=10, Precision (bits)=2 bits2026.05 | 0.661 | |
| HD-CBPROBN (Number of actions)=10, d (Context dimensionality)=5, Precision (bits)=2 bits2026.05 | 0.659 | |
| HD-CBREALN (Number of actions)=10, d (Context dimensionality)=152026.05 | 0.659 | |
| HD-CBBINN (Number of actions)=20, d (Context dimensionality)=5, Precision (bits)=3 bits2026.05 | 0.658 | |
| HD-CBPROBN (Number of actions)=20, d (Context dimensionality)=10, Precision (bits)=4 bits2026.05 | 0.657 | |
| HD-CBBINN (Number of actions)=20, d (Context dimensionality)=10, Precision (bits)=4 bits2026.05 | 0.656 | |
| HD-CBPROBN (Number of actions)=20, d (Context dimensionality)=15, Precision (bits)=3 bits2026.05 | 0.656 | |
| HD-CBPROBN (Number of actions)=10, d (Context dimensionality)=10, Precision (bits)=3 bits2026.05 | 0.652 | |
| HD-CBBINN (Number of actions)=15, d (Context dimensionality)=5, Precision (bits)=2 bits2026.05 | 0.645 | |
| HD-CBPROBN (Number of actions)=15, d (Context dimensionality)=10, Precision (bits)=4 bits2026.05 | 0.643 | |
| HD-CBBINN (Number of actions)=20, d (Context dimensionality)=5, Precision (bits)=2 bits2026.05 | 0.643 | |
| HD-CBPROBN (Number of actions)=15, d (Context dimensionality)=10, Precision (bits)=2 bits2026.05 | 0.642 | |
| HD-CBBINN (Number of actions)=15, d (Context dimensionality)=10, Precision (bits)=4 bits2026.05 | 0.636 | |
| HD-CBPROBN (Number of actions)=10, d (Context dimensionality)=10, Precision (bits)=4 bits2026.05 | 0.635 | |
| HD-CBBINN (Number of actions)=20, d (Context dimensionality)=10, Precision (bits)=3 bits2026.05 | 0.634 | |
| HD-CBPROBN (Number of actions)=10, d (Context dimensionality)=10, Precision (bits)=2 bits2026.05 | 0.631 | |
| HD-CBPROBN (Number of actions)=10, d (Context dimensionality)=15, Precision (bits)=3 bits2026.05 | 0.631 | |
| HD-CBBINN (Number of actions)=10, d (Context dimensionality)=5, Precision (bits)=4 bits2026.05 | 0.63 | |
| HD-CBPROBN (Number of actions)=15, d (Context dimensionality)=15, Precision (bits)=3 bits2026.05 | 0.63 | |
| HD-CBPROBN (Number of actions)=20, d (Context dimensionality)=15, Precision (bits)=2 bits2026.05 | 0.623 | |
| HD-CBPROBN (Number of actions)=20, d (Context dimensionality)=15, Precision (bits)=4 bits2026.05 | 0.621 | |
| HD-CBBINN (Number of actions)=10, d (Context dimensionality)=5, Precision (bits)=3 bits2026.05 | 0.62 | |
| HD-CBPROBN (Number of actions)=10, d (Context dimensionality)=15, Precision (bits)=4 bits2026.05 | 0.618 | |
| HD-CBBINN (Number of actions)=10, d (Context dimensionality)=10, Precision (bits)=4 bits2026.05 | 0.614 | |
| HD-CBBINN (Number of actions)=15, d (Context dimensionality)=10, Precision (bits)=3 bits2026.05 | 0.614 | |
| HD-CBBINN (Number of actions)=20, d (Context dimensionality)=10, Precision (bits)=2 bits2026.05 | 0.614 | |
| HD-CBPROBN (Number of actions)=15, d (Context dimensionality)=15, Precision (bits)=4 bits2026.05 | 0.608 | |
| HD-CBBINN (Number of actions)=10, d (Context dimensionality)=5, Precision (bits)=2 bits2026.05 | 0.606 | |
| HD-CBPROBN (Number of actions)=10, d (Context dimensionality)=15, Precision (bits)=2 bits2026.05 | 0.603 | |
| HD-CBPROBN (Number of actions)=15, d (Context dimensionality)=15, Precision (bits)=2 bits2026.05 | 0.601 | |
| HD-CBBINN (Number of actions)=20, d (Context dimensionality)=15, Precision (bits)=4 bits2026.05 | 0.601 | |
| HD-CBBINN (Number of actions)=10, d (Context dimensionality)=10, Precision (bits)=3 bits2026.05 | 0.598 | |
| HD-CBBINN (Number of actions)=15, d (Context dimensionality)=10, Precision (bits)=2 bits2026.05 | 0.598 | |
| HD-CBBINN (Number of actions)=20, d (Context dimensionality)=15, Precision (bits)=3 bits2026.05 | 0.591 | |
| HD-CBBINN (Number of actions)=10, d (Context dimensionality)=15, Precision (bits)=4 bits2026.05 | 0.588 | |
| HD-CBBINN (Number of actions)=20, d (Context dimensionality)=15, Precision (bits)=2 bits2026.05 | 0.584 | |
| HD-CBBINN (Number of actions)=15, d (Context dimensionality)=15, Precision (bits)=4 bits2026.05 | 0.583 | |
| HD-CBBINN (Number of actions)=10, d (Context dimensionality)=10, Precision (bits)=2 bits2026.05 | 0.581 | |
| HD-CBBINN (Number of actions)=15, d (Context dimensionality)=15, Precision (bits)=3 bits2026.05 | 0.573 | |
| HD-CBBINN (Number of actions)=10, d (Context dimensionality)=15, Precision (bits)=2 bits2026.05 | 0.569 | |
| HD-CBBINN (Number of actions)=10, d (Context dimensionality)=15, Precision (bits)=3 bits2026.05 | 0.569 | |
| HD-CBBINN (Number of actions)=15, d (Context dimensionality)=15, Precision (bits)=2 bits2026.05 | 0.565 |