# Hybrid-AIRL: Enhancing Inverse Reinforcement Learning with Supervised Expert Guidance Source: [Hybrid-AIRL: Enhancing Inverse Reinforcement Learning with Supervised Expert Guidance]() Collection index: [llms.txt]() Data updated: 2026-04-24T05:00:04.605Z Authors: Bram Silue, Santiago Amaya-Corredor, Patrick Mannion, Lander Willem, Pieter Libin Published: 2025-11-26T13:04:24.000Z ## Abstract Adversarial Inverse Reinforcement Learning (AIRL) has shown promise in addressing the sparse reward problem in reinforcement learning (RL) by inferring dense reward functions from expert demonstrations. However, its performance in highly complex, imperfect-information settings remains largely unexplored. To explore this gap, we evaluate AIRL in the context of Heads-Up Limit Hold'em (HULHE) poker, a domain characterized by sparse, delayed rewards and significant uncertainty. In this setting, we find that AIRL struggles to infer a sufficiently informative reward function. To overcome this limitation, we contribute Hybrid-AIRL (H-AIRL), an extension that enhances reward inference and policy learning by incorporating a supervised loss derived from expert data and a stochastic regularization mechanism. We evaluate H-AIRL on a carefully selected set of Gymnasium benchmarks and the HULHE poker setting. Additionally, we analyze the learned reward function through visualization to gain deeper insights into the learning process. Our experimental results show that H-AIRL achieves higher sample efficiency and more stable learning compared to AIRL. This highlights the benefits of incorporating supervised signals into inverse RL and establishes H-AIRL as a promising framework for tackling challenging, real-world settings. ## Recorded benchmark results A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. - [Poker Gameplay on RLCard Heads-Up Limit Hold'em (test)](): Heads-Up Limit Hold'em Poker; RLCard Heads-Up Limit Hold'em (HULHE) default (test); Payoff (mbb/h): 96. ## Original sources and implementation [Original paper]() [PDF]()