# Model-Based Reinforcement Learning for Type 1Diabetes Blood Glucose Control

Source: [Model-Based Reinforcement Learning for Type 1Diabetes Blood Glucose Control](<https://www.sota2.com/research/paper/68fa687e1e209131cea1c59d>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-27T06:04:44.961Z

Authors: Taku Yamagata, Aisling O'Kane, Amid Ayobi, Dmitri Katz, Katarzyna Stawarz, Paul Marshall, Peter Flach, Ra\\'ul Santos-Rodr\\'iguez (1) \_\_INSTITUTION\_8\_\_ University of Bristol, (2) The Open University, (3) Cardiff University)

Published: 2020-10-13T10:17:30.000Z

## Abstract

In this paper we investigate the use of model-based reinforcement learning to assist people with Type 1 Diabetes with insulin dose decisions. The proposed architecture consists of multiple Echo State Networks to predict blood glucose levels combined with Model Predictive Controller for planning. Echo State Network is a version of recurrent neural networks which allows us to learn long term dependencies in the input of time series data in an online manner. Additionally, we address the quantification of uncertainty for a more robust control. Here, we used ensembles of Echo State Networks to capture model (epistemic) uncertainty. We evaluated the approach with the FDA-approved UVa/Padova Type 1 Diabetes simulator and compared the results against baseline algorithms such as Basal-Bolus controller and Deep Q-learning. The results suggest that the model-based reinforcement learning algorithm can perform equally or better than the baseline algorithms for the majority of virtual Type 1 Diabetes person profiles tested.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Glucose Regulation on Various Clinical and Simulation Cohorts](<https://www.sota2.com/research/sota/glucose-regulation-on-various-clinical-and-simulation-cohorts.md>): Glucose Regulation; Various Clinical and Simulation Cohorts; TIR: 65.63.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2010.06266>)

[PDF](<https://arxiv.org/pdf/2010.06266.pdf>)
