00:00:00 / 00:00:00

Appears in collection : A Random Walk in the Land of Stochastic Analysis and Numerical Probability / Une marche aléatoire dans l'analyse stochastique et les probabilités numériques

We are interested in monitoring patients in remission from cancer. Our aim is to detect their relapses as soon as possible, as well as detect the type of relapse, to decide on the appropriate treatment to be given. Available data are some marker level of the rate of cancerous cells in the blood which evolves continuously but is measured at discrete (large) intervals and through noise. The patient's state of health is modeled by a piecewise deterministic Markov process (PDMP). Several decisions must be taken from these incomplete observations: what treatment to give, and when to schedule the next medical visit. After presenting a suitable class of controlled PDMPs to model this situation, I will describe the corresponding stochastic control problem and will present the resolution strategy that we adopted. The objective is to obtain an approximation of the value function (optimal performance) as well as build an explicit policy applicable in practice and as close to optimality as possible. The results will be illustrated by simulations calibrated on a cohort of a clinical trial on multiple myeloma provided by the Center of Cancer Research in Toulouse.

Information about the video

Citation data

  • DOI 10.24350/CIRM.V.20088403
  • Cite this video de Saporta, Benoîte (06/09/2023). Stochastic control for medical treatment optimization. CIRM. Audiovisual resource. DOI: 10.24350/CIRM.V.20088403
  • URL https://dx.doi.org/10.24350/CIRM.V.20088403

Bibliography

  • ALMUDEVAR, Anthony. A dynamic programming algorithm for the optimal control of piecewise deterministic Markov processes. SIAM Journal on Control and Optimization, 2001, vol. 40, no 2, p. 525-539. - https://doi.org/10.1137/S0363012999364474
  • BÄUERLE, Nicole et LANGE, Dirk. Optimal control of partially observable piecewise deterministic Markov processes. SIAM Journal on Control and Optimization, 2018, vol. 56, no 2, p. 1441-1462. - https://doi.org/10.1137/17M1134731
  • BÄUERLE, Nicole et RIEDER, Ulrich. Markov decision processes with applications to finance. Springer Science & Business Media, 2011. - https://doi.org/10.1007/978-3-642-18324-9
  • BRANDEJSKY, Adrien, DE SAPORTA, Benoîte, et DUFOUR, François. Optimal stopping for partially observed piecewise-deterministic Markov processes. Stochastic Processes and their Applications, 2013, vol. 123, no 8, p. 3201-3238. - https://doi.org/10.1016/j.spa.2013.03.006
  • CALVIA, Alessandro. Stochastic filtering and optimal control of pure jump Markov processes with noise-free partial observation. ESAIM: Control, Optimisation and Calculus of Variations, 2020, vol. 26, p. 25. - https://doi.org/10.1051/cocv/2019020
  • CLEYNEN, Alice et DE SAPORTA, Benoîte. Change-point detection for piecewise deterministic Markov processes. Automatica, 2018, vol. 97, p. 234-247. - https://doi.org/10.1016/j.automatica.2018.08.011
  • DO VALLE COSTA, Oswaldo Luiz et DUFOUR, François. Continuous average control of piecewise deterministic Markov processes. Springer, 2013. - https://doi.org/10.1007/978-1-4614-6983-4
  • COSTA, Oswaldo Luiz do Valle et CAB, Raymundo. Impulse and continuous control of piecewise deterministic Markov processes. Stochastics: An International Journal of Probability and Stochastic Processes, 2000, vol. 70, no 1-2, p. 75-107. - https://doi.org/10.1080/17442500008834246
  • COSTA, Oswaldo LV et DAVIS, M. H. A. Impulse control of piecewise-deterministic processes. Mathematics of Control, Signals and Systems, 1989, vol. 2, p. 187-206. - https://doi.org/10.1007/BF02551384
  • DAVIS, Mark HA. Piecewise‐deterministic Markov processes: A general class of non‐diffusion stochastic models. Journal of the Royal Statistical Society: Series B (Methodological), 1984, vol. 46, no 3, p. 353-376. - http://www.jstor.org/stable/2345677
  • DAVIS, M. (1993). Markov models and optimization vol. 49 of Monographs on Statistics and Applied Probability. Chapman & Hall, London.
  • DE SAPORTA, Benoîte et DUFOUR, François. Numerical method for impulse control of piecewise deterministic Markov processes. Automatica, 2012, vol. 48, no 5, p. 779-793. - https://doi.org/10.1016/j.automatica.2012.02.031
  • DE SAPORTA, Benoîte, DUFOUR, François, et GEERAERT, Alizée. Optimal strategies for impulse control of piecewise deterministic Markov processes. Automatica, 2017, vol. 77, p. 219-229. - https://doi.org/10.1016/j.automatica.2016.11.039
  • DE SAPORTA, Benoite, DUFOUR, François, et ZHANG, Huilong. Numerical methods for simulation and optimization of piecewise deterministic Markov processes: application to reliability. John Wiley & Sons, 2015.
  • DEMPSTER, M. A. H. et YE, J. J. Impulse control of piecewise deterministic Markov processes. The Annals of Applied Probability, 1995, p. 399-423. - https://doi.org/10.1214/aoap/1177004771
  • DUFOUR, François, HORIGUCHI, Masayuki, et PIUNOVSKIY, A. B. Optimal impulsive control of piecewise deterministic Markov processes. Stochastics, 2016, vol. 88, no 7, p. 1073-1098. - https://doi.org/10.1080/17442508.2016.1197925
  • PIUNOVSKIY, Alexey, PLAKHOV, Alexander, TORRES, Delfim FM, et al. Optimal impulse control of dynamical systems. SIAM Journal on Control and Optimization, 2019, vol. 57, no 4, p. 2720-2752. - https://doi.org/10.1137/18M1212069

Last related questions on MathOverflow

You have to connect your Carmin.tv account with mathoverflow to add question

Ask a question on MathOverflow




Register

  • Bookmark videos
  • Add videos to see later &
    keep your browsing history
  • Comment with the scientific
    community
  • Get notification updates
    for your favorite subjects
Give feedback