Multiconstrained Finite-Horizon Piecewise Deterministic Markov Decision Processes with Unbounded Transition Rates

References

• [1] Anderson EJ, Nash P (1987) Linear Programming in Infinite-Dimensional Spaces (John Wiley & Sons, Ltd., Chichester, UK).Google Scholar
• [2] Bäuerle N, Rieder U (2010) Optimal control of piecewise deterministic Markov processes with finite time horizon. Piunovskiy A, ed. Modern Trends in Controlled Stochastic Processes: Theory and Applications (Luniver Press, UK), 123–143.Google Scholar
• [3] Bäuerle N, Rieder U (2011) Piecewise deterministic Markov decision processes. Markov Decision Processes with Applications to Finance (Universitext, Springer, Heidelberg), 243–265.Google Scholar
• [4] Boyd S, Vandenberghe L (2004) Convex Optimization (Cambridge University Press, Cambridge, UK).Crossref, Google Scholar
• [5] Costa OLV, Dufour F (2013) Continuous Average Control of Piecewise Deterministic Markov Processes (Springer, New York).Crossref, Google Scholar
• [6] Costa OLV, Dufour F (2015) Linear programming formulation for constrained discounted continuous control for piecewise deterministic Markov processes. J. Math. Anal. Appl. 424(2):892–914.Crossref, Google Scholar
• [7] Costa OLV, Dufour F, Piunovskiy AB (2016) Constrained and unconstrained optimal discounted control of piecewise deterministic Markov processes. SIAM J. Control Optim. 54(3):1444–1474.Crossref, Google Scholar
• [8] Davis MHA (1993) Markov Models and Optimization (Chapman & Hall, London).Crossref, Google Scholar
• [9] Goreac D, Serea OS (2012) Linearization techniques for controlled piecewise deterministic Markov processes: Application to Zubov’s method. Appl. Math. Optim. 66(2):209–238.Crossref, Google Scholar
• [11] Guo XP, Huang YH, Zhang Y (2017) Constrained continuous-time Markov decision processes on the finite horizon. Appl. Math. Optim. 75(2):317–341.Crossref, Google Scholar
• [10] Guo XP, Vykertas M, Zhang Y (2013) Absorbing continuous-time Markov decision processes with total cost criteria. Adv. Appl. Probab. 45(2):490–519.Crossref, Google Scholar
• [12] Hernández-Lerma O, Lasserre JB (1999) Further Topics on Discrete-Time Markov Control Processes (Springer-Verlag, New York).Google Scholar
• [13] Huang YH, Guo XP (2019) Finite-horizon piecewise deterministic Markov decision processes with unbounded transition rates. Stochastics 91(1):67–95.Crossref, Google Scholar
• [14] Jacod J (1975) Multivariate point processes: Predictable projection, Radon-Nikodym derivatives, representation of martingales. Z. Wahrscheinlichkeitstheorie und Verw. Gebiete. 31(3):235–253.Crossref, Google Scholar
• [15] Piunovskiy A, Zhang Y (2011) Discounted continuous-time Markov decision processes with unbounded rates: The convex analytic approach. SIAM J. Control Optim. 49(5):2032–2061.Crossref, Google Scholar
• [16] Rockafellar RT (1974) Conjugate Duality and Optimization (SIAM, Philadelphia).Crossref, Google Scholar
• [17] Yushkevich AA (1988) Bellman inequalities in Markov decision deterministic drift processes. Stochastics 23(1):25–77.Crossref, Google Scholar