Optimal Control of Markov-Modulated Multiclass Many-Server Queues

References

• Anderson D, Blom J, Mandjes M, Thorsdottir H, de Turck K (2016) A functional central limit theorem for a Markov-modulated infinite-server queue. Methodology Comput. Appl. Probab. 18(1):153–168.Google Scholar
• Arapostathis A, Pang G (2018) Infinite-horizon average optimality of the N-network in the Halfin-Whitt regime. Math. Oper. Res. 43(3):838–866.Google Scholar
• Arapostathis A, Pang G (2019) Infinite horizon asymptotic average optimality for large-scale parallel server networks. Stochastic Processes Their Appl. 129(1):283–322.Google Scholar
• Arapostathis A, Biswas A, Pang G (2015) Ergodic control of multi-class M/M/N+M queues in the Halfin-Whitt regime. Ann. Appl. Probab. 25(6):3511–3570.Google Scholar
• Arapostathis A, Borkar VS, Ghosh MK (2012) Ergodic Control of Diffusion Processes, Encyclopedia of Mathematics and Its Applications, vol. 143 (Cambridge University Press, Cambridge, UK).Google Scholar
• Arapostathis A, Pang G, Sandrić N (2019) Ergodicity of a Lévy–driven SDE arising from multiclass many-server queues. Ann. Appl. Probab. 29(2):1070–1126.Google Scholar
• Atar R, Mandelbaum A, Reiman MI (2004) Scheduling a multi class queue with many exponential servers: Asymptotic optimality in heavy traffic. Ann. Appl. Probab. 14(3):1084–1134.Google Scholar
• Bakhtin Y, Hurth T (2012) Invariant densities for dynamical systems with random switching. Nonlinearity 25(10):2937–2952.Google Scholar
• Benaïm M, Le Borgne S, Malrieu F, Zitt PA (2015) Qualitative properties of certain piecewise deterministic Markov processes. Annales de l’Institut Henri Poincaré - Probabilités et Statistiques 51(3):1040–1075.Google Scholar
• Billingsley P (1999) Convergence of Probability Measures, Wiley Series in Probability and Statistics: Probability and Statistics, 2nd ed. (John Wiley & Sons, Inc., New York).Google Scholar
• Budhiraja A, Ghosh A, Liu X (2014) Scheduling control for Markov-modulated single-server multiclass queueing systems in heavy traffic. Queueing Systems 78(1):57–97.Google Scholar
• Cloez B, Hairer M (2015) Exponential ergodicity for Markov processes with random switching. Bernoulli 21(1):505–536.Google Scholar
• Dieker AB, Gao X (2013) Positive recurrence of piecewise Ornstein-Uhlenbeck processes and common quadratic Lyapunov functions. Ann. Appl. Probab. 23(4):1291–1317.Google Scholar
• Ethier SN, Kurtz TG (1986) Markov Processes Characterization and Convergence, Wiley Series in Probability and Mathematical Statistics: Probability and Mathematical Statistics (John Wiley & Sons, Inc., New York).Google Scholar
• Gamarnik D, Stolyar AL (2012) Multiclass multiserver queueing system in the Halfin-Whitt heavy traffic regime: Asymptotics of the stationary distribution. Queueing Systems 71(1–2):25–51.Google Scholar
• Halfin S, Whitt W (1981) Heavy-traffic limits for queues with many exponential servers. Oper. Res. 29(3):567–588.Google Scholar
• Jansen HM, Mandjes M, De Turck K, Wittevrongel S (2017) Diffusion limits for networks of Markov-modulated infinite-server queues. ArXiv 1712.04251.Google Scholar
• Khasminskii RZ (2012) Stability of regime-switching stochastic differential equations. Problems Inform. Transmission 48(3):259–270.Google Scholar
• Khasminskii RZ, Zhu C, Yin G (2007) Stability of regime-switching diffusions. Stochastic Processes Their Appl. 117(8):1037–1051.Google Scholar
• Kumar R, Lewis ME, Topaloglu H (2013) Dynamic service rate control for a single-server queue with Markov-modulated arrivals. Naval Res. Logist. 60(8):661–677.Google Scholar
• Mao X (1999) Stability of stochastic differential equations with Markovian switching. Stochastic Processes Their Appl. 79(1):45–67.Google Scholar
• Meyn SP, Tweedie RL (1993) Stability of Markovian processes. III. Foster-Lyapunov criteria for continuous-time processes. Adv. Appl. Probab. 25(3):518–548.Google Scholar
• Pang G, Whitt W (2009) Heavy-traffic limits for many-server queues with service interruptions. Queueing Systems 61(2–3):167–202.Google Scholar
• Pang G, Zheng Y (2017) On the functional and local limit theorems for Markov modulated compound Poisson processes. Statist. Probab. Lett. 129:131–140.Google Scholar
• Pang G, Talreja R, Whitt W (2007) Martingale proofs of many-server heavy-traffic limits for Markovian queues. Probab. Surveys 4:193–267.Google Scholar
• Protter PE (2005) Stochastic Integration and Differential Equations, Stochastic Modelling and Applied Probability, vol. 21, 2nd ed. version 2.1, corrected third printing (Springer-Verlag, Berlin).Google Scholar
• Xia L, He Q, Alfa AS (2017) Optimal control of state-dependent service rates in a MAP/M/1 queue. IEEE Trans. Automatic Control 62(10):4965–4979.Google Scholar