Lyapunov Conditions for Differentiability of Markov Chain Expectations

References

• [1] Dunford N, Schwartz JT, Bade WG, Bartle RG (1971) Linear Operators (Wiley-Interscience, New York).Google Scholar
• [2] Glasserman P (1993) Regenerative derivatives of regenerative sequences. Adv. Appl. Probab. 25(1):116–139.Crossref, Google Scholar
• [3] Glynn PW, L’Ecuyer P (1995) Likelihood ratio gradient estimation for stochastic recursions. Adv. Appl. Probab. 27(4):1019–1053.Crossref, Google Scholar
• [4] Glynn PW, Meyn SP (1996) A Liapunov bound for solutions of the Poisson equation. Ethier SN, Feng J, Stockbridge RH, eds. Ann. Probab. 24(2):916–931.Crossref, Google Scholar
• [5] Glynn PW, Zeevi A (2008) Bounding stationary expectations of Markov processes. Markov Processes and Related Topics: A Festschrift for Thomas G. Kurtz (Institute of Mathematical Statistics), 195–214.Crossref, Google Scholar
• [6] Heidergott B, Hordijk A (2003) Taylor series expansions for stationary Markov chains. Adv. Appl. Probab. 35(4):1046–1070.Crossref, Google Scholar
• [7] Heidergott, B, Hordijk A (2009) Measure-valued differentiation for the cycle cost performance in the G/G/1 queue in the presence of heavy-tailed distributions. Markov Processes Related Fields 15:225–253.Google Scholar
• [8] Heidergott B, Vázquez-Abad F (2006) Measure-valued differentiation for random horizon problems. Markov Processes Related Fields 12(3):509–536.Google Scholar
• [9] Heidergott B, Hordijk A, Weisshaupt H (2006) Measure-valued differentiation for stationary Markov chains. Math. Oper. Res. 31(1):154–172.Link, Google Scholar
• [10] Ibragimov IA, Has’minskii RZ (1981) Statistical Estimation: Asymptotic Theory, vol. 16 (Springer Science & Business Media, New York).Crossref, Google Scholar
• [11] Kiefer J, Wolfowitz J (1956) On the characteristics of the general queueing process, with applications to random walk. Ann. Math. Statist. 27(1):147–161.Crossref, Google Scholar
• [12] Kifer Y (1986) Ergodic Theory of Random Transformations. Progress in Probability, vol. 10 (Birkhäuser, Boston).Crossref, Google Scholar
• [13] Leahu H, Heidergott B, Hordijk A (2013) Perturbation analysis of waiting times in the G/G/1 queue. Discrete Event Dyn. Syst. 23(3):277–305.Crossref, Google Scholar
• [14] Lehmann EL, Casella G (2006) Theory of Point Estimation (Springer Science & Business Media, New York).Google Scholar
• [15] Meyn S, Tweedie R (2009) Markov Chains and Stochastic Stability (Cambridge University Press, Cambridge).Crossref, Google Scholar
• [16] Pflug GC (1992) Gradient estimates for the performance of Markov chains and discrete event processes. Ann. Oper. Res. 39(1):173–194.Crossref, Google Scholar
• [17] Rosenblatt, M. (1985) Stationary Sequences and Random Fields (Birkhäuser, Boston, Basel, Stuttgart).Crossref, Google Scholar
• [18] Serfling RJ (1980) Approximation Theorems of Mathematical Statistics (Wiley, New York).Crossref, Google Scholar
• [19] Vázquez-Abad FJ, Kushner HJ (1992) Estimation of the derivative of a stationary measure with respect to a control parameter. J. Appl. Probab. 29(2):343–352.Crossref, Google Scholar