Likelihood Ratio Gradient Estimation for Steady-State Parameters

References

• Ethier S, Kurtz T (1986) Markov Processes: Characterization and Convergence (John Wiley & Sons, New York).Google Scholar
• Fu M (2006) Gradient estimation. Henderson SG, Nelson BL, eds. Simulation, Handbooks in Operations Research and Management Science, vol. 13 (North-Holland, Amsterdam), 575–616.Google Scholar
• Glasserman P (1991) Gradient Estimation via Perturbation Analysis, Kluwer International Series in Engineering and Computer Science (Kluwer Academic Publishers, Norwell, MA).Google Scholar
• Glynn P, L’Ecuyer P (1995) Likelihood ratio gradient estimation for stochastic recursions. Adv. Appl. Probab. 27(4):1019–1053.Google Scholar
• Glynn P, Meyn S (1996) A Liapounov bound for solutions of the Poisson equation. Ann. Probab. 24(2):916–931.Google Scholar
• Hashemi A, Nunez M, Plecháč P, Vlachos D (2016) Stochastic averaging and sensitivity analysis for two scale reaction networks. J. Chemical Phys. 144(7):074104.Google Scholar
• Heidergott B, Hordijk A (2009) Measure-valued differentiation for the cycle cost performance in the G/G/1 queue in the presence of heavy-tailed distributions. Markov Processes Related Fields 15(2):225–253.Google Scholar
• Heidergott B, Hordijk A, Weisshaupt H (2006) Measure-valued differentiation for stationary Markov chains. Math. Oper. Res. 31(1):154–172.Link, Google Scholar
• Kurtz T, Protter P (1991) Weak limit theorems for stochastic integrals and stochastic differential equations. Ann. Probab. 19(3):1035–1070.Google Scholar
• L’Ecuyer P (1990) A unifed view of the IPA, SF, and LR gradient estimation techniques. Management Sci. 36(11):1364–1383.Link, Google Scholar
• L’Ecuyer P (1995) On the interchange of derivative and expectation for likelihood ratio derivative estimators. Management Sci. 41(4):738–748.Link, Google Scholar
• Meyn S, Tweedie R (1993) Markov Chains and Stochastic Stability (Springer-Verlag, London).Google Scholar
• Rhee C, Glynn P (2016) Lyapunov conditions for differentiability of Markov chain expectations: The absolutely continuous case. Working paper, Northwestern University, Evanston, IL.Google Scholar
• Rubinstein R, Marcus R (1985) Efficiency of multivariate control variates and Monte Carlo simulation. Oper. Res. 33(3):661–677.Link, Google Scholar
• Whitt W (2007) Proofs of the martingale FCLT. Probab. Surveys 4:268–302.Google Scholar