Likelihood Ratio Derivative Estimation for Finite-Time Performance Measures in Generalized Semi-Markov Processes

Published Online:https://doi.org/10.1287/mnsc.44.10.1426

References

  • Athreya K. B., Ney P. E.Branching Processes (1972) (Springer-Verlag, Berlin) CrossrefGoogle Scholar
  • Aleksandrov V. M., Sysoyev V. I., Shemeneva V. V. Stochastic optimization. Engrg. Cybernetics (1968) 5:11–16Google Scholar
  • Arsham H., Feuerberger A., McLeish D. L., Kreimer J., Rubinstein R. Y. Sensitivity analysis and the “What If” problem in simulation analysis. Math. Comput. Modelling (1989) 12:193–219CrossrefGoogle Scholar
  • Billingsley P.Probability and Measure (1986) 2nd ed.( John Wiley and Sons, New York) Google Scholar
  • Blum A., Heidelberger P., Lavenberg S. S., Nakayama M. K., Shahabuddin P.System Availability Estimator (SAVE) Language Reference and User's Manual, Version 4.0 (1993) (Research report RA 219 S, IBM T. J. Watson Research Center, Yorktown Heights, New York) Google Scholar
  • Bratley P., Fox B. L., Schrage S. E.A Guide to Simulation (1987) 2nd ed.(Springer-Verlag, New York) CrossrefGoogle Scholar
  • Damerdji H. Maximum likelihood ratio estimation for generalized semi-Markov processes. Discrete Event Dynam. Systems: Theory and Appl. (1996) 6:73–104CrossrefGoogle Scholar
  • Glasserman P.Gradient Estimation Via Perturbation Analysis (1991a) (Kluwer Academic Press, Norwell MA) Google Scholar
  • Glasserman P. Structural conditions for perturbation analysis derivative estimates: Finite time performance indices. Oper. Res. (1991b) 39:724–738LinkGoogle Scholar
  • Glasserman P. Structural conditions for perturbation analysis of queuing systems. J. ACM (1991c) 38:1005–1025CrossrefGoogle Scholar
  • Glasserman P., Glynn P. W., Swain J. J., Goldsman D., Crain R. C., Wilson J. R. Gradient estimation for regenerative processes. Proc. 1992 Winter Simulation Conf. (1992) (IEEE Press, Piscataway, NJ) 280–288CrossrefGoogle Scholar
  • Glasserman P., Yao D. D. Monotonicity in generalized semi-Markov processes. Math. Oper. Res. (1992a) 17:1–21LinkGoogle Scholar
  • Glasserman P., Yao D. D. Generalized semi-Markov processes: Antimatroid structure and second-order properties. Math. Oper. Res. (1992b) 17:444–469LinkGoogle Scholar
  • Glasserman P., Yao D. D. Some guidelines and guarantees for common random numbers. Management Sci. (1992c) 38:884–908LinkGoogle Scholar
  • Glynn P. W., Wilson J., Henriksen J., Roberts S. Stochastic approximation for Monte Carlo optimization. Proc. 1986 Winter Simulation Conf. (1986) (IEEE Press)356–364CrossrefGoogle Scholar
  • Glynn P. W., Thesen A., Grant H., Kelton W. D. Likelihood ratio gradient estimation: An overview. Proc. 1987 Winter Simulation Conf. (1987) (IEEE Press, Piscataway, NJ) 366–375CrossrefGoogle Scholar
  • Glynn P. W., MacNair E. A., Musselman K. J., Heidelberger P. Optimization of stochastic systems via simulation. Proc. 1989 Winter Simulation Conf. (1989a) (IEEE Press, Piscataway, NJ) 90–105CrossrefGoogle Scholar
  • Glynn P. W. A GSMP formalism for discrete-event systems. Proc. IEEE (1989b) 77:14–23CrossrefGoogle Scholar
  • Glynn P. W. Likelihood ratio derivative estimators for stochastic systems. Comm. ACM (1990) 33(10):75–84CrossrefGoogle Scholar
  • Glynn P. W., Iglehart D. L. Simulation methods for queues: An overview. Queueing Systems: Theory and Appl. (1988) 3:221–256CrossrefGoogle Scholar
  • Glynn P. W., Iglehart D. L. Importance Sampling for Stochastic Simulations. Management Sci. (1989) 35:1367–1393LinkGoogle Scholar
  • Haas P. J., Shedler G. S. Regenerative generalized semi-Markov processes. Stochastic Models (1987) 3:409–438CrossrefGoogle Scholar
  • Heidelberger P., Cao X. R., Zazanis M. A., Suri R. Convergence properties of infinitesimal perturbation analysis estimates. Management Sci. (1988) 34:1281–1302LinkGoogle Scholar
  • Heidelberger P., Shahabuddin P., Nicola V. F. Bounded relative error in estimating transient measures of highly dependable non-Markovian systems. ACM Trans. on Modeling and Comput. Simulation (1994) 4:137–164CrossrefGoogle Scholar
  • Ho Y. C., Cao X. R. Optimization and perturbation analysis of queueing networks. J. Optim. Theory and Appl. (1983) 40:559–582CrossrefGoogle Scholar
  • L'Ecuyer P. A unified view of the IPA. SF, and LR gradient estimation techniques. Management Sci. (1990) 36:1364–1383LinkGoogle Scholar
  • L'Ecuyer P., Nelson B. L., Kelton W. D., Clerk G. M. An overview of derivative estimation. Proc. 1991 Winter Simulation Conf. (1991) (IEEE Press, Piscataway, NJ) 207–217CrossrefGoogle Scholar
  • L'Ecuyer P. Note: On the interchange of derivative and expectation for likelihood ratio derivative estimators. Management Sci. (1995) 41:738–748LinkGoogle Scholar
  • Nakayama M. K. Asymptotics of likelihood ratio derivative estimators in simulations of highly reliable Markovian systems. Management Sci. (1995) 41:524–554LinkGoogle Scholar
  • Nakayama M. K., Goyal A., Glynn P. W. Likelihood ratio sensitivity analysis for Markovian models of highly dependable systems. Oper. Res. (1994) 42:137–157LinkGoogle Scholar
  • Nakayama M. K., Shahabuddin P., Sigman K. A note on exponential moments for branching processes and busy periods for queues. (1996) . PreprintGoogle Scholar
  • Nicola V. F., Nakayama M. K., Heidelberger P., Goyal A. Fast simulation of highly dependable systems with general failure and repair processes. IEEE Trans. Comput. (1993) 14:1440–1452CrossrefGoogle Scholar
  • Nicola V. F., Shahabuddin P., Heidelberger P., Glynn P. W. Fast simulation of steady state availability in non-Markovian highly dependable systems. Proc. Twenty-Third Annual Internat. Sympos. on Fault Tolerant Computing (1993) (IEEE Computer Society Press, Piscataway, NJ) 38–47CrossrefGoogle Scholar
  • Prabhu N. U.Stochastic Processes (1965) (Macmillan, New York) Google Scholar
  • Reiman M. I., Weiss A., Wilson J. R., Henriksen J. O., Roberts S. D. Sensitivity analysis via likelihood ratios. Proc. 1986 Winter Simulation Conf. (1986) (IEEE Press, Piscataway, NJ) 285–289CrossrefGoogle Scholar
  • Reiman M. I., Weiss A. Sensitivity analysis for simulations via likelihood ratios. Oper. Res. (1989) 37:830–844LinkGoogle Scholar
  • Ross S.Stochastic Processes (1983) (Wiley, New York) Google Scholar
  • Rubinstein R. Y. The score function approach for sensitivity analysis of computer simulation models. Math. Comput. Simulation (1986) 28:351–379CrossrefGoogle Scholar
  • Rubinstein R. Y. Sensitivity analysis and performance extrapolation for computer simulation models. Oper. Res. (1989) 37:72–81LinkGoogle Scholar
  • Rubinstein R. Y., Shapiro A.Discrete Event Systems: Sensitivity Analysis and Stochastic Optimization by the Score Function Method (1993) (Wiley, New York) Google Scholar
  • Shassberger R. On the equilibrium distribution of a class of finite-state generalized semi-Markov processes. Math. Oper. Res. (1976) 1:395–406LinkGoogle Scholar
  • Whitt W. Continuity of generalized semi-Markov processes. Math. Oper. Res. (1980) 5:494–501LinkGoogle Scholar
INFORMS site uses cookies to store information on your computer. Some are essential to make our site work; Others help us improve the user experience. By using this site, you consent to the placement of these cookies. Please read our Privacy Statement to learn more.