On the Numerical Analysis of Inhomogeneous Continuous-Time Markov Chains

Published Online:https://doi.org/10.1287/ijoc.1090.0357

References

  • Cellier F. E., Kofman E.Continuous System Simulation (2006) (Springer, New York) Google Scholar
  • Çinlar E.Introduction to Stochastic Processes (1975) (Prentice Hall, Upper Saddle River, NJ) Google Scholar
  • Cloth L., Haverkort B. R., Jongerden M. Computing battery lifetime distributions. Proc. Dependable Systems and Networks (2007) (IEEE Press, Los Alamitos, CA) 780–789CrossrefGoogle Scholar
  • Fox B. L., Glynn P. W. Computing Poisson probabilities. Comm. ACM (1986) 31(4):440–445CrossrefGoogle Scholar
  • Galassi M., Davies J., Theiler J., Gough B., Jungman G., Booth M., Rossi F.GNU Scientific Library Reference Manual (2006) (Network Theory Ltd., Bristol, UK) Google Scholar
  • Grassmann W. K. Transient solutions in Markovian queueing systems. Comput. Oper. Res. (1977) 4(1):47–53CrossrefGoogle Scholar
  • Gross D., Miller D. R. The randomization technique as a modeling tool and solution procedure for transient Markov processes. Oper. Res. (1984) 32(2):343–361LinkGoogle Scholar
  • Haverkort B., Katoen J.-P. The performability distribution of non-homogeneous Markov reward models. Proc. 7th Performability Workshop (2005) Torino, Italy:38–42Google Scholar
  • Jensen A. Markoff chains as an aid in the study of Markoff processes. Skandinavisk Akrtuarietidskrift (1953) 36:87–91Google Scholar
  • Johnson B. R. An elementary approach for extending Poisson processes to the nonstationary case. Amer. Math. Monthly (1984) 91(10):646–648CrossrefGoogle Scholar
  • Law A. M., Kelton W. D.Simulation, Modeling and Analysis (2000) (McGraw Hill, New York) Google Scholar
  • Leemis L. M. Nonparametric estimation of the cumulative intensity function for a nonhomogeneous Poisson process. Management Sci. (1991) 37(7):886–900LinkGoogle Scholar
  • Lewis P. A. W., Shedler G. S. Simulation of nonhomogeneous Poisson processes by thinning. Naval Res. Logist. Quart. (1979) 26(3):403–413CrossrefGoogle Scholar
  • Lui J. C. S., Muntz R. R. Computing bounds on steady state availability of repairable computer systems. J. ACM (1994) 41(4):676–707CrossrefGoogle Scholar
  • Nelson R.Probability, Stochastic Processes, and Queueing Theory (1995) (Springer, New York) CrossrefGoogle Scholar
  • Reibman A. L., Trivedi K. S. Numerical transient analysis of Markov models. Comput. Oper. Res. (1988) 15(1):19–36CrossrefGoogle Scholar
  • Rindos A., Woolet S., Viniotis I., Trivedi K., Stewart W. J. Exact methods for the transient analysis of nonhomogeneous continuous time Markov chains. Computations with Markov Chains (1995) (Kluwer Academic Publishers, Norwell, MA) 121–133CrossrefGoogle Scholar
  • Shantikumar J. G. Uniformization and hybrid simulation/analytic models of renewal processes. Oper. Res. (1986) 34(4):573–580LinkGoogle Scholar
  • Stewart W. J.Introduction to the Numerical Solution of Markov Chains (1994) (Princeton University Press, Princeton, NJ) Google Scholar
  • Telek M., Horváth A., Horváth G. Analysis of inhomogeneous Markov reward models. Linear Algebra Its Appl. (2004) 386:383–405CrossrefGoogle Scholar
  • van Dijk N. M. Uniformization for nonhomogeneous Markov chains. Oper. Res. Lett. (1992) 12(5):283–291CrossrefGoogle Scholar
  • van Moorsel A. P. A., Wolter K. Numerical solution of non-homogeneous Markov processes through uniformization. Proc. 12th Eur. Simulation Multiconference (1998) SCS Europe, Saarbrücken, Germany:710–717Google Scholar
  • Zhang T., Horigome M. Availability and reliability of systems with dependent components and time-varying failure and repair rates. IEEE Trans. Reliability (2001) 50(2):151–158CrossrefGoogle Scholar
INFORMS site uses cookies to store information on your computer. Some are essential to make our site work; Others help us improve the user experience. By using this site, you consent to the placement of these cookies. Please read our Privacy Statement to learn more.