Solution and Forecast Horizons for Infinite-Horizon Nonhomogeneous Markov Decision Processes

References

• Alden J. M., Smith R. L. Rolling horizon procedures in nonhomogeneous Markov decision processes. Oper. Res. (1994) 40:S183–S194Link, Google Scholar
• Altman E., Koole G. On submodular functions of dynamic programming. (1995) 1–23Technical Report 2658, INRIA, FranceGoogle Scholar
• Bean J. C., Smith R. L. Conditions for the existence of planning horizons. Math. Oper. Res. (1984) 9:391–401Link, Google Scholar
• Bean J. C., Smith R. L. Conditions for the discovery of planning horizons. Math. Programming (1993) 59:215–229Crossref, Google Scholar
• Bean J. C., Birge J. R., Smith R. L. Aggregation in dynamic programming. Oper. Res. (1987) 35:215–220Link, Google Scholar
• Bean J. C., Smith R. L., Lasserre J. B. Denumerable state nonhomogeneous Markov decision processes. J. Math. Anal. Appl. (1990) 153:64–77Crossref, Google Scholar
• Bes C., Lasserre J. B. An online procedure in discounted infinite-horizon stochastic optimal control. J. Optim. Theory Appl. (1986) 50:61–67Crossref, Google Scholar
• Bes C., Sethi S. Concepts of forecast and decision horizons: Applications to dynamic stochastic optimization problems. Math. Oper. Res. (1988) 13:295–310Link, Google Scholar
• Bhaskaran S., Sethi S. Conditions for the existence of decision horizons for discounted problems in stochastic environment: A note. Oper. Res. Lett. (1985) 4:61–65Crossref, Google Scholar
• Chand S., Hsu V., Sethi S. Forecast, solution and rolling horizons in operations management problems: A classified bibliography. Manufacturing Service Oper. Management (2002) 4:25–43Link, Google Scholar
• Cheevaprawatdomrong T., Smith R. L. Infinite horizon production scheduling in time-varying systems under stochastic demand. Oper. Res. (2004) 52:105–115Link, Google Scholar
• Cheevaprawatdomrong T., Schochetman I. E., Smith R. L., Garcia A. Solution and forecast horizons for infinite horizon nonhomogeneous Markov desion processes. (2005) 1–32Technical Report 05-10, Department of Industrial and Operations Engineering, University of Michigan, Ann Arbor, MIGoogle Scholar
• Cruz-Suarez D., Mantes-de-Oca R., Salem-Silva F. Conditions for the uniqueness of optimal policies of discounted Markov decision processes. Math. Methods Oper. Res. (2004) 60:415–436Crossref, Google Scholar
• Garcia A., Smith R. L. Solving nonstationary infinite horizon dynamic optimization problems. J. Math. Anal. Appl. (2000) 244:304–317Crossref, Google Scholar
• Hernandez-Lerma O.Adaptive Markov Control Processes (1989) (Springer, New York) Crossref, Google Scholar
• Hernandez-Lerma O., Lasserre J. B. A forecast horizon and a stopping rule for general Markov decision processes. J. Math. Anal. Appl. (1988) 132:388–400Crossref, Google Scholar
• Hopp W. J. Identifying forecast horizons in nonhomogeneous Markov decision processes. Oper. Res. (1989) 37:339–343Link, Google Scholar
• Hopp W. J., Bean J. C., Smith R. L. A new optimality criterion for nonhomogeneous Markov decision processes. Oper. Res. (1987) 85:875–883Link, Google Scholar
• Lee C., Denardo E. Rolling planning horizons: Error bounds for dynamic lot size model. Math. Oper. Res. (1986) 11:423–432Link, Google Scholar
• Ross S. M.Introduction to Stochastic Dynamic Programming (1983) (Academic Press, New York) Google Scholar
• Ryan S. M., Bean J. C. Degeneracy in infinite horizon optimization. Math. Programming (1989) 43:305–316Crossref, Google Scholar
• Ryan S. M., Bean J. C., Smith R. L. A tie-breaking algorithm for discrete infinite horizon optimization. Oper. Res. (1992) 40:S117–S126Link, Google Scholar
• Schochetman I. E., Smith R. L. Finite dimensional approximation in infinite dimensional mathematical programming. Math. Programming (1992) 54:307–333Crossref, Google Scholar
• Smith R. L., Zhang R. Q. Infinite horizon production planning in time varying systems with convex production and inventory costs. Management Sci. (1998) 44:1313–1320Link, Google Scholar
• Topkis D. M.Supermodularity and Complementarity (1998) (Princeton University Press, Princeton, NJ) Crossref, Google Scholar