Easy Affine Markov Decision Processes

References

• Anderson CN, Hsieh CH, Sandin SA, Hewitt R, Hollowed A, Beddington J, May RM, Sugihara G (2008) Why fishing magnifies fluctuations in fish abundance. Nature 452(7189):835–839.Crossref, Google Scholar
• Aström KJ (1970) Introduction to Stochastic Control Theory (Academic Press, Cambridge, MA).Google Scholar
• Athans M, ed. (1971) IEEE Transactions on Automatic Control, Special Issue on the Linear-Quadratic Gaussian Problem, vol. 16 (IEEE, New York).Google Scholar
• Bellman RE, Stuart ED (1962) Applied Dynamic Programming (Princeton University Press, Princeton, NJ).Crossref, Google Scholar
• Bellman RE (1957) Dynamic Programming (Princeton University Press, Princeton, NJ).Google Scholar
• Berkeley SA, Chapman C, Sogard SM (2004) Maternal age as a determinant of larval growth and survival in a marine fish, sebastes melanops. Ecology 85(5):1258–1264.Crossref, Google Scholar
• Bertsekas DP (1995) Dynamic Programming and Optimal Control, vol. 1 (Athena Scientific, Belmont, MA).Google Scholar
• Bertsekas DP, Shreve SE (1978) Stochastic Optimal Control: The Discrete Time Case (Academic Press, Cambridge, MA).Google Scholar
• Birge JR, Louveaux FV (2011) Introduction to Stochastic Programming (Springer, New York).Crossref, Google Scholar
• Clark AJ, Scarf HE (1960) Optimal policies for a multi-echelon inventory problem. Management Sci. 6(4):475–490.Link, Google Scholar
• Clark CW, Mangel M (2000) Dynamic State Variable Models in Ecology: Methods and Applications (Oxford University Press, New York).Google Scholar
• Dantzig GB (1963) Linear Programming and Extensions (Princeton University Press, Princeton, NJ; RAND Corporation, Santa Monica, CA).Crossref, Google Scholar
• Denardo EV, Rothblum UG (1979) Affine dynamic programming. Puterman ML, ed. Dynamic Programming and Its Applications (Academic Press, New York), 255–267.Google Scholar
• Denardo EV, Rothblum UG (1983) Affine structure and invariant policies for dynamic programs. Math. Oper. Res. 8(3):342–365.Link, Google Scholar
• Devalkar SK, Anupindi R, Sinha A (2011) Integrated optimization of procurement, processing, and trade of commodities. Oper. Res. 59(6):1369–1381.Link, Google Scholar
• Eberly JC, Van Mieghem JA (1997) Multi-factor dynamic investment under uncertainty. J. Econom. Theory 75(2):345–387.Crossref, Google Scholar
• Heyman DP, Sobel MJ (2004) Stochastic Optimization, Stochastic Models in Operations Research, vol. 2 (Dover Publications, Mineola, NY).Google Scholar
• Holden M, Conrad J (2015) Optimal escapement in stage-structured fisheries with environmental stochasticity. Math. Biosciences 269:76–85.Crossref, Google Scholar
• Howard RA (1960) Dynamic Programming and Markov Processes (John Wiley & Sons, New York).Google Scholar
• Johnson SA, Shoemaker CA, Li Y, Tejada-Guibert JA, Stedinger JR (1993) Numerical solution of continuous-state dynamic programs using linear and spline interpolation. Oper. Res. 41(3):484–500.Link, Google Scholar
• Lovejoy WS (1986a) Bounds on the optimal age-at-first-capture for stochastic, age-structured fisheries. Canadian J. Fisheries Aquatic Sci. 43(1):101–107.Crossref, Google Scholar
• Lovejoy WS (1986b) Policy bounds for Markov decision processes. Oper. Res. 34(4):630–637.Link, Google Scholar
• Mathur K, Solow D (1994) Management Science (Prentice-Hall, Englewood Cliffs, NJ).Google Scholar
• Mendelssohn R (1982) An iterative aggregation procedure for Markov decision processes. Oper. Res. 30(1):62–73.Link, Google Scholar
• Ning J (2017) Easy affine Markov decision processes: Properties and applications. Leading Developments from INFORMS Communities, TutORials in Operations Research (INFORMS, Catonsville, MD), 28–47.Link, Google Scholar
• Ning J, Sobel MJ (2018) Production, capacity, and liquidity of a financially constrained firm. Manufacturing Service Oper. Management 20(1):147–160.Link, Google Scholar
• Palumbi SR (2004) Fisheries science: Why mothers matter. Nature 430(7000):621–622.Crossref, Google Scholar
• Powell WB (2007) Approximate Dynamic Programming (John Wiley & Sons, Hoboken, NJ).Crossref, Google Scholar
• Powell WB (2014) Clearing the jungle of stochastic optimization. Newman A, Leung J, eds. Bridging Data and Decisions, TutORials in Operations Research (INFORMS, Catonsville, MD), 109–137.Link, Google Scholar
• Puterman ML (1994) Markov Decision Processes: Discrete Stochastic Dynamic Programming (John Wiley & Sons, New York).Crossref, Google Scholar
• Reed WJ (1980) Optimum age-specific harvesting in a nonlinear population model. Biometrics 36(4):579–593.Crossref, Google Scholar
• Scarf HE (1960) The optimality of (s,S) policies in the dynamic inventory problem. Mathematical Methods in the Social Sciences 1959 (Stanford University Press, Stanford, CA).Google Scholar
• Simon HA (1956) Dynamic programming under uncertainty with a quadratic criterion function. Econometrica 24(1):74–81.Crossref, Google Scholar
• Sinha C, Sobel MJ, Babich V (2011) Computationally simple and unified approach to finite- and infinite-horizon clarkscarf inventory model. IIE Trans. 43(3):207–219.Crossref, Google Scholar
• Skonhoft A, Vestergaard N, Quaas M (2012) Optimal harvest in an age structured model with different fishing selectivity. Environ. Res. Econom. 51(4):525–544.Crossref, Google Scholar
• Sobel MJ (1981) Myopic solutions of Markov decision processes and stochastic games. Oper. Res. 29(5):996–1009.Link, Google Scholar
• Sobel MJ (1990a) Higher-order and average reward myopic-affine dynamic models. Math. Oper. Res. 15(2):299–310.Link, Google Scholar
• Sobel MJ (1990b) Myopic solutions of affine dynamic models. Oper. Res. 38(2):847–853.Link, Google Scholar
• Tahvonen O (2009) Economics of harvesting age-structured fish populations. J. Environ. Econom. Management 58(3):281–299.Crossref, Google Scholar
• Tahvonen O, Quaas MF, Voss R (2017) Harvesting selectivity and stochastic recruitment in economic models of age-structured fisheries. J. Environ. Econom. Management 92(November):659–676.Crossref, Google Scholar
• Theil H (1957) A note on certainty equivalence in dynamic planning. Econometrica 25(2):346–349.Crossref, Google Scholar
• Van Mieghem JA (2003) Capacity management, investment and hedging: Review and recent developments. Manufacturing Service Oper. Management 5(4):269–302.Link, Google Scholar
• Veinott AF Jr, Wagner HM (1965) Computing optimal (s, S) policies. Management Sci. 11(5):525–552.Link, Google Scholar
• Veinott AF Jr (1965) Optimal policy for a multi-product, dynamic nonstationary inventory problem. Management Sci. 12(3):206–222.Link, Google Scholar
• Wagner HM (1969) Principles of Operations Research, with Applications to Managerial Decisions (Prentice-Hall, Upper Saddle River, NJ).Google Scholar
• Whitt W (1978) Approximations of dynamic programs, I. Math. Oper. Res. 3(3):231–243.Link, Google Scholar
• Whitt W (1979a) Approximations of dynamic programs, II. Math. Oper. Res. 4(2):179–185.Link, Google Scholar
• Whitt W (1979b) A priori bounds for approximations of dynamic programs. J. Math. Anal. Appl. 71(1):297–302.Crossref, Google Scholar
• Zéphyr L, Lang P, Lamond BF, Côté P (2017) Approximate stochastic dynamic programming for hydroelectric production planning. Eur. J. Oper. Res. 262(2):586–601.Crossref, Google Scholar