Optimality Inequalities for Average Cost Markov Decision Processes and the Stochastic Cash Balance Problem

References

• Bertsekas D. P.Dynamic Programming and Optimal Control (2000) Vol. 12nd ed.(Athena Scientific, Belmont, MA) Google Scholar
• Bertsekas D. P.Dynamic Programming and Optimal Control (2001) Vol. 22nd ed.(Athena Scientific, Belmont, MA) Google Scholar
• Bertsekas D. P., Shreve S. E.Stochastic Optimal Control: The Discrete-Time Case (1996) (Athena Scientific, Belmont, MA) Google Scholar
• Cavazos-Cadena R. A counterexample on the optimality equation in Markov decision chains with the average cost criterion. Systems & Control Lett. (1991) 16:387–392Crossref, Google Scholar
• Cavazos-Cadena R., Sennott L. I. Comparing recent assumptions for the existence of average optimal stationary policies. Oper. Res. Lett. (1992) 11:33–37Crossref, Google Scholar
• Chen X., Simchi-Levi D. A new approach for the stochastic cash balance problem with fixed costs. (2003) . Operations Research Center, Massachusetts Institute of Technology, Preprint. https://netfiles.uiuc.edu/xinchen/www/papers/CBP7.pdfGoogle Scholar
• Chen X., Simchi-Levi D. Coordinating inventory control and pricing strategies with random demand and fixed ordering cost: The infinite horizon case. Math. Oper. Res. (2004) 29:698–723Link, Google Scholar
• Constantinides G. M., Richard S. F. Existence of optimal simple policies for discounted cost inventory and cash management in continuous time. Oper. Res. (1978) 26(4):620–636Link, Google Scholar
• Elton E. J., Gruber M. J. On the cash balance problem. Oper. Res. Quart. (1974) 25(4):553–572Crossref, Google Scholar
• Eppen G. D., Fama E. F. Cash balance and simple dynamic portfolio problems with proportional costs. Internat. Econom. Rev. (1969) 10(2):119–133Crossref, Google Scholar
• Feinberg E. A., Feinberg E. A., Shwartz A. Total reward criteria. Handbook of Markov Decision Processes (2002) (Kluwer, Boston, MA) 173–207Crossref, Google Scholar
• Feinberg E. A., Lewis M. E. Optimality of four-threshold policies in inventory systems with customer returns and borrowing/storage options. Probab. Engrg. Inform. Sci. (2005) 19(1):45–71Crossref, Google Scholar
• Feinberg E. A., Lewis M. E. Optimality inequalities for average cost Markov decision processes and the optimality of (s, S) policies. (2006) . Technical Report TR1442, Cornell University, http://legacy.orie.cornell.edu/techreports/TR1442.pdfGoogle Scholar
• Fernández-Gaucherand E., Arapostathis A., Marcus S. I. Convex stochastic control problems. Proc. 31st Conf. Decision and Control, IEEE (1992) (December):2179–2180Crossref, Google Scholar
• Fleischmann M., Kuik R., Dekker R. Controlling inventories with stochastic item retruns: A basic model. Eur. J. Oper. Res. (2002) 138:63–75Crossref, Google Scholar
• Gaskill H. S., Narayanaswami P. P.Elements of Real Analysis (1998) (Prentice-Hall, Upper Saddle River, NJ) Google Scholar
• Girgis N. M. Optimal cash balance levels. Management Sci. (1968) 15(3):130–140Link, Google Scholar
• Hernández-Lerma O. Average optimality in dynamic programming on Borel spaces. Systems and Control Lett. (1991) 17(3):237–242Crossref, Google Scholar
• Hernández-Lerma O., Lasserre J. B.Discrete-Time Markov Control Processes: Basic Optimality Criteria (1996) (Springer, New York) Crossref, Google Scholar
• Heyman D. P. Optimal disposal policies for a single-item inventory system with returns. Naval Res. Logist. Quart. (1977) 24:385–405Crossref, Google Scholar
• Heyman D. P., Sobel M. J.Stochastic Models in Operations Research (1984) 2(McGraw-Hill, New York) Google Scholar
• Hildenbrand W.Core and Equilibria of a Large Economy (1974) (Princeton University Press, Princeton, NJ) . Princeton Studies in Mathematical EconomicsGoogle Scholar
• Hinderer K., Waldmann K.-H. Cash management in a randomly varying environment. Eur. J. Oper. Res. (2001) 130:468–485Crossref, Google Scholar
• Kechris A. S.Classical Descriptive Set Theory (1994) (Springer-Verlag, New York) Google Scholar
• Neave E. H. The stochastic cash balance problem with fixed costs for increases and decreases. Management Sci. (1970) 16(7):472–490Link, Google Scholar
• Nikaido H.Convex Structures and Economic Theory, Mathematics in Science and Engineering (1968) 51(Academic Press, New York) Google Scholar
• Schäl M. Average optimality in dynammic programming with general state space. Math. Oper. Res. (1993) 18(1):163–172Link, Google Scholar
• Sennott L. I.Stochastic Dynamic Programming and the Control of Queueing Systems (1999) (John Wiley and Sons, Inc., New York) Wiley Series in Probability and StatisticsGoogle Scholar
• Shiryaev A. N.Probability (1996) 2nd ed.(Springer, New York) Crossref, Google Scholar
• van der Laan E., Salomon M. Production planning and inventory control with remanufacturing and disposal. Eur. J. Oper. Res. (1997) 102:264–278Crossref, Google Scholar
• Ye Q., Duenyas I. Optimal capacity investment decisions with two-sided fixed capacity adjustment costs. Oper. Res. (2007) 55(2):272–283Link, Google Scholar