Technical Note—A Note on “Myopic Solutions of Markovian Decision Processes and Stochastic Games”

Published Online:https://doi.org/10.1287/opre.33.6.1394

The aim of this note is to correct some oversights in a 1981 paper by M. J. Sobel on myopic policies. We show by example that somewhat stronger assumptions than Sobel's must be imposed on a Markovian decision model to ensure the optimality of myopic policies. We offer alternatives for augmenting or altenng Sobel's assumptions so that they will be sufficient for myopic policies to be optimal from every initial state.

INFORMS site uses cookies to store information on your computer. Some are essential to make our site work; Others help us improve the user experience. By using this site, you consent to the placement of these cookies. Please read our Privacy Statement to learn more.