Technical Note—Cyclic Variables and Markov Decision Processes

References

• Aguirregabiria V, Mira P (2002) Swapping the nested fixed point algorithm: A class of estimators for discrete Markov decision models. Econometrica 70(4):1519–1543.Crossref, Google Scholar
• Dai P, Mausam, Weld DS, Goldsmith J (2011) Topological value iteration algorithms. J. Artificial Intelligence Res. 42:181–209.Google Scholar
• Judd KL (1998) Numerical Methods in Economics (MIT Press, Cambridge, MA).Google Scholar
• Paarsch HJ, Rust J (2009) Valuing programs with deterministic and stochastic cycles. J. Econom. Dynam. Control 33(3):614–623.Crossref, Google Scholar
• Pakes A, McGuire P (1994) Computing Markov-perfect Nash equilibria: Numerical implications of a dynamic differentiated product model. RAND J. Econom. 25(4):555–589.Crossref, Google Scholar
• Rust J (1987) Optimal replacement of GMC bus engines: An empirical model of Harold Zurcher. Econometrica 55(5):999–1033.Crossref, Google Scholar
• Su C-L, Judd KL (2012) Constrained optimization approaches to estimation of structural models. Econometrica 80(5):2213–2230.Crossref, Google Scholar