Near-Term Liability of Exploitation: Exploration and Exploitation in Multistage Problems

References

• Andrews K.The Concept of Corporate Strategy (1965) (Irwin Homewood, IL) Google Scholar
• Argote L.Organizational Learning: Creating Retaining and Transferring Knowledge (1999) (Springer-Verlag, New York) Google Scholar
• Bellman R.Dynamic Programming (1957) (Princeton University Press, Princeton, NJ) Google Scholar
• Benner M., Tushman M. Process management and technological innovation: A longitudinal study of the photography and paint industries. Admin. Sci. Quart. (2002) 47:676–706Crossref, Google Scholar
• Benner M., Tushman M. Exploitation, exploration and process management: The productivity dilemma revisited. Acad. Management Rev. (2003) 28(2):238–257Crossref, Google Scholar
• Berthier N., Rosenstein M., Barto A. Approximate optimal control as a model for motor learning. Psych. Rev. (2005) 112(2):329–346Crossref, Google Scholar
• Block Z., MacMillan I. Milestones for successful venture planning. Harvard Bus. Rev. (1985) 63(5):184–190Google Scholar
• Breeden J., Dionkelacker F., Huber A. Noise in the modeling and control of dynamical systems. Physical Rev. A (1990) 42:5827–5836Crossref, Google Scholar
• Brehmer B., Frensch P., Funke J. Feedback delays in complex dynamic decision tasks. Complex Problem Solving, The European Perspective (1995) (Erlbaum Associates, Hillsdale, NJ) Google Scholar
• Bruderer E., Singh J. Organizational evolution, learning and selection: A genetic algorithm-based model. Acad. Management J. (1996) 39:1322–1329Crossref, Google Scholar
• Camerer C., Ho T. H. Experience-weighted attraction learning in normal form games. Econometrica (1999) 67:837–874Crossref, Google Scholar
• Campbell D. T. Blind variation and selective retention in creative thought processes. Psych. Rev. (1960) 67:380–400Crossref, Google Scholar
• Cyert R., March J.A Behavioral Theory of the Firm (1963) (Prentice-Hall, Englewood Cliffs, NJ) Google Scholar
• Daw N., Dayan P. Matchmaking. Science (2004) 304:1753–1754Crossref, Google Scholar
• Daw N., O'Doherty J., Dayan P., Seymour B., Dolan R. Cortical substrates for exploratory decisions in humans. Nature (2006) 441(15):876–879Crossref, Google Scholar
• DeGroot A. D.Thought and Choice in Chess (1965) (Mouton Publishers, The Hague) Google Scholar
• DeGroot M. H.Optimal Statistical Decisions (1970) (McGraw-Hill, New York) Google Scholar
• Denrell J., Fang C., Levinthal D. Learning from t-mazes to labyrinths: Learning from model-based feedback. Management Sci. (2004) 50(10):1366–1378Link, Google Scholar
• Einhorn H., Hogarth R. Behavioral decision theory: Processes of judgment and choice. J. Accounting Res. (1981) 19(1):1–32Crossref, Google Scholar
• Friedman M.Essays in Positive Economics (1953) (University of Chicago Press, Chicago) Google Scholar
• Fukunaga A., Rabideau G., Chien S. Robust local search for spacecraft operations using adaptive noise. Proc. 4th Internat. Workshop Planning Scheduling Space (2004) Darmstadt, GermanyGoogle Scholar
• Gans N., Knox G., Croson R. Simple models of discrete choice and their performance in bandit experiments. Manufacturing Service Oper. Management (2007) 9(4):383–408Link, Google Scholar
• Garvin D. How the baldridge award really works. Harvard Bus. Rev. (1991) 69(6):80–93Google Scholar
• Gavetti G., Levinthal D. Looking forward and looking backward: Cognitive and experiential search. Admin. Sci. Quart. (2000) 45(1):113–137Crossref, Google Scholar
• Gavetti G., Levinthal D., Rivkin J. Strategy making in novel and complex worlds: The power of analogy. Strategic Management J. (2005) 26:691–712Crossref, Google Scholar
• Gibson F., Fichman M., Plaut D. Learning in dynamic decision tasks: Computational model and empirical evidence. Organ. Behav. Human Decision Processes (1997) 71:11–35Crossref, Google Scholar
• Guastello S.Chaos, Catastrophe and Human Affairs (1995) (Lawrence Erlbaum Associates, Mahwah, NJ) Google Scholar
• Herriott S., Levinthal D., March J. G. Learning from experience in organizations. Amer. Econom. Rev., Papers Proc. 97th Annual Meeting (1985) 75(2):298–302Google Scholar
• Holland J.Adaptation in Natural and Artificial Systems (1975) (University of Michigan Press, Ann Arbor, MI) Google Scholar
• Hsu F. H.Behind Deep Blue: Building the Computer that Defeated the World Chess Champion (2002) (Princeton University Press, Princeton, NJ) Google Scholar
• Jackson E. On the control of complex dynamic systems. Physica D (1991a) 50:341–366Crossref, Google Scholar
• Jackson E. Controls of dynamic flows with attractors. Physical Rev. A (1991b) 44:4839–4853Crossref, Google Scholar
• Kaelbling L.Learning in Embedded Systems (1993) (MIT Press, Cambridge, MA) Crossref, Google Scholar
• Kahneman D., Tversky A. On the psychology of prediction. Psych. Rev. (1973) 80:237–251Crossref, Google Scholar
• Kaplan C. A., Simon H. A. In search of insight. Cognitive Psych. (1990) 22:374–419Crossref, Google Scholar
• Kauffman S.The Origins of Order (1993) (Oxford University Press, New York) Crossref, Google Scholar
• Langley P., Jones R., Sternberg R. A computational model of scientific insights. The Nature of Creativity: Contemporary Psychological Perspectives (1988) (Cambridge University Press, New York) 177–201Google Scholar
• Lant T. K., Carley K., Prietula M. Computer simulations of organizations as experiential learning systems: Implications for organization theory. Computational Organization Theory (1994) (Lawrence Erlbaum Associates, Hillsdale, NJ) Google Scholar
• Lant T., Mezias S. Managing discontinuous change: A simulation study of organizational learning and entrepreneurship. Strategic Management J. (1990) 11(4):147–179Google Scholar
• Lant T., Mezias S. An organizational learning model of convergence and reorientation. Organ. Sci. (1992) 3(1):47–71Link, Google Scholar
• Lave C., March J.An Introduction to Models in Social Sciences (1975) (Harper & Row, New York) Google Scholar
• Lee D. Best to go with what you know? Nature (2006) 441(15):822–823Crossref, Google Scholar
• Leifer E.Actors as Observers: A Theory of Skill in Social Relationships (1991) (Garland, New York) Google Scholar
• Levinthal D. Adaptation on rugged landscapes. Management Sci. (1997) 43(7):934–950Link, Google Scholar
• Levinthal D., March J. A model of adaptive organizational search. J. Econom. Behav. Organ. (1981) 2:307–333Crossref, Google Scholar
• Levinthal D., March J. The myopia of learning. Strategic Management J. (1993) 14:95–112Crossref, Google Scholar
• Levitt B., March J. Organization learning. Annual Rev. Sociol. (1988) 14:319–340Crossref, Google Scholar
• Luce R.Individual Choice Behavior (1959) (John Wiley and Sons, New York) Google Scholar
• March J. Bounded rationality, ambiguity and the engineering of choice. Bell J. Econom. (1978) 9(2):587–608Crossref, Google Scholar
• March J. Exploration and exploitation in organization learning. Organ. Sci. (1991) 2(1):71–87Link, Google Scholar
• McKelvey B. Avoiding complexity catastrophe in co-evolutionary pockets: Strategies for rugged landscape. Organ. Sci. (1999) 10(3):294–321Link, Google Scholar
• Minsky M. Steps towards artificial intelligence. Proc. Inst. Radio Engineers (1961) 49(1):8–30Google Scholar
• Montague P. R., Dayan P., Sejnowski T. J. A framework for mesence-phalic dopamine systems based on predictive hebbian learning. J. Neuroscience (1996) 16:1936–1947Google Scholar
• McClure S., Daw N., Montague P. A computational substrate for incentive salience. Trends in Neurosciences (2003) 26:423–428Crossref, Google Scholar
• Newell A., Simon H.Human Problem Solving (1972) (Prentice-Hall, Englewood Cliffs, NJ) Google Scholar
• O'Doherty J., Dayan P., Schultz J., Deichmann R., Friston K., Dolan R. Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science (2004) 304:452–454Crossref, Google Scholar
• Ohle F., Dinkelacker F., Huber A., Welge M. Adapative control of chaotic systems. (1990) . Technical Report CCER-90-13, Department of Physics, Beckman Institute, University of Illinois, Urbana-ChampaignGoogle Scholar
• Padgett J., Ansell C. Robust action and the rise of the medici, 1400–1434. Amer. J. Sociol. (1993) 98(6):1259–1319Crossref, Google Scholar
• Perkins D.The Eureka Effect: The Art and Logic of Breakthrough Thinking (2000) (W. W. Norton and Company, New York) Google Scholar
• Pisano G. Can science be a business? Harvard Bus. Rev. (2006) October):1–12Google Scholar
• Poincaré H.The Foundations of Science (1929) (Science House, New York) Google Scholar
• Radner R., Rothschild M. On the allocation of effort. J. Econom. Theory (1975) 10:358–376Crossref, Google Scholar
• Rivkin J. W. Imitation of complex strategies. Management Sci. (2000) 46(6):824–844Link, Google Scholar
• Roth A., Erev I. Learning in extensive form games: Experimental data and simple dynamic models in the intermediate term. Games and Econom. Behav. (1995) 8:164–212Crossref, Google Scholar
• Samuel A. Some studies in machine learning using the game of checkers. IBM J. Res. Development (1959) 32:211–229Google Scholar
• Samuel A. Some studies in machine learning using the game of checkers II—Recent progress. IBM J. Res. Development (1967) 11:601–617Crossref, Google Scholar
• Savage L.The Foundations of Statistics (1954) (John Wiley and Sons, New York) Google Scholar
• Schultz W., Dayan P., Montague P. R. A neural substrate of prediction and reward. Science (1997) 275:1593–1599Crossref, Google Scholar
• Seabrook R., Dienes Z. Incubation in problem solving as a context effect. Proc. 25th Meeting Cognitive Sci. Soc. (2003) Lawrence Erlbaum AssociatesMahwah, NJGoogle Scholar
• Segal E. Incubation in insight problem solving. Creativity Res. J. (2004) 16(1):141–148Crossref, Google Scholar
• Selman B., Kautz H. An empirical study of greedy local search for satisfiability testing. Proc. Amer. Assoc. Artificial Intelligence (1993) 46–51Google Scholar
• Selman B., Kautz H., Cohen B. Noise strategies for improving local search. Proc. Amer. Assoc. Artificial Intelligence (1994) 337–343Google Scholar
• Simon H. A behavioral model of rational choice. Quart. J. Econom. (1955) 69(1):99–118Crossref, Google Scholar
• Simon H. A., Colodny R. Scientific discovery and the psychology of problem solving. Mind and Cosmos (1966) (University of Pittsburgh Press, Pittsburg) 22–40Google Scholar
• Simon H. Decision making and problem solving. Research Briefings 1986: Report of the Research Briefing Panel on Decision Making and Problem Solving (1986) (National Academy of Sciences, National Academy Press, Washington, D.C.) Google Scholar
• Simon H. Invariants of human behavior. Annual Rev. Psych. (1990) 41:1–19Crossref, Google Scholar
• Simon H., Lindbeck A. Rational decision-making in business organizations. Nobel Lectures, Economics 1969–1980 (1992) (World Scientific Publishing, Singapore) Google Scholar
• Simonton D., Sternberg R. J., Davidson J. E. Foresight in insight? A Darwinian answer. The Nature of Insight (1995) (MIT Press, Cambridge, MA) 465–494Google Scholar
• Sterman J. Misperceptions of feedback in dynamic decision making. Organ. Behav. Human Decision Processes (1989) 43(3):301–328Crossref, Google Scholar
• Sterman J., Repenning N., Kofman F. Unanticipated side effects of successful quality programs: Exploring a paradox of organizational improvement. Management Sci. (1997) 43(4):503–521Link, Google Scholar
• Sutton J.Philosophy and Memory Traces: Descartes to Connectionism (1998) (Cambridge University Press, Cambridge, UK) Google Scholar
• Sutton R., Barto A. An adaptive network that constructs and uses an internal model of its world. Cognition Brain Theory (1981) 4(3):217–246Google Scholar
• Sutton R., Barto A.Reinforcement Learning: An Introduction (1998) (MIT Press, Cambridge, MA) Google Scholar
• Thagard P.Mind: Introduction to Cognitive Science (1996) (MIT Press, Cambridge, MA) Google Scholar
• Thompson J. D.Organizations in Action (1967) (McGraw-Hill, New York) Google Scholar
• Thorndike E. Animal intelligence: An experimental study of the associative processes in animals. Psych. Rev. (1898) . Monograph Supplements 8Google Scholar
• Wallas G.The Art of Thought (1926) (Harcourt, New York) Google Scholar
• Watkins C.Learning from Delayed Rewards (1989) (Kings' College, Cambridge, UK) Google Scholar
• Weber E., Shafir S., Blais A.-R. Predicting risk sensitivity in humans and lower animals: Risk as variance or coefficient of variation. Psych. Rev. (2004) 11:430–445Crossref, Google Scholar
• Yaniv I., Meyer D. Activation and metacognition of inaccessible stored information: Potential bases of incubation effects in problem solving. J. Experiment. Psych. Learn., Memory, Cognition (1987) 13:187–205Crossref, Google Scholar