Crowding-Out or Crowding-In? The Effects of Idea Evaluation on Evaluators’ Idea Generation

References

• Aceves P, Evans JA (2024) Mobilizing conceptual spaces: How word embedding models can inform measurement and theory within organization science. Organ. Sci. 35(3):788–814.Link, Google Scholar
• Agrawal A, Catalini C, Goldfarb A, Luo H (2018) Slack time and innovation. Organ. Sci. 29(6):1056–1073.Link, Google Scholar
• Ahmadi S, Jansen JJP, Eggers JP (2022) Using stretch goals for idea generation among employees: One size does not fit all! Organ. Sci. 33(2):671–687.Link, Google Scholar
• Amabile T (1988) A model of creativity and innovation in organizations. Res. Organ. Behav. 10:123–167.Google Scholar
• Argote L, Ingram P (2000) Knowledge transfer: A basis for competitive advantage in firms. Organ. Behav. Human Decision Processing 82(1):150–169.Crossref, Google Scholar
• Argote L, Lee S, Park J (2021) Organizational learning processes and outcomes: Major findings and future research directions. Management Sci. 67(9):5399–5429.Link, Google Scholar
• Arts S, Cassiman B, Hou J (2023) Position and differentiation of firms in technology space. Management Sci. 69(12):7253–7265.Link, Google Scholar
• Ayoubi C, Zumel Dumlao JM, Teplitskiy M (2025) Learning by evaluating: Evidence from academic peer review. Preprint, submitted July 14, http://dx.doi.org/10.2139/ssrn.5339282.Google Scholar
• Bandiera O, Barankay I, Rasul I (2010) Social incentives in the workplace. Rev. Econom. Stud. 77(2):417–458.Crossref, Google Scholar
• Baumann O, Eggers JP, Stieglitz N (2019) Colleagues and competitors: How internal social comparisons shape organizational search and adaptation. Admin. Sci. Quart. 64(2):275–309.Crossref, Google Scholar
• Bayus BL (2013) Crowdsourcing new product ideas over time: An analysis of the Dell IdeaStorm community. Management Sci. 59(1):226–244.Link, Google Scholar
• Bell JJ, Pescher C, Tellis GJ, Füller J (2024) Can AI help in ideation? A theory-based model for idea screening in crowdsourcing contests. Marketing Sci. 43(1):54–72.Link, Google Scholar
• Berg JM (2016) Balancing on the creative highwire. Admin. Sci. Quart. 61(3):433–468.Crossref, Google Scholar
• Bjelland OM, Wood RC (2008) An inside view of IBM’s ‘innovation jam’. MIT Sloan Management Rev. 50(1):32–40.Google Scholar
• Borusyak K, Jaravel X, Spiess J (2024) Revisiting event-study designs: Robust and efficient estimation. Rev. Econom. Stud. 91(6):3253–3285. Crossref, Google Scholar
• Boudreau KJ, Lacetera N, Lakhani KR (2011) Incentives and Problem uncertainty in innovation contests: An empirical analysis. Management Sci. 57(5):843–863.Link, Google Scholar
• Boudreau KJ, Guinan EC, Lakhani KR, Riedl C (2016) Looking across and looking beyond the knowledge frontier: Intellectual distance, novelty, and resource allocation in science. Management Sci. 62(10):2765–2783.Link, Google Scholar
• Burtch G, He Q, Hong Y, Lee D (2022) How do peer awards motivate creative content? Experimental evidence from Reddit. Management Sci. 68(5):3488–3506.Link, Google Scholar
• Callaway B, Sant’Anna PH (2021) Difference-in-differences with multiple time periods. J. Econom. 225(2):200–230.Crossref, Google Scholar
• Camacho N, Nam H, Kannan PK, Stremersch S (2019) Tournaments to crowdsource innovation: The role of moderator feedback and participation intensity. J. Marketing 83(2):138–157.Crossref, Google Scholar
• Catalini C (2018) Microgeography and the direction of inventive activity. Management Sci. 64(9):4348–4364.Link, Google Scholar
• Cattani G, Ferriani S, Lanza A (2017) Deconstructing the outsider puzzle: The legitimation journey of novelty. Organ. Sci. 28(6):965–992.Link, Google Scholar
• Chan TY, Li J, Pierce L (2014) Compensation and peer effects in competing sales teams. Management Sci. 60(8):1965–1984.Link, Google Scholar
• Chan KW, Li SY, Ni J, Zhu JJ (2021) What feedback matters? The role of experience in motivating crowdsourcing innovation. Production Oper. Management 30(1):103–126.Crossref, Google Scholar
• Choudhury P (2022) Geographic mobility, immobility, and geographic flexibility: A review and agenda for research on the changing geography of work. Acad. Management Ann. 16(1):258–296.Crossref, Google Scholar
• Cornelius PB, Gokpinar B, Sting FJ (2021) Sparking manufacturing innovation: How temporary interplant assignments increase employee idea values. Management Sci. 67(4):2231–2250.Link, Google Scholar
• Criscuolo P, Dahlander L, Grohsjean T, Salter A (2017) Evaluating novelty: The role of panels in the selection of R&D projects. Acad. Management J. 60(2):433–460.Crossref, Google Scholar
• Cropley A (2006) In praise of convergent thinking. Creativity Res. J. 18(3):391–404.Crossref, Google Scholar
• Cyert R, March JG (1963) A Behavioral Theory of the Firm (Prentice Hall/Pearson Education, Upper Saddle River, NJ).Google Scholar
• Dahan E, Mendelson H (2001) An extreme-value model of concept testing. Management Sci. 47(1):102–116.Link, Google Scholar
• Dahlander L, Piezunka H (2014) Open to suggestions: How organizations elicit suggestions through proactive and reactive attention. Res. Policy 43(5):812–827.Crossref, Google Scholar
• de Chaisemartin C, D’Haultfœuille X (2020) Two-way fixed effects estimators with heterogeneous treatment effects. Amer. Econom. Rev. 110(9):2964–2996.Crossref, Google Scholar
• de Chaisemartin C, D’Haultfœuille X (2026) Difference-in-differences estimators of intertemporal treatment effects. Rev. Econom. Statist.Google Scholar
• Deichmann D, Jensen M (2018) I can do that alone…or not? How idea generators juggle between the pros and cons of teamwork. Strategic Management J. 39(2):458–475.Crossref, Google Scholar
• Deichmann D, van den Ende J (2014) Rising from failure and learning from success: The role of past experience in radical initiative taking. Organ. Sci. 25(3):670–690.Link, Google Scholar
• Ederer F, Manso G (2013) Is pay for performance detrimental to innovation? Management Sci. 59(7):1496–1513.Link, Google Scholar
• Edmondson AC (2012) Teaming: How Organizations Learn, Innovate, and Compete in the Knowledge Economy (Jossey-Bass, NJ).Google Scholar
• Festinger L (1954) A theory of social comparison processes. Human Relations 7(2):117–140.Crossref, Google Scholar
• Fleming L (2001) Recombinant uncertainty in technological search. Management Sci. 47(1):117–132.Link, Google Scholar
• Fleming L, Sorenson O (2004) Science as a map in technological search. Strategic Management J. 25(8–9):909–928.Crossref, Google Scholar
• Forderer J, Burtch G (2025) Estimating career benefits from online community leadership: Evidence from Stack exchange moderators. Management Sci. 71(3):2443–2466.Link, Google Scholar
• Franzoni C, Stephan PE (2023) Uncertainty and risk-taking in science: Meaning, measurement and management in peer review of research proposals. Res. Policy 52(3):104706.Crossref, Google Scholar
• Fuchs C, Sting FJ, Schlickel M, Alexy O (2019) The ideator’s bias: How identity-induced self-efficacy drives overestimation in employee-driven process innovation. Acad. Management J. 62(5):1498–1522.Crossref, Google Scholar
• Gallus J (2017) Fostering public good contributions with symbolic awards: A large-scale natural field experiment at Wikipedia. Management Sci. 63(12):3999–4015.Link, Google Scholar
• Ghosh S, Wu A (2023) Iterative coordination and innovation: Prioritizing value over novelty. Organ. Sci. 34(6):2182–2206.Link, Google Scholar
• Girotra K, Terwiesch C, Ulrich KT (2010) Idea generation and the quality of the best idea. Management Sci. 56(4):591–605.Link, Google Scholar
• Goodman-Bacon A (2021) Difference-in-differences with variation in treatment timing. J. Econom. 225(2):254–277.Crossref, Google Scholar
• Guilford JP (1967) The Nature of Human Intelligence (McGraw-Hill, New York).Google Scholar
• Guzman J, Li A (2023) Measuring founding strategy. Management Sci. 69(1):101–118.Link, Google Scholar
• Haas MR, Criscuolo P, George G (2015) Which problems to solve? Online knowledge sharing and attention allocation in organizations. Acad. Management J. 58(3):680–711.Crossref, Google Scholar
• Haunschild PR, Polidoro F, Chandler D (2015) Organizational oscillation between learning and forgetting: The dual role of serious errors. Organ. Sci. 26(6):1682–1701.Link, Google Scholar
• Janis IL (1982) Groupthink: Psychological Studies of Policy Decisions and Fiascos (Houghton Mifflin, Boston).Google Scholar
• Jeppesen LB, Frederiksen L (2006) Why do users contribute to firm-hosted user communities? The case of computer-controlled music instruments. Organ. Sci. 17(1):45–63.Link, Google Scholar
• Jeppesen LB, Lakhani KR (2010) Marginality and problem-solving effectiveness in broadcast search. Organ. Sci. 21(5):1016–1033.Link, Google Scholar
• Jones BF (2010) Age and great invention. Rev. Econom. Statist. 92(1):1–14.Crossref, Google Scholar
• Kang H, Eklund JC (2025) Fast friends: The impact of short-term visits on firms’ invention outcomes. Organ. Sci. 36(3):1154–1176.Link, Google Scholar
• Kaplan S, Vakili K (2015) The double-edged sword of recombination in breakthrough innovation. Strategic Management J. 36(10):1435–1457.Crossref, Google Scholar
• Karim S, Kaul A (2015) Structural recombination and innovation: Unlocking intraorganizational knowledge synergy through structural change. Organ. Sci. 26(2):439–455.Link, Google Scholar
• Kim JD (2022) Startup acquisitions, relocation, and employee entrepreneurship. Strategic Management J. 43(11):2189–2216.Crossref, Google Scholar
• King G, Zeng L (2001a) Explaining rare events in international relations. Internat. Organ. 55(3):693–715.Crossref, Google Scholar
• King G, Zeng L (2001b) Logistic regression in rare events data. Political Anal. (Oxford) 9(2):137–163.Crossref, Google Scholar
• Klapper H, Piezunka H, Dahlander L (2024) Peer evaluations: Evaluating and being evaluated. Organ. Sci. 35(4):1363–1387.Link, Google Scholar
• Koenker R, Bassett G (1978) Regression quantiles. Econometrica 46(1):33–50.Crossref, Google Scholar
• Kornish LJ, Hutchison-Krupat J (2017) Research on idea generation and selection: Implications for management of technology. Production Oper. Management 26(4):633–651.Crossref, Google Scholar
• Kornish LJ, Ulrich KT (2011) Opportunity spaces in innovation: Empirical analysis of large samples of ideas. Management Sci. 57(1):107–128.Link, Google Scholar
• Lahiri N (2010) Geographic distribution of R&D activity: How does it affect innovation quality? Acad. Management J. 53(5):1194–1209.Crossref, Google Scholar
• Lane JN, Cai T, Menietti M, Weber G, Guinan E (2024) Greenlighting innovative projects: How evaluation format shapes the perceived feasibility of novel ideas. Harvard Business School Technology & Operations Mgt. Unit Working Paper 24-064. Harvard Business School, Boston.Google Scholar
• Lane JN, Ganguli I, Gaule P, Guinan E, Lakhani KR (2021) Engineering serendipity: When does knowledge sharing lead to knowledge production? Strategic Management J. 42(6):1215–1244.Crossref, Google Scholar
• Lane JN, Teplitskiy M, Gray G, Ranu H, Menietti M, Guinan EC, Lakhani KR (2022) Conservatism gets funded? A field experiment on the role of negative information in novel project evaluation. Management Sci. 68(6):4478–4495.Link, Google Scholar
• Levin SG, Stephan PE (1991) Research productivity over the life cycle: Evidence for academic scientists. Amer. Econom. Rev. 81(1):114–132.Google Scholar
• Levinthal DA, March JG (1993) The myopia of learning. Strategic Management J. 14(S2):95–112. Crossref, Google Scholar
• Li D (2017) Expertise versus bias in evaluation: Evidence from the NIH. Amer. Econom. J. Appl. Econom. 9(2):60–92.Crossref, Google Scholar
• March JG (1991) Exploration and exploitation in organizational learning. Organ. Sci. 2(1):71–87.Link, Google Scholar
• March JG, Simon HA (1958) Organizations (Wiley, New York).Google Scholar
• Mas A, Moretti E (2009) Peers at work. Amer. Econom. Rev. 99(1):112–145.Crossref, Google Scholar
• Mihm J, Schlapp J (2019) Sourcing innovation: On feedback in contests. Management Sci. 65(2):559–576.Link, Google Scholar
• Miller DL (2023) An introductory guide to event study models. J. Econom. Perspective 37(2):203–230.Crossref, Google Scholar
• Mueller J, Melwani S, Goncalo JA (2012) The bias against creativity: Why people desire but reject creative ideas. Psych. Sci. 23(1):13–17.Crossref, Google Scholar
• Nelson RR, Winter SG (1982) An Evolutionary Theory of Economic Change (Harvard University Press, Cambridge, MA).Google Scholar
• Nijstad BA, Stroebe W, Lodewijkx HF (2002) Cognitive stimulation and interference in groups: Exposure effects in an idea generation task. J. Experiment. Soc. Psych. 38(6):535–544.Crossref, Google Scholar
• Ocasio W (1997) Towards an attention-based view of the firm. Strategic Management J. 18(S1):187–206.Crossref, Google Scholar
• Ocasio W (2011) Attention to attention. Organ. Sci. 22(5):1286–1296.Link, Google Scholar
• Osborn AF (1953) Applied Imagination: Principles and Procedures of Creative Problem Solving (Charles Scribners Sons, New York).Google Scholar
• Perry-Smith JE, Mannucci PV (2017) From creativity to innovation: The social network drivers of the four phases of the idea journey. Acad. Management Rev. 42(1):53–79.Crossref, Google Scholar
• Piezunka H, Dahlander L (2019) Idea rejected, tie formed: Organizations’ feedback on crowdsourced ideas. Acad. Management J. 62(2):503–530.Crossref, Google Scholar
• Rahmani M, Roels G, Karmarkar US (2018) Team leadership and performance: Combining the roles of direction and contribution. Management Sci. 64(11):5234–5249.Link, Google Scholar
• Ramdas K, Saleh K, Stern S, Liu H (2018) Variety and experience: Learning and forgetting in the use of surgical devices. Management Sci. 64(6):2590–2608.Link, Google Scholar
• Repenning NP (2001) Understanding fire fighting in new product development. J. Production Innovation Management 18(5):285–300.Crossref, Google Scholar
• Riedl C, Grad T, Lettl C (2024) Competition and collaboration in crowdsourcing communities: What happens when peers evaluate each other? Organ. Sci. 35(6):1957–1976.Link, Google Scholar
• Rietzschel EF, Nijstad BA, Stroebe W (2007) Relative accessibility of domain knowledge and creativity: The effects of knowledge activation on the quantity and originality of generated ideas. J. Experiment. Soc. Psych. 43(6):933–946.Crossref, Google Scholar
• Sætre AS, Van de Ven A (2021) Generating theory by abduction. Acad. Management Rev. 46(4):684–701.Crossref, Google Scholar
• Sandler DH, Sandler R (2019) Multiple event studies in public finance and labor economics: A simulation study with applications. J. Econom. Soc. Measures 39(1):31–57.Google Scholar
• Schmidheiny K, Siegloch S (2023) On event studies and distributed-lags in two-way fixed effects models: Identification, equivalence, and generalization. J. Appl. Econometrics 38(5):695–713.Crossref, Google Scholar
• Schweisfurth TG, Greul A (2024) Unexpected interruptions, idle time, and creativity: Evidence from a natural experiment. Organ. Sci. 35(1):116–137.Link, Google Scholar
• Schweisfurth TG, Schöttl CP, Raasch C, Zaggl MA (2023) Distributed decision-making in the shadow of hierarchy: How hierarchical similarity biases idea evaluation. Strategic Management J. 44(9):2255–2282.Crossref, Google Scholar
• Sgourev SV (2013) How Paris gave rise to cubism (and Picasso): Ambiguity and fragmentation in radical innovation. Organ. Sci. 24(6):1601–1617.Link, Google Scholar
• Singh J (2005) Collaborative networks as determinants of knowledge diffusion patterns. Management Sci. 51(5):756–770.Link, Google Scholar
• Singh J (2008) Distributed R&D, cross-regional knowledge integration and quality of innovative output. Res. Policy 37(1):77–96.Crossref, Google Scholar
• Singh J, Agrawal A (2011) Recruiting for ideas: How firms exploit the prior inventions of new hires. Management Sci. 57(1):129–150.Link, Google Scholar
• Singh J, Fleming L (2010) Lone inventors as sources of breakthroughs: Myth or reality? Management Sci. 56(1):41–56.Link, Google Scholar
• Singh J, Marx M (2013) Geographic constraints on knowledge spillovers: Political borders vs. spatial proximity. Management Sci. 59(9):2056–2078.Link, Google Scholar
• Smirnova I, Reitzig M, Sorenson O (2022) Building status in an online community. Organ. Sci. 33(6):2519–2540.Link, Google Scholar
• Smith SM, Ward TB, Schumacher JS (1993) Constraining effects of examples in a creative generation task. Memory Cognition 21(6):837–845.Crossref, Google Scholar
• Sorenson O, Stuart TE (2001) Syndication networks and the spatial distribution of venture capital investments. Amer. J. Sociol. 106(6):1546–1588.Crossref, Google Scholar
• Stadler C, Helfat CE, Verona G (2022) Transferring knowledge by transferring individuals: Innovative technology use and organizational performance in multiunit firms. Organ. Sci. 33(1):253–274.Link, Google Scholar
• Sullivan BN (2010) Competition and beyond: Problems and attention allocation in the organizational rulemaking process. Organ. Sci. 21(2):432–450.Link, Google Scholar
• Sun L, Abraham S (2021) Estimating dynamic treatment effects in event studies with heterogeneous treatment effects. J. Econom. 225(2):175–199.Crossref, Google Scholar
• Sutton RI, Hargadon A (1996) Brainstorming groups in context: Effectiveness in a product design firm. Admin. Sci. Quart. 41(4):685–718.Crossref, Google Scholar
• Terwiesch C, Ulrich KT (2009) Innovation Tournaments: Creating, Selecting, and Developing Exceptional Opportunities (Harvard Business Review Press, Boston).Google Scholar
• Terwiesch C, Xu Y (2008) Innovation contests, open innovation, and multiagent problem solving. Management Sci. 54(9):1529–1543.Link, Google Scholar
• von Hippel E, von Krogh G (2016) CROSSROADS—Identifying viable “need–solution pairs”: Problem solving without problem formulation. Organ. Sci. 27(1):207–221.Link, Google Scholar
• Weitzman ML (1998) Recombinant growth. Quart. J. Econom. 113(2):331–360.Crossref, Google Scholar
• Wooten JO, Ulrich KT (2017) Idea generation and the role of feedback: Evidence from field experiments with innovation tournaments. Production Oper. Management 26(1):80–99.Crossref, Google Scholar
• Wuchty S, Jones BF, Uzzi B (2007) The increasing dominance of teams in production of knowledge. Science (1979) 316(5827):1036–1039.Google Scholar