Can AI Help in Ideation? A Theory-Based Model for Idea Screening in Crowdsourcing Contests

Published Online:https://doi.org/10.1287/mksc.2023.1434

References

  • Abadie A, Kasy M (2019) The risk of machine learning. Rev. Econom. Statist. 101(5):743–762.CrossrefGoogle Scholar
  • Allen BJ, Chandrasekaran D, Basuroy S (2018) Design crowdsourcing: The impact on new product performance of crowdsourcing design solutions from the “crowd.” J. Marketing 82(2):106–123.CrossrefGoogle Scholar
  • Auer P (2002) Using confidence bounds for exploitation-exploration trade-offs. J. Machine Learn. Res. 3:397–422.Google Scholar
  • Balakrishnan V, Lloyd-Yemoh E (2014) Stemming and lemmatization: A comparison of retrieval performances. Lecture Notes on Software Engrg. 2(3):262–267Google Scholar
  • Bayus BL (2013) Crowdsourcing new product ideas over time: An analysis of the Dell Ideastorm community. Management Sci. 59(1):226–244.LinkGoogle Scholar
  • Berger J, Humphreys A, Ludwig S, Moe WW, Netzer O, Schweidel DA (2020) Uniting the tribes: Using text for marketing insight. J. Marketing 84(1):1–25.CrossrefGoogle Scholar
  • Berger J, Packard G (2018) Are atypical things more popular? Psych. Sci. 29(7):1178–1184.CrossrefGoogle Scholar
  • Berlyne DE (1970) Novelty, complexity, and hedonic value. Perception Psychophysics 8:279–286.CrossrefGoogle Scholar
  • Besemer SP, Treffinger DJ (1981) Analysis of creative products: Review and synthesis. J. Creative Behav. 15(3):158–178.CrossrefGoogle Scholar
  • Bilalić M, McLeod P, Gobet F (2008) Inflexibility of experts—Reality or myth? Quantifying the Einstellung effect in chess masters. Cognitive Psych. 56(2):73–102.CrossrefGoogle Scholar
  • Blei DM, Ng AY, Jordan MI (2003) Latent Dirichlet allocation. J. Machine Learn. Res. 3:993–1022.Google Scholar
  • Breiman L (2001) Random forests. Machine Learn. 45(1):5–32.CrossrefGoogle Scholar
  • Brynjolfsson E, McAfee A (2017) The business of artificial intelligence: What it can—and cannot—do for your organization. Harvard Business Review Online (July 18), https://hbr.org/2017/07/the-business-of-artificial-intelligence.Google Scholar
  • Burt RS (2004) Structural holes and good ideas. Amer. J. Sociol. 110(2):349–399.CrossrefGoogle Scholar
  • Burt RS (2009) Structural Holes: The Social Structure of Competition (Harvard University Press, Boston).Google Scholar
  • Cockburn I, Henderson R, Stern S (2019) The impact of artificial intelligence on innovation: An exploratory analysis. Agrawal A, Gans J, Goldfarb A, eds. The Economics of Artificial Intelligence (University of Chicago Press, Chicago), 115–148.CrossrefGoogle Scholar
  • Dahan E, Hauser JR (2002) Product development—Managing a dispersed process. Weitz B, Wensley R, eds. Handbook of Marketing (Sage Publication, New York), 179–222.CrossrefGoogle Scholar
  • Dahl DW, Chattopadhyay A, Gorn GJ (1999) The use of visual mental imagery in new product design. J. Marketing Res. 36(1):18–28.CrossrefGoogle Scholar
  • Dahl DW, Moreau CP (2002) The influence and value of analogical thinking during new product ideation. J. Marketing Res. 39(1):47–60.CrossrefGoogle Scholar
  • Dean DL, Hender JM, Rodgers TL, Santanen E (2006) Identifying good ideas: Constructs and scales for idea evaluation. J. Assoc. Inform. Systems 7(10):646–699.Google Scholar
  • Durand DE, VanHuss SH (1992) Creativity software and DSS: Cautionary findings. Inform. & Management 23(1):1–6.Google Scholar
  • Eling K, Griffin A, Langerak F (2014) Using intuition in fuzzy front-end decision-making: A conceptual framework. J. Product Innovation Management 31(5):956–972.CrossrefGoogle Scholar
  • Fiez T, Jain L, Jamieson K, Ratliff L (2019) Sequential experimental design for transductive linear bandits. 33rd Conf. Neural Inform. Processing Systems (Curran Associates, Red Hook, NY), 10667–10777.Google Scholar
  • Finke RA, Ward TB, Smith SM (1996) Creative Cognition: Theory, Research, and Applications. MIT Press, Cambridge, MA.Google Scholar
  • Friedman JH, Popescu BE (2008) Predictive learning via rule ensembles. Ann. Appl. Statist. 2(3):916–954.CrossrefGoogle Scholar
  • Füller J, Hutter K, Wahl J, Bilgram V, Tekic R (2022) How AI revolutionizes innovation management—Perceptions and implementation preferences of AI-based innovators. Tech. Forecasting Soc. Change 178:121598.CrossrefGoogle Scholar
  • Godart FC, Galunic C (2019) Explaining the popularity of cultural elements: Networks, culture, and the structural embeddedness of high fashion trends. Organ. Sci. 30(1):151–168.LinkGoogle Scholar
  • Goldenberg J, Mazursky S (2002) Creativity in Product Innovation (Cambridge University Press, Cambridge, UK).CrossrefGoogle Scholar
  • Goodfellow I, Bengio Y, Courville A (2016) Deep Learning (MIT Press, Cambridge, MA).Google Scholar
  • Hoffman M, Bach F, Blei D (2010) Online learning for latent Dirichlet allocation. Adv. Neural Inform. Processing Systems 23.Google Scholar
  • Hosmer DW, Lemeshow S (2013) Applied Logistic Regression, 2nd ed. (John Wiley & Sons, New York).CrossrefGoogle Scholar
  • Ireland ME, Pennebaker JW (2010) Language style matching in writing: Synchrony in essays, correspondence, and poetry. J. Personality Soc. Psych. 99(3):549–571.CrossrefGoogle Scholar
  • Jain L, Jamieson K (2018) Firing bandits: Optimizing crowdfunding. Proc. 35th Internat. Conf. Machine Learn. (PMLR), 2206–2214.Google Scholar
  • Jain L, Mason B, Nowak R (2017) Learning low-dimensional metrics. 31st Conf. Neural Inform. Processing Systems (Curran Associates, Red Hook, NY), 4139–4147.Google Scholar
  • Jamieson K, Jain L (2018) A bandit approach to multiple testing with false discovery control. 32nd Conf. Neural Inform. Processing Systems (Curran Associates, Red Hook, NY), 1–11.Google Scholar
  • Jamieson K, Jain L, Fernandez C, Glattard N, Nowak R (2015) NEXT: A system for real-world development, evaluation, and application of active learning. Adv. Neural Inform. Processing Systems 28:2656–2664.Google Scholar
  • Katariya S, Jain L, Sengupta N, Evans J, Nowak R (2018) Adaptive sampling for coarse ranking. Proc. 21st Internat. Conf. Artificial Intelligence Statist. (PMLR), 1–16.Google Scholar
  • Kilgour M, Koslow S, O’Connor H (2020) Why do great creative ideas get rejected? J. Advertising Res. 60(1):12–27.CrossrefGoogle Scholar
  • King G, Zeng L (2001) Logistic regression in rare events data. Political Anal. 9(2):137–163.CrossrefGoogle Scholar
  • Kornish LJ, Jones SM (2021) Raw ideas in the fuzzy front end: Verbosity increases perceived creativity. Marketing Sci. 40(6):1106–1122.AbstractGoogle Scholar
  • Kornish LJ, Ulrich KT (2011) Opportunity spaces in innovation: Empirical analysis of large samples of ideas. Management Sci. 57(1):107–128.LinkGoogle Scholar
  • Lamb C, Brown DG, Clarke C (2015) Human competence in creativity evaluation. Toivonen H, Colton S, Cook M, Ventura D, eds. Proc. Sixth Internat. Conf. Comput. Creativity (ICCC), 102–109.Google Scholar
  • Luo L, Toubia O (2015) Improving online idea generation platforms and customizing the task structure on the basis of consumers’ domain-specific knowledge. J. Marketing 79(5):100–114.CrossrefGoogle Scholar
  • Matz SC, Netzer O (2017) Big data as a window into consumers’ psychology. Current Opinion Behav. Sci. 18:7–12.CrossrefGoogle Scholar
  • Mervis CV, Rosch E (1981) Categorization of natural objects. Annual Rev. Psych. 32(1):89–115.CrossrefGoogle Scholar
  • Mobley MI, Doares LM, Mumford MD (1992) Process analytic models of creative capacities: Evidence for the combination and reorganization process. Creativity Res. J. 5(2):125–155.CrossrefGoogle Scholar
  • Netzer O, Feldman R, Goldenberg J, Fresko M (2012) Mine your own business: Market-structure surveillance through text mining. Marketing Sci. 31(3):521–543.LinkGoogle Scholar
  • Netzer O, Lemaire A, Herzenstein M (2019) When words sweat: Written words can predict loan default in the text of loan applications. J. Marketing 56(6):1–81.Google Scholar
  • O’Quin K, Besemer SP (1999) Creative products. Encyclopedia of Creativity, vol. 1 (Academic Press, Cambridge, MA), 413–422.Google Scholar
  • Rafieian O, Yoganarasimhan H (2021) Targeting and privacy in mobile advertising. Marketing Sci. 40(2):193–218.LinkGoogle Scholar
  • Rehurek R, Sojka P (2011) Gensim–Python Framework for Vector Space Modelling (NLP Centre, Faculty of Informatics, Masaryk University, Brno, Czech Republic), 3(2):1–2.Google Scholar
  • Ritchie G (2001) Assessing creativity. Wiggins GA, ed. Proc. AISB’01 Sympos. Artificial Intelligence Creativity Arts Sci., 3–11.Google Scholar
  • Rosch E, Simpson C, Miller RS (1976) Structural bases of typicality effects. J. Experiment. Psych. 2(4):491–502.Google Scholar
  • Runco MA (1995) Insight for creativity, expression for impact. Creativity Res. J. 8(4):377–390.CrossrefGoogle Scholar
  • Sievert S, Ross D, Jain L, Jamieson K, Nowak R, Mankoff R (2017) NEXT: A system to easily connect crowdsourcing adaptive data collection. Proc. 16th Python Sci. Conf. (SciPy), 113–119.Google Scholar
  • Simonton BK (1999) Creativity from a historiometric perspective. Sternberg, RJ, ed. Handbook of Creativity (Cambridge University Press, Cambridge, UK), 116–136.Google Scholar
  • Stephen A, Zubcsek PP, Goldenberg J (2016) Lower connectivity is better: The effects of network structure on redundancy of ideas and customer innovativeness in interdependent ideation tasks. J. Marketing Res. 53(2):263–279.CrossrefGoogle Scholar
  • Sukhov A (2018) The role of perceived comprehension in idea evaluation. Creativity Innovation Management 27(2):183–195.CrossrefGoogle Scholar
  • Sukhov A, Sihvonen A, Netz J, Magnusson P, Olsson L (2021) How experts screen ideas: The complex interplay of intuition, analysis, and sensemaking. J. Product Innovation Management 38(2):248–270.CrossrefGoogle Scholar
  • Terwiesch C, Ulrich KT (2009) Creating and Selecting Exceptional Opportunities (Harvard University Press, Cambridge, MA).Google Scholar
  • Tibshirani R (1996) Regression shrinkage and selection via the Lasso. J. Roy. Statist. Soc. B 58(1):267–288.CrossrefGoogle Scholar
  • Toubia O (2006) Idea generation, creativity, and incentives. Marketing Sci. 25(5):411–425.LinkGoogle Scholar
  • Toubia O, Flores L (2007) Adaptive idea screening using consumers. Marketing Sci. 26(3):342–360.LinkGoogle Scholar
  • Toubia O, Netzer O (2017) Idea generation, creativity, and prototypicality. Marketing Sci. 36(1):1–20.LinkGoogle Scholar
  • Urban GL, Katz GM (1983) Pre-test-market models: Validation and managerial implications. J. Marketing Res. 20(3):221–234.CrossrefGoogle Scholar
  • Wang M, Zhao Y, Zhang B (2015) Collective dynamics of ‘small-world’ networks. Sci. Rep. 5(1):1–12.Google Scholar
  • Watts DJ, Strogatz SH (1998) Collective dynamics of ‘small-world’ networks. Nature 393(6684):440–442.CrossrefGoogle Scholar
  • Wedel M, Kannan PK (2016) Marketing analytics for data-rich environments. J. Marketing 80(6):97–121.CrossrefGoogle Scholar
  • Wooten JO, Ulrich KT (2019) The impact of visibility in innovation tournaments: Evidence from field experiments. Working paper, Darla Moore School of Business, Columbia, SC.Google Scholar
  • Yao Y, Vehtari A, Simpson D, Gelman A (2018) Using stacking to average Bayesian predictive distributions (with discussion). Bayesian Anal. 13(3):917–1007.Google Scholar
INFORMS site uses cookies to store information on your computer. Some are essential to make our site work; Others help us improve the user experience. By using this site, you consent to the placement of these cookies. Please read our Privacy Statement to learn more.