Measuring the Impact of Crowdsourcing Features on Mobile App User Engagement and Retention: A Randomized Field Experiment

Published Online:https://doi.org/10.1287/mnsc.2020.3943

References

  • Afeche P, Araghi M, Baron O (2017) Customer acquisition, retention, and service access quality: Optimal advertising, capacity level, and capacity allocation. Manufacturing Service Oper. Management 19(4):674–691.LinkGoogle Scholar
  • Ahuja V, Medury Y (2010) Corporate blogs as e-CRM tools: Building consumer engagement through content management. J. Database Marketing Customer Strategy Management 17(2):91–105.CrossrefGoogle Scholar
  • Algesheimer R, Dholakia UM, Herrmann A (2005) The social influence of brand community: Evidence from European car clubs. J. Marketing 69(3):19–34.Google Scholar
  • Allen BJ, Chandrasekaran, D, Basuroy S (2018) Design crowdsourcing: The impact on new product performance of sourcing sesign solutions from the “crowd.” J. Marketing 82(2):106–123.Google Scholar
  • Ascarza E, Hardie BG (2013) A joint model of usage and churn in contractual settings. Marketing Sci. 32(4):570–590.LinkGoogle Scholar
  • Ascarza E, Iyengar R, Schleicher M (2016) The perils of proactive churn prevention using plan recommendations: Evidence from a field experiment. J. Marketing Res. 53(1):46–60.CrossrefGoogle Scholar
  • Ascarza E, Netzer O, Hardie BG (2018) Some customers would rather leave without saying goodbye. Marketing Sci. 37(1):54–77.LinkGoogle Scholar
  • Assael H (2005) A demographic and psychographic profile of heavy Internet users and users by type of Internet usage. J. Advertising Res. 45(1):93–123.CrossrefGoogle Scholar
  • Baron RM, Kenny DA (1986) The moderator–mediator variable distinction in social psychological research: Conceptual, strategic, and statistical considerations. J. Personality Soc. Psych. 51(6):1173.CrossrefGoogle Scholar
  • Bayus BL (2013) Crowdsourcing new product ideas over time: An analysis of the Dell IdeaStorm community. Management Sci. 59(1):226–244.LinkGoogle Scholar
  • Benartzi S, Thaler RH (2002) How much is investor autonomy worth? J. Finance 57(4):1593–1616.CrossrefGoogle Scholar
  • Berné C, Múgica JM, Yagüe MJ (2001) The effect of variety-seeking on customer retention in services. J. Retailing Consumer Services 8(6):335–345.CrossrefGoogle Scholar
  • Bista S, Nepal S, Colineau N, Paris C (2012) Using gamification in an online community. Carminati B, IEEE Electrical Insulation Society Staff, eds. Proc. 8th Internat. Conf. Collaborative Comput.: Networking, Appl. Worksharing (EAI/IEEE, Pittsburgh, PA), 611–618.Google Scholar
  • Bolton RN (1998) A dynamic model of the duration of the customer’s relationship with a continuous service provider: The role of satisfaction. Marketing Sci. 17(1):45–65.LinkGoogle Scholar
  • Bonchek M, Choudary SP (2013) Three elements of a successful platform strategy. Harvard Bus. Rev. 92:1–2.Google Scholar
  • Boudreau KJ, Lacetera N, Lakhani KR (2011) Incentives and problem uncertainty in innovation contests: An empirical analysis. Management Sci. 57(5):843–863.LinkGoogle Scholar
  • Bowden JL-H (2009) The process of customer engagement: A conceptual framework. J. Marketing Theory Practice 17(1):63–74.CrossrefGoogle Scholar
  • Brodie RJ, Hollebeek LD, Juric B, Ilic A (2011) Customer engagement: Conceptual domain, fundamental propositions, and implications for research. J. Service Res. 14(3):252–271.CrossrefGoogle Scholar
  • Broniarczyk SM, Griffin JG (2014) Decision difficulty in the age of consumer empowerment. J. Consumer Psych. 24(4):608–625.CrossrefGoogle Scholar
  • Burtch G, Hong Y, Bapna R, Griskevicius V (2018) Stimulating online reviews by combining financial incentives and social norms. Management Sci. 64(5):2065–2082.LinkGoogle Scholar
  • Cafazzo J, Casselman M, Hamming N, Katzman DK, Palmert MR (2012) Design of an mHealth app for the self-management of adolescent type 1 diabetes: A pilot study. J. Medical Internet Res. 14(3):e70.CrossrefGoogle Scholar
  • Calder BJ, Isaac MS, Malthouse EC (2016) How to capture consumer experiences: A context-specific approach to measuring engagement. J. Advertising Res. 56(1):39–52.CrossrefGoogle Scholar
  • Chapman PM (1997) Models of engagement: Intrinsically motivated interaction with multimedia learning software. Doctoral dissertation, University of Waterloo, Waterloo, BC.Google Scholar
  • Chen PY, Hitt LM (2002) Measuring switching costs and the determinants of customer retention in Internet-enabled businesses: A study of the online brokerage industry. Inform. Systems Res. 13(3):255–274.LinkGoogle Scholar
  • Chevalier JA, Mayzlin D (2006) The effect of word of mouth on sales: Online book reviews. J. Marketing Res. 43(3):345–354.CrossrefGoogle Scholar
  • Cleves M, Gould WW, Gutierrez RG, Marchenko Y (2008) An Introduction to Survival Analysis Using Stata, 2nd ed. (Stata Press, College Station, TX).Google Scholar
  • Cohen J (1988) Statistical Power Analysis for the Behavioral Sciences, 2nd ed. (Routledge, New York).Google Scholar
  • Dillon A, Watson C (1996) User analysis in HCI—The historical lessons from individual differences research. Internat. J. Human Comput. Stud. 45(6):619–637.CrossrefGoogle Scholar
  • Doan A, Ramakrishnan R, Halevy AY (2011) Crowdsourcing systems on the world-wide web. Comm. ACM 54(4):86–96.CrossrefGoogle Scholar
  • Duan W, Gu B, Whinston AB (2008) Do online reviews matter?—An empirical investigation of panel data. Decision Support Systems 45(4):1007–1016.CrossrefGoogle Scholar
  • Evans D, Cothrel J (2014) Social Customer Experience: Engage and Retain Customers Through Social Media (John Wiley & Sons, Sybex, NJ).Google Scholar
  • Feyisetan O, Simperl E, van Kleek M, Shadbolt N (2015) Improving paid microtasks through gamification and adaptive furtherance incentives. Gangemi A, Leonardi S, Panconesi A, eds. Proc. 24th Internat. Conf. World Wide Web (Association for Computing Machinery, New York), 333–343.Google Scholar
  • Franke N, Schreier M (2010) Why customers value self-designed products: The importance of process effort and enjoyment. J. Product Innovation Management 27(7):1020–1031.CrossrefGoogle Scholar
  • Fuchs C, Schreier M (2011) Customer empowerment in new product development. J. Product Innovation Management 28(1):17–32.CrossrefGoogle Scholar
  • Füller J, Mühlbacher H, Matzler K, Jawecki G (2009) Consumer empowerment through Internet-based co-creation. J. Management Inform. Systems 26(3):71–102.CrossrefGoogle Scholar
  • Ghose A, Han SP (2014) Estimating demand for mobile applications in the new economy. Management Sci. 60(6):1470–1488.LinkGoogle Scholar
  • Ghose A, Ipeirotis PG (2010) Estimating the helpfulness and economic impact of product reviews: Mining text and reviewer characteristics. IEEE Trans. Knowledge Data Engrg. 23(10):1498–1512.CrossrefGoogle Scholar
  • Gilbert DT, Wilson TD (2000) Miswanting: Some problems in the forecasting of future affective states. Forgas JP, ed. Feeling and Thinking: The Role of Affect in Social Cognition (Cambridge University Press, Cambridge, UK), 178–197.Google Scholar
  • Goh KY, Heng CS, Lin Z (2013) Social media brand community and consumer behavior: Quantifying the relative impact of user- and marketer-generated content. Inform. Systems Res. 24(1):88–107.LinkGoogle Scholar
  • Gruen TW, Summers JO, Acito F (2000) Relationship marketing activities, commitment, and membership behaviors in professional associations. J. Marketing 64(3):34–49.Google Scholar
  • Gupta S, Hanssens D, Hardie B, Kahn W, Kumar V, Lin N, Ravishanker R, Sriram S (2006) Modeling customer lifetime value. J. Service Res. 9(2):139–155.CrossrefGoogle Scholar
  • Hackman JR, Oldham GR (1976) Motivation through the design of work: Test of a theory. Organ. Behav. Human Performance 16(2):250–279.CrossrefGoogle Scholar
  • Hoffman DL, Novak TP, Schlosser A (2000) Consumer control in online environments. Working paper, eLab, Owen School of Management, Vanderbilt University, Nashville, TN.Google Scholar
  • Howe J (2006) The rise of crowdsourcing. Wired Magazine (January 6), https://www.wired.com/2006/06/crowds/.Google Scholar
  • Huang Y, Singh P, Mukhopadhyay T (2012). Crowdsourcing contests: A dynamic structural model of the impact of incentive structure on solution quality. Proc. ICIS 2012 (Association for Information Systems, Orlando, FL).Google Scholar
  • Huang Y, Vir Singh P, Srinivasan K (2014) Crowdsourcing new product ideas under consumer learning. Management Sci. 60(9):2138–2159.LinkGoogle Scholar
  • Iyengar R, Jedidi K, Essegaier S, Danaher P (2011) The impact of tariff structure on customer retention, usage, and profitability of access services. Marketing Sci. 30(5):820–836.LinkGoogle Scholar
  • Iyer G, Katona Z (2015) Competing for attention in social communication markets. Management Sci. 62(8):2304–2320.LinkGoogle Scholar
  • Jeppesen LB, Lakhani KR (2010) Marginality and problem-solving effectiveness in broadcast search. Organ. Sci. 21(5):1016–1033.LinkGoogle Scholar
  • Jung J, Sun T, Bapna R, Golden J (2021) Social learning in prosumption: Evidence from a randomized field experiment. Available at SSRN 3796254.Google Scholar
  • Kappelman LA (1995) Measuring user involvement: A diffusion of innovation perspective. ACM SIGMIS Database: ADBIS 26(2-3):65–86.CrossrefGoogle Scholar
  • Kazai G, Kamps J, Koolen M, Milic-Frayling N (2011) Crowdsourcing for book search evaluation: Impact of hit design on comparative system ranking. Proc. 34th Internat. ACM SIGIR Conf. Res. Development Inform. Retrieval (Association for Computing Machinery, Beijing), 205–214.Google Scholar
  • Kim YH, Kim DJ, Wachter K (2013) A study of mobile user engagement (MoEN): Engagement motivations, perceived value, satisfaction, and continued engagement intention. Decision Support Systems 56:361–370.CrossrefGoogle Scholar
  • Kittur A, Kraut RE (2008) Harnessing the wisdom of crowds in Wikipedia: Quality through coordination. Proc. 2008 ACM Conf. Comput. Supported Cooperative Work (Association for Computing Machinery, San Diego, CA), 37–46.Google Scholar
  • Klein L, Ford G (2003) Consumer search for information in the digital age: An empirical study of prepurchase search for automobiles. J. Internat. Marketing 17(3):29–49.Google Scholar
  • Klem AM, Connell JP (2004) Relationships matter: Linking teacher support to student engagement and achievement. J. School Health 74(7):262–273.CrossrefGoogle Scholar
  • Lee D, Hosanagar K, Nair HS (2018) Advertising content and consumer engagement on social mMedia: Evidence from Facebook. Management Sci. 64(11):5105–5131.LinkGoogle Scholar
  • Levine SS, Prietula MJ (2013) Open collaboration for innovation: Principles and performance. Organ. Sci. 25(5):1414–1433.LinkGoogle Scholar
  • Lewis M (2004) The influence of loyalty programs and short-term promotions on customer retention. J. Marketing Res. 41(3):281–292.CrossrefGoogle Scholar
  • Liu CZ, Au YA, Choi HS (2012) An empirical study of the freemium strategy for mobile apps: Evidence from the Google Play market. Proc. ICIS 2012 (Association for Information Systems, Orlando, FL).Google Scholar
  • Malone TW, Laubacher R, Dellarocas C (2010) The collective intelligence genome. MIT Sloan Management Rev. 51(3):20–31.Google Scholar
  • McAlexander JH, Schouten JW, Koenig HF (2002) Building brand community. J. Marketing 66(1):38–54.Google Scholar
  • McAlister L (1982) A dynamic attribute satiation model of variety-seeking behavior. J. Consumer Res. 9(2):141–150.CrossrefGoogle Scholar
  • McAlister L, Pessemier E (1982) Variety seeking behavior: An interdisciplinary review. J. Consumer Res. 9(3):311–322.CrossrefGoogle Scholar
  • Moe WW, Trusov M (2011) The value of social dynamics in online product rating forums. J. Marketing Res. 48(3):444–456.CrossrefGoogle Scholar
  • Mollen A, Wilson H (2010) Engagement, telepresence and interactivity in online consumer experience: Reconciling scholastic and managerial perspectives. J. Bus. Res. 63(9):919–925.CrossrefGoogle Scholar
  • Nishikawa H, Schreier M, Ogawa S (2013) User-generated vs. designer-generated products: A performance assessment at Muji. Internat. J. Res. Marketing 30(2):160–167.CrossrefGoogle Scholar
  • Norton MI, Mochon D, Ariely D (2012) The IKEA effect: When labor leads to love. J. Consumer Psych. 22(3):453–460.CrossrefGoogle Scholar
  • O’Brien HL, Toms EG (2008) What is user engagement? A conceptual framework for defining user engagement with technology. J. Amer. Soc. Inform. Sci. Tech. 59(6):938–955.CrossrefGoogle Scholar
  • O’Brien HL, Toms EG (2010) The development and evaluation of a survey to measure user engagement. J. Amer. Soc. Inform. Sci. Tech. 61(1):50–69.CrossrefGoogle Scholar
  • Oestreicher-Singer G, Zalmanson L (2013) Content or community? A digital business strategy for content providers in the social age. MIS Quart. 37(2):591–616.CrossrefGoogle Scholar
  • Pan Y, Blevis E (2011) A survey of crowdsourcing as a means of collaboration and the implications of crowdsourcing for interaction design. Internat. Conf. Collaboration Technologies Systems (IEEE, Philadelphia), 397–403.Google Scholar
  • Pierce JL, Kostova T, Dirks KT (2003) The state of psychological ownership: Integrating and extending a century of research. Rev. General Psych. 7(1):84.CrossrefGoogle Scholar
  • Pires GD, Stanton J, Rita P (2006) The Internet, consumer empowerment and marketing strategies. Eur. J. Marketing 40(9/10):936–949.Google Scholar
  • Poetz MK, Schreier M (2012) The value of crowdsourcing: Can users really compete with professionals in generating new product ideas? J. Product Innovation Management 29(2):245–256.CrossrefGoogle Scholar
  • Ransbotham S, Kane GC (2011) Membership turnover and collaboration success in online communities: Explaining rises and falls from grace in Wikipedia. MIS Quart. 35(3):613.CrossrefGoogle Scholar
  • Ransbotham S, Kane GC, Lurie NH (2012) Network characteristics and the value of collaborative user-generated content. Marketing Sci. 31(3):387–405.LinkGoogle Scholar
  • Ren Y, Chen J, Riedl J (2015) The impact and evolution of group diversity in online open collaboration. Management Sci. 62(6):1668–1686.LinkGoogle Scholar
  • Said NS (2004) An engaging multimedia design model. Proc. 2004 Conf. Interaction Design Children (Association for Computing Machinery, New York), 169–172. Available at: https://dl.acm.org/doi/abs/10.1145/1017833.1017873.Google Scholar
  • Thomas JS (2001) A methodology for linking customer acquisition to customer retention. J. Marketing Res. 38(2):262–268.CrossrefGoogle Scholar
  • Tirunillai S, Tellis GJ (2012) Does chatter really matter? Dynamics of user-generated content and stock performance. Marketing Sci. 31(2):198–215.LinkGoogle Scholar
  • Väätäjä H, Vainio T, Sirkkunen E, Salo K (2011) Crowdsourced news reporting: supporting news content creation with mobile phones. Proc. 13th Internat. Conf. Human Comput. Interaction Mobile Devices Services (Association for Computing Machinery, New York), 435–444. Available at: https://dl.acm.org/doi/abs/10.1145/2037373.2037438?casa_token=Utsf1wL3DWwAAAAA:kRqVbwObptc1rPHqpGGU-s_RKkh-yWCkbRXXA2Gba8F5z1XwAr4w2ziSt8RqpKeGCw82HEMfSKVvUg.Google Scholar
  • Van Doorn J, Lemon KN, Mittal V, Nass S, Pick D, Pirner P, Verhoef PC (2010) Customer engagement behavior: Theoretical foundations and research directions. J. Service Res. 13(3):253–266.CrossrefGoogle Scholar
  • Van Trijp HC, Hoyer WD, Inman JJ (1996) Why switch? Product category: Level explanations for true variety-seeking behavior. J. Marketing Res. 33(3):281–292.CrossrefGoogle Scholar
  • Verhoef PC, Reinartz WJ, Krafft M (2010) Customer engagement as a new perspective in customer management. J. Service Res. 13(3):247–252.CrossrefGoogle Scholar
  • Vivek SD, Beatty SE, Dalela V, Morgan RM (2014) A generalized multidimensional scale for measuring customer engagement. J. Marketing Theory Practice 22(4):401–420.CrossrefGoogle Scholar
  • Wathieu L, Brenner L, Carmon Z, Chattopadhyay A, Wertenbroch K, Drolet A, Gourville J, et al. (2002) Consumer control and empowerment: A primer. Marketing Lett. 13(3):297–305.CrossrefGoogle Scholar
  • Webster J, Ahuja JS (2006) Enhancing the design of web navigation systems: The influence of user disorientation on engagement and performance. Management Inform. Systems Quart. 30(3):661–678.CrossrefGoogle Scholar
  • Wooten JO, Ulrich KT (2015) The impact of visibility in innovation tournaments: Evidence from field experiments. Department of Management Science, University of South Carolina. Available at SSRN 2214952.Google Scholar
  • Wooten JO, Ulrich KT (2017) Idea generation and the role of feedback: Evidence from field experiments with innovation tournaments. Production Oper. Management 26(1):80–99.CrossrefGoogle Scholar
  • Wright LT, Newman A, Dennis C (2006) Enhancing consumer empowerment. Eur. J. Marketing 40(9/10):925–935.Google Scholar
  • Yang Y, Duan Y, Wang X, Huang Z, Xie N, Shen HT (2018) Hierarchical multi-clue modelling for POI populatiry prediction with heterogeneous torist infomraiton. IEEE Trans. Knowledge Data Engrg. 31(4):757–768.CrossrefGoogle Scholar
  • Zhang Y, Li B, Luo X, Wang X (2019) Personalized mobile targeting with user engagement stages: Combining a structural hidden markov model and field experiment. Inform. Systems Res. 30(3):787–804.LinkGoogle Scholar
  • Zheng Y, Zhao K, Stylianou A (2013) The impacts of information quality and system quality on users’ continuance intention in information-exchange virtual communities: An empirical investigation. Decision Support Systems 56:513–524.CrossrefGoogle Scholar
  • Zhu F, Zhang X (2010) Impact of online consumer reviews on sales: The moderating role of product and consumer characteristics. J. Marketing 74(2):133–148.Google Scholar
  • Zimmerman J, Tomasic A, Garrod C, Yoo D, Hiruncharoenvate C, Aziz R, Thiruvengadam NR, et al.. (2011) Konstan JA, Chi Ed, Höök K, eds. Field trial of Tiramisu: Crowd-sourcing bus arrival times to spur co-design. Proc. 2011 Annual. Conf. Human Factors Comput. Systems (Association for Computing Machinery, New York), 1677–1686.Google Scholar
INFORMS site uses cookies to store information on your computer. Some are essential to make our site work; Others help us improve the user experience. By using this site, you consent to the placement of these cookies. Please read our Privacy Statement to learn more.