Not Good Enough, but Try Again! The Impact of Improved Rejection Communications on Contributor Retention and Performance in Open Knowledge Collaboration

References

• Aaltonen A, Kallinikos J (2013) Coordination and learning in Wikipedia: Revisiting the dynamics of exploitation and exploration. Holmqvist M, Spicer A, eds. Managing ‘Human Resources’ by Exploiting and Exploring People’s Potentials, Research in the Sociology of Organizations, vol. 37 (Emerald Group Publishing Limited, Leeds, UK), 161–192.Google Scholar
• Aaltonen A, Lanzara GF (2015) Building governance capability in online social production: Insights from Wikipedia. Organ. Stud. 36(12):1649–1673.Crossref, Google Scholar
• Aaltonen A, Seiler S (2016) Cumulative growth in user-generated content production: Evidence from Wikipedia. Management Sci. 62(7):2054–2069.Link, Google Scholar
• Adler PS (2001) Market, hierarchy, and trust: The knowledge economy and the future of capitalism. Organ. Sci. 12(2):215–234.Link, Google Scholar
• Ahn J, Butler BS, Weng C, Webster S (2013) Learning to be a better Q’er in social Q&A sites: Social norms and information artifacts. Proc. Amer. Soc. Inform. Sci. Tech. 50(1):1–10.Crossref, Google Scholar
• Anderson A, Huttenlocher D, Kleinberg J, Leskovec J (2012) Discovering value from community activity on focused question answering sites: A case study of Stack Overflow. Proc. 18th ACM SIGKDD Internat. Conf. Knowledge Discovery Data Mining (Association for Computing Machinery, New York), 850–858.Google Scholar
• Anthony D, Smith SW, Williamson T (2009) Reputation and reliability in collective goods: The case of the online encyclopedia Wikipedia. Rationality Soc. 21(3):283–306.Crossref, Google Scholar
• Arazy O, Daxenberger J, Lifshitz-Assaf H, Oded N, Gurevych I (2016) Turbulent stability of emergent roles: The dualistic nature of self-organizing knowledge coproduction. Inform. Systems Res. 27(4):792–812.Link, Google Scholar
• Bapna S, Benson A, Funk RJ (2024) Rejection communication and women’s job-search persistence. Preprint, submitted February 4, https://dx.doi.org/10.2139/ssrn.3953695.Google Scholar
• Baron RM, Kenny DA (1986) The moderator-mediator variable distinction in social psychological research: Conceptual, strategic, and statistical considerations. J. Personality Soc. Psych. 51(6):1173–1182.Crossref, Google Scholar
• Bayus BL (2013) Crowdsourcing new product ideas over time: An analysis of the Dell IdeaStorm community. Management Sci. 59(1):226–244.Link, Google Scholar
• Beschastnikh I, Kriplean T, McDonald DW (2008) Wikipedian self-governance in action: Motivating the policy lens. Proc. Internat. AAAI Conf. Web Soc. Media 2(1):27–35.Crossref, Google Scholar
• Boudreau K (2010) Open platform strategies and innovation: Granting access vs. devolving control. Management Sci. 56(10):1849–1872.Link, Google Scholar
• Bregolin J (2022) Communication effort and the cost of language: Evidence from Stack Overflow. Technical Report 202213, Department of Economics, University of Liverpool, Liverpool, UK. https://ideas.repec.org/p/liv/livedp/202213.html.Google Scholar
• Burtch G, Ghose A, Wattal S (2015) The hidden cost of accommodating crowdfunder privacy preferences: A randomized field experiment. Management Sci. 61(5):949–962.Link, Google Scholar
• Calonico S, Cattaneo MD, Titiunik R (2014) Robust nonparametric confidence intervals for regression-discontinuity designs. Econometrica 82(6):2295–2326.Crossref, Google Scholar
• Calonico S, Cattaneo MD, Titiunik R (2015) rdrobust: An R package for robust nonparametric inference in regression-discontinuity designs. R J. 7(1):38–51.Crossref, Google Scholar
• Calonico S, Cattaneo MD, Farrell MH, Titiunik R (2019) Regression discontinuity designs using covariates. Rev. Econom. Statist. 101(3):442–451.Crossref, Google Scholar
• Cappelleri JC, Trochim WM (2015) Regression discontinuity design. Wright JD, ed. International Encyclopedia of the Social & Behavioral Sciences, vol. 20, 2nd ed. (Elsevier Science, Oxford, UK), 152–159.Crossref, Google Scholar
• Cardinal LB, Sitkin SB, Long CP (2004) Balancing and rebalancing in the creation and evolution of organizational control. Organ. Sci. 15(4):411–431.Link, Google Scholar
• Cattaneo MD, Idrobo N, Titiunik R (2019) A Practical Introduction to Regression Discontinuity Designs: Foundations, Elements in Quantitative and Computational Methods for the Social Sciences (Cambridge University Press, Cambridge, UK).Crossref, Google Scholar
• Cattaneo MD, Jansson M, Ma X (2020) Simple local polynomial density estimators. J. Amer. Statist. Assoc. 115(531):1449–1455.Crossref, Google Scholar
• Cavusoglu H, Phan TQ, Cavusoglu H, Airoldi EM (2016) Assessing the impact of granular privacy controls on content sharing and disclosure on Facebook. Inform. Systems Res. 27(4):848–879.Link, Google Scholar
• Cook TD, Wong VC (2008) Empirical tests of the validity of the regression discontinuity design. Ann. Économ. Statist. 91/92 (July–December):127–150.Google Scholar
• Cortini M, Galanti T, Barattucci M (2019) The effect of different rejection letters on applicants’ reactions. Behavioral Sci. 9(10):102.Crossref, Google Scholar
• Dejean S, Jullien N (2015) Big from the beginning: Assessing online contributors’ behavior by their first contribution. Res. Policy 44(6):1226–1239.Crossref, Google Scholar
• de la Cuesta B, Imai K (2016) Misunderstandings about the regression discontinuity design in the study of close elections. Annu. Rev. Polit. Sci. 19:375–396.Crossref, Google Scholar
• Dlugos K, Keller J (2021) Turned down and taking off? Rejection and turnover in internal talent markets. Acad. Management J. 64(1):63–85.Crossref, Google Scholar
• Fang Y, Neufeld D (2009) Understanding sustained participation in open source software projects. J. Management Inform. Systems 25(4):9–50.Crossref, Google Scholar
• Faraj S, Jarvenpaa SL, Majchrzak A (2011) Knowledge collaboration in online communities. Organ. Sci. 22(5):1224–1239.Link, Google Scholar
• Forte A, Larco V, Bruckman A (2009) Decentralization in Wikipedia governance. J. Management Inform. Systems 26(1):49–72.Crossref, Google Scholar
• Gelman A, Imbens G (2019) Why high-order polynomials should not be used in regression discontinuity designs. J. Bus. Econom. Statist. 37(3):447–456.Crossref, Google Scholar
• Giles J (2005) Internet encyclopaedias go head to head. Nature 438(7070):900–901.Crossref, Google Scholar
• Gilliland SW (1993) The perceived fairness of selection systems: An organizational justice perspective. Acad. Management Rev. 18(4):694–734.Crossref, Google Scholar
• Gilliland SW (1994) Effects of procedural and distributive justice on reactions to a selection system. J. Appl. Psych. 79(5):691–701.Crossref, Google Scholar
• Gilliland SW, Groth M, Baker RCI, Dew AF, Polly LM, Langdon JC (2001) Improving applicants’ reactions to rejection letters: An application of fairness theory. Personnel Psych. 54(3):669–703.Crossref, Google Scholar
• Greenstein S, Zhu F (2016) Open content, Linus’ law, and neutral point of view. Inform. Systems Res. 27(3):618–635.Link, Google Scholar
• Greenwood BN, Wattal S (2017) Show me the way to go home: An empirical investigation of ride-sharing and alcohol related motor vehicle fatalities. MIS Quart. 41(1):163–187.Crossref, Google Scholar
• Hahn J, Todd P, Van der Klaauw W (2001) Identification and estimation of treatment effects with a regression-discontinuity design. Econometrica 69(1):201–209.Crossref, Google Scholar
• Halavais A, Lackaff D (2008) An analysis of topical coverage of Wikipedia. J. Comput-Mediated Commun. 13(2):429–440.Crossref, Google Scholar
• Halfaker A, Kittur A, Riedl J (2011) Don’t bite the newbies: How reverts affect the quantity and quality of Wikipedia work. Proc. 7th Internat. Sympos. Wikis Open Collaboration (Association for Computing Machinery, New York), 163–172.Google Scholar
• Halfaker A, Geiger RS, Morgan JT, Riedl J (2013) The rise and decline of an open collaboration system: How Wikipedia’s reaction to popularity is causing its decline. Amer. Behavioral Scientist 57(5):664–688.Crossref, Google Scholar
• Hartmann J, Heitmann M, Siebert C, Schamp C (2023) More than a feeling: Accuracy and application of sentiment analysis. Internat. J. Res. Marketing 40(1):75–87.Crossref, Google Scholar
• Hausman C, Rapson DS (2018) Regression discontinuity in time: Considerations for empirical applications. Annu. Rev. Resource Econom. 10:533–552.Crossref, Google Scholar
• Hayes AF (2018) Introduction to Mediation, Moderation and Conditional Process Analysis: A Regression-Based Approach, 2nd ed. (The Guilford Press, New York).Google Scholar
• Hayes AF, Montoya AK, Rockwood NJ (2017) The analysis of mechanisms and their contingencies: PROCESS versus structural equation modeling. Australasian Marketing J. 25(1):76–81.Crossref, Google Scholar
• Hill BM, Shaw A (2021) The hidden costs of requiring accounts: Quasi-experimental evidence from peer production. Commun. Res. 48(6):771–795.Crossref, Google Scholar
• Imai K, Keele L, Tingley D (2010) A general approach to causal mediation analysis. Psych. Methods 15(4):309–334.Crossref, Google Scholar
• Imai K, Tingley D, Yamamoto T (2013) Experimental designs for identifying causal mechanisms. J. Royal Statist. Soc. Ser. A 176(Part 1):5–51.Crossref, Google Scholar
• Imbens G, Kalyanaraman K (2012) Optimal bandwidth choice for the regression discontinuity estimator. Rev. Econom. Stud. 79(3):933–959.Crossref, Google Scholar
• Imbens GW, Lemieux T (2008) Regression discontinuity designs: A guide to practice. J. Econometrics 142(2):615–635.Crossref, Google Scholar
• Jhaver S, Bruckman A, Gilbert E (2019) Does transparency in moderation really matter? User behavior after content removal explanations on Reddit. Proc. ACM Human-Comput. Interaction 3(CSCW):150.Crossref, Google Scholar
• Kane GC, Ransbotham S (2016) Content and collaboration: An affiliation network approach to information quality in online peer production communities. Inform. Systems Res. 27(2):424–439.Link, Google Scholar
• Konradt U, Garbers Y, Böge M, Erdogan B, Bauer TN (2017) Antecedents and consequences of fairness perceptions in personnel selection: A 3-year longitudinal study. Group Organ. Management 42(1):113–146.Crossref, Google Scholar
• Lee DS, Lemieux T (2010) Regression discontinuity designs in economics. J. Econom. Lit. 48(2):281–355.Crossref, Google Scholar
• Lee HK, Kee JS, Keil M (2018) Using perspective-taking to de-escalate launch date commitment for products with known software defects. J. Management Inform. Systems 35(4):1251–1276.Crossref, Google Scholar
• Levine SS, Prietula MJ (2014) Open collaboration for innovation: Principles and performance. Organ. Sci. 25(5):1414–1433.Link, Google Scholar
• Liu J, Ram S (2011) Who does what: Collaboration patterns in the Wikipedia and their impact on article quality. ACM Trans. Management Inform. Systems 2(2):11–22.Crossref, Google Scholar
• McCrary J (2008) Manipulation of the running variable in the regression discontinuity design. J. Econometrics 142(2):698–714.Crossref, Google Scholar
• Mindel V, Aaltonen A, Rai A, Mathiassen L, Jabr W (2025) Timely quality problem resolution in peer-production systems: The impact of bots, policy citations, and contributor experience. Inform. Systems Res. 36(2):1242–1258.Link, Google Scholar
• Morgan JT, Zachry M (2010) Negotiating with angry mastodons: The Wikipedia policy environment as genre ecology. Proc. 2010 ACM Internat. Conf. Supporting Group Work (Association for Computing Machinery, New York), 165–168.Google Scholar
• Musicant DR, Ren Y, Johnson JA, Riedl J (2011) Mentoring in Wikipedia: A clash of cultures. Proc. 7th Internat. Sympos. Wikis Open Collaboration (Association for Computing Machinery, New York), 173–182.Google Scholar
• Nagaraj A (2021) Information seeding and knowledge production in online communities: Evidence from OpenStreetMap. Management Sci. 67(8):4908–4934.Link, Google Scholar
• Nagaraj A, Piezunka H (2024) The divergent effect of competition on platforms: Deterring recruits, motivating converts. Strategy Sci. 9(3):277–296.Link, Google Scholar
• Nguyen TQ, Schmid I, Stuart EA (2021) Clarifying causal mediation analysis for the applied researcher: Defining effects based on what we want to learn. Psych. Methods 26(2):255–271.Crossref, Google Scholar
• Nov O (2007) What motivates Wikipedians? Commun. ACM 50(11):60–64.Crossref, Google Scholar
• Ouchi WG (1977) The relationship between organizational structure and organizational control. Admin. Sci. Quart. 22(1):95–113.Crossref, Google Scholar
• Ouchi WG (1979) A conceptual framework for the design of organizational control mechanisms. Management Sci. 25(9):833–848.Link, Google Scholar
• Panciera K, Halfaker A, Terveen L (2009) Wikipedians are born, not made: A study of power editors on Wikipedia. Proc. ACM 2009 Internat. Conf. Supporting Group Work (Association for Computing Machinery, New York), 51–60.Google Scholar
• Pavlou PA, Liang H, Xue Y (2007) Understanding and mitigating uncertainty in online exchange relationships: A principal-agent perspective. MIS Quart. 31(1):105–136.Crossref, Google Scholar
• Piezunka H, Dahlander L (2019) Idea rejected, tie formed: Organizations’ feedback on crowdsourced ideas. Acad. Management J. 62(2):503–530.Crossref, Google Scholar
• Queiroz M, Tallon PP, Coltman T, Sharma R (2023) Conditional paths to business unit agility: Corporate IT platforms and the moderating role of business unit IT autonomy. Eur. J. Inform. Systems 32(4):675–694.Crossref, Google Scholar
• Ransbotham S, Kane GC (2011) Membership turnover and collaboration success in online communities: Explaining rises and falls from grace in Wikipedia. MIS Quart. 35(3):613–627.Crossref, Google Scholar
• Ren Y, Kraut R, Kiesler S, Resnick P (2018) Regulating behavior in online communities. Technical report, Carnegie Mellon University, Pittsburgh, PA.Google Scholar
• Ryan AM, Ployhart RE (2000) Applicants’ perceptions of selection procedures and decisions: A critical review and agenda for the future. J. Management 26(3):565–606.Google Scholar
• Sah RK, Stiglitz JE (1986) The architecture of economic systems: Hierarchies and polyarchies. Amer. Econom. Rev. 76(4):716–727.Google Scholar
• Sen S, Lerman D (2007) Why are you telling me this? An examination into negative consumer reviews on the web. J. Interactive Marketing 21(4):76–94.Crossref, Google Scholar
• Shah SK (2006) Motivation, governance, and the viability of hybrid forms in open source software development. Management Sci. 52(7):1000–1014.Link, Google Scholar
• Srinivasan KB, Danescu-Niculescu-Mizil C, Lee L, Tan C (2019) Content removal as a moderation strategy: Compliance and other outcomes in the ChangeMyView community. Proc. ACM Human-Comput. Interaction 3(CSCW):163.Crossref, Google Scholar
• Stvilia B, Twidale MB, Smith LC, Gasser L (2008) Information quality work organization in Wikipedia. J. Amer. Soc. Inform. Sci. Tech. 59(6):983–1001.Crossref, Google Scholar
• Tams S (2022) Helping older workers realize their full organizational potential: A moderated mediation model of age and IT-enabled task performance. MIS Quart. 46(1):1–34.Crossref, Google Scholar
• Tiwana A (2015) Evolutionary competition in platform ecosystems. Inform. Systems Res. 26(2):266–281.Link, Google Scholar
• Warncke-Wang M, Ayukaev VR, Hecht B, Terveen LG (2015) The success and failure of quality improvement projects in peer production communities. Proc. 18th ACM Conf. Comput. Supported Cooperative Work Social Comput. (Association for Computing Machinery, New York), 743–756.Google Scholar
• White TB, Lemon KN, Hogan JE (2007) Customer retention when the customer’s future usage is uncertain. Psych. Marketing 24(10):849–870.Crossref, Google Scholar
• Zhang X, Zhu F (2011) Group size and incentives to contribute: A natural experiment at Chinese Wikipedia. Amer. Econom. Rev. 101(4):1601–1615.Crossref, Google Scholar
• Zhao X, Lynch JG Jr, Chen Q (2010) Reconsidering Baron and Kenny: Myths and truths about mediation analysis. J. Consumer Res. 37(2):197–206.Crossref, Google Scholar