Examining the Impact of Generative AI on Users’ Voluntary Knowledge Contribution: Evidence from A Natural Experiment on Stack Overflow

Published Online:https://doi.org/10.1287/isre.2023.0332

References

  • Abdullah U (2023) How accurate is ChatGPT in generating responses? PC guide (March 7), https://www.pcguide.com/apps/how-accurate-is-chat-gpt/.Google Scholar
  • Adamopoulos P, Ghose A, Todri V (2018) The impact of user personality traits on word of mouth: Text-mining social media platforms. Inform. Systems Res. 29(3):612–640.LinkGoogle Scholar
  • Adams GS, Converse BA, Hales AH, Klotz LE (2021) People systematically overlook subtractive changes. Nature 592(7853):258–261.CrossrefGoogle Scholar
  • Alcántara A (2023) Is it human or AI? New tools help you spot the bots. Wall Street Journal (January 10), https://www.wsj.com/articles/is-it-human-or-ai-new-tools-help-you-spot-the-bots-11673356404.Google Scholar
  • Alyakoob M, Rahman MS (2022) Shared prosperity (or lack thereof) in the sharing economy. Inform. Systems Res. 33(2):638–658.LinkGoogle Scholar
  • Aral S, Muchnik L, Sundararajan A (2009) Distinguishing influence-based contagion from homophily-driven diffusion in dynamic networks. Proc. Natl. Acad. Sci USA 106(51):21544–21549.CrossrefGoogle Scholar
  • Athey S, Imbens GW (2022) Design-based analysis in difference-in-differences settings with staggered adoption. J. Econom. 226(1):62–79.CrossrefGoogle Scholar
  • Baidoo-Anu D, Owusu Ansah L (2023) Education in the era of generative artificial intelligence (AI): Understanding the potential benefits of ChatGPT in promoting teaching and learning. Preprint, submitted April 8, http://dx.doi.org/10.2139/ssrn.4337484.Google Scholar
  • Baker M, Reimann P (2024) Editorial notes: Revitalising foundational concepts. Int. J. Comput. Support. Collab. Learn. 19(4):395–400.CrossrefGoogle Scholar
  • Baker AC, Larcker DF, Wang CC (2022) How much should we trust staggered difference-in-differences estimates? J. Financial Econom. 144(2):370–395.CrossrefGoogle Scholar
  • Bandura A, Walters RH (1977) Social Learning Theory, vol. 1 (Prentice Hall, Englewood Cliffs, NJ).Google Scholar
  • Barki H, Titah R, Boffo C (2007) Information system use–Related activity: An expanded behavioral conceptualization of individual-level information system use. Inform. Systems Res. 18(2):173–192.LinkGoogle Scholar
  • Bauer K, von Zahn M, Hinz O (2023) Expl (AI) ned: The impact of explainable artificial intelligence on users’ information processing. Inform. Systems Res. 34(4):1582–1602.LinkGoogle Scholar
  • Blackwell M, Iacus S, King G, Porro G (2009) CEM: Coarsened exact matching in Stata. Stata J. 9(4):524–546.CrossrefGoogle Scholar
  • Blohm I, Riedl C, Füller J, Leimeister JM (2016) Rate or trade? Identifying winning ideas in open idea sourcing. Inform. Systems Res. 27(1):27–48.LinkGoogle Scholar
  • Borwankar S, Khern-Am-Nuai W, Kannan K (2023) Unraveling the impact: An empirical investigation of ChatGPT’s exclusion from Stack Overflow. Preprint, submitted October 4, https://ssrn.com/abstract=4481959.Google Scholar
  • Bowman E (2023) A college student created an app that can tell whether AI wrote an essay. NPR (January 9), https://www.npr.org/2023/01/09/1147549845/gptzero-ai-chatgpt-edward-tian-plagiarism.Google Scholar
  • Boyaci T, Canyakmaz C, de Véricourt F (2024) Human and machine: The impact of machine input on decision making under cognitive limitations. Management Sci. 70(2):1258–1275.LinkGoogle Scholar
  • Brockman G, Eleti A, Georges E, Jang J, Kilpatrick L, Lim R, Miller L, Pokrass M (2024) Introducing ChatGPT and Whisper APIs. OpenAI (April 24), https://openai.com/blog/introducing-chatgpt-and-whisper-apis.Google Scholar
  • Brynjolfsson E, Li D, Raymond LR (2025) Generative AI at work. Quart. J. Econom. 140(2):889–942.Google Scholar
  • Burtch G, Carnahan S, Greenwood BN (2018) Can you gig it? An empirical examination of the gig economy and entrepreneurial activity. Management Sci. 64(12):5497–5520.LinkGoogle Scholar
  • Burtch G, Lee D, Chen Z (2024) The consequences of generative AI for online knowledge communities. Sci. Rep. 14(1):10413.CrossrefGoogle Scholar
  • Burtch G, He Q, Hong Y, Lee D (2022) How do peer awards motivate creative content? Experimental evidence from Reddit. Management Sci. 68(5):3488–3506.LinkGoogle Scholar
  • Cao Z, Zhu Y, Li G, Qiu L (2024) Consequences of information feed integration on user engagement and contribution: A natural experiment in an online knowledge-sharing community. Inform. Systems Res. 35(3):1114–1136. LinkGoogle Scholar
  • Cengiz D, Dube A, Lindner A, Zipperer B (2019) The effect of minimum wages on low-wage jobs. Qurart. J. Econom. 134(3):1405–1454.CrossrefGoogle Scholar
  • Chen W, Wei X, Zhu KX (2018) Engaging voluntary contributions in online communities: A hidden Markov model. MIS Quart. 42(1):83–100.CrossrefGoogle Scholar
  • Chen Y, Cheng HK, Liu Y, Pu J, Qiu L, Wang N (2022) Knowledge‐sharing ties and equivalence in corporate online communities: A novel source to understand voluntary turnover. Production Oper. Management 31(10):3896–3913.CrossrefGoogle Scholar
  • Cheng Z, Pang MS, Pavlou PA (2020) Mitigating traffic congestion: The role of intelligent transportation systems. Inform. Systems Res. 31(3):653–674.LinkGoogle Scholar
  • Cohen J (1988) Set correlation and contingency tables. Appl. Psychol. Meas. 12(4):425–434.CrossrefGoogle Scholar
  • David C (2023) Stack Overflow growth and usage statistics (2023). SignHouse (January 17), https://www.usesignhouse.com/blog/stack-overflow-stats.Google Scholar
  • De Chaisemartin C, D’Haultfoeuille X (2022) Difference-in-differences estimators of intertemporal treatment effects. National Bureau of Economic Research, Cambridge, MA.Google Scholar
  • Dempster MAH, Leemans V (2006) An automated FX trading system using adaptive reinforcement learning. Expert Syst. Appl. 30(3):543–552.CrossrefGoogle Scholar
  • Dowling M, Lucey B (2023) ChatGPT for (finance) research: The Bananarama conjecture. Financial Res. Lett. 53(2023):103662–103662.CrossrefGoogle Scholar
  • Elder D (2025) Balancing creators and consumers: Mastering the 1% rule in online spaces. Bettermode (March 14), https://bettermode.com/blog/one-percent-rule-online-communities.Google Scholar
  • Fügener A, Grahl J, Gupta A, Ketter W (2022) Cognitive challenges in Human–Artificial Intelligence Collaboration: Investigating the path toward productive delegation. Inform. Systems Res. 33(2):678–696.LinkGoogle Scholar
  • Ge R, Zheng Z, Tian X, Liao L (2021) Human–Robot interaction: When investors adjust the usage of robo-advisors in peer-to-peer lending. Inform. Systems Res. 32(3):774–785.LinkGoogle Scholar
  • Goodman-Bacon A (2021) Difference-in-differences with variation in treatment timing. J. Econom. 225(2):254–277.CrossrefGoogle Scholar
  • Gopal A, Sivaramakrishnan K (2008) Research note—On vendor preferences for contract types in offshore software projects: The case of fixed price vs. time and materials contracts. Inform. Systems Res. 19(2):202–220.LinkGoogle Scholar
  • Guo B, Zhang X, Wang Z, Jiang M, Nie J, Ding Y, Yue J, Wu Y (2023) How close is ChatGPT to human experts? Comparison corpus, evaluation, and detection. Preprint, submitted January 18, https://arxiv.org/abs/2301.07597.Google Scholar
  • He S, Qiu L, Cheng X (2022) Surge pricing and short-term wage elasticity of labor supply in real-time ridesharing markets. MIS Quart. 46(1):193–228.CrossrefGoogle Scholar
  • Heckman JJ (1979) Sample selection bias as a specification error. Econom. J. Econometric Soc. 47(1):153–161.CrossrefGoogle Scholar
  • Hong X, Guan SU, Wong PW, Xue N, Man KL, Liu D (2021) Can AI teach humans? Humans AI collaboration for lifelong machine learning. Int. Conf. Data Sci. Inform. Tech. (Association for Computing Machinery, New York), 427–432.Google Scholar
  • Huang P, Zhang Z (2016) Participation in open knowledge communities and job-hopping: Evidence from enterprise software. MIS Quart. 40(3):785–806.CrossrefGoogle Scholar
  • Huang P, Tafti A, Mithas S (2018) Platform sponsor investments and user contributions in knowledge communities: The role of knowledge seeding. MIS Quart. 42(1):213–240.CrossrefGoogle Scholar
  • Huang P, Ceccagnoli M, Forman C, Wu DJ (2022) IT knowledge spillovers, absorptive capacity, and productivity: Evidence from enterprise software. Inform. Systems Res. 33(3):908–934.LinkGoogle Scholar
  • Huang N, Wang L, Hong Y, Lin L, Guo X, Chen G (2024) When the clock strikes: A multimethod investigation of on-the-hour effects in online learning. Inform. Systems Res. 35(2):766–782.LinkGoogle Scholar
  • Jia N, Luo X, Fang Z, Liao C (2024) When and how artificial intelligence augments employee creativity. Acad. Management J. 67(1):5–32.CrossrefGoogle Scholar
  • John K, Qi Q, Wang J (2020) Bank integration and the market for corporate control: Evidence from cross-state acquisitions. Management Sci. 66(7):3277–3294.LinkGoogle Scholar
  • Johnson SL, Safadi H, Faraj S (2015) The emergence of online community leadership. Inform. Systems Res. 26(1):165–187.LinkGoogle Scholar
  • Jussupow E, Spohrer K, Heinzl A, Gawlitza J (2021) Augmenting medical diagnosis decisions? An investigation into physicians’ decision-making process with artificial intelligence. Inform. Systems Res. 32(3):713–735.LinkGoogle Scholar
  • Kirchner JH (2023) New AI classifier for indicating AI-written text. OpenAI (January 31), https://openai.com/blog/new-ai-classifier-for-indicating-ai-written-text.Google Scholar
  • Kumar S, Qiu L (2021) Social Media Analytics and Practical Applications: The Change to the Competition Landscape (CRC Press, Boca Raton, FL).CrossrefGoogle Scholar
  • Kumar N, Qiu L, Kumar S (2018) Exit, voice, and response on digital platforms: An empirical investigation of online management response strategies. Inform. Systems Res. 29(4):849–870.LinkGoogle Scholar
  • Kung TH, Cheatham M, Medenilla A, Sillos C, De Leon L, Elepaño C, Madriaga M, et al. (2023) Performance of ChatGPT on USMLE: Potential for AI-assisted medical education using large language models. PLOS Digit. Health 2(2):e0000198.CrossrefGoogle Scholar
  • Kwon HE, Dewan S, Oh W, Kim T (2023) Self-regulation and external influence: The relative efficacy of mobile apps and offline channels for personal weight management. Inform. Systems Res. 34(1):50–66.LinkGoogle Scholar
  • Lee SY, Rui H, Whinston AB (2019) Is best answer really the best answer? The politeness bias. MIS Quart. 43(2):579–600.CrossrefGoogle Scholar
  • Li X (2016) Could deal promotion improve merchants’ online reputations? The moderating role of prior reviews. J. Management Inform. Systems 33(1):171–201.CrossrefGoogle Scholar
  • Li X, Hsieh JPA, Rai A (2013) Motivational differences across post-acceptance information system usage behaviors: An investigation in the business intelligence systems context. Inform. Systems Res. 24(3):659–682.LinkGoogle Scholar
  • Li S, Shang J, Slaughter SA (2010) Why do software firms fail? Capabilities, competitive actions, and firm survival in the software industry from 1995 to 2007. Inform. Systems Res. 21(3):631–654.LinkGoogle Scholar
  • Liu L, Wang Y, Xu Y (2024) A practical guide to counterfactual estimators for causal inference with time-series cross-sectional data. Amer. J. Political Sci. 68(1):160–176.CrossrefGoogle Scholar
  • Liu X, Wang GA, Fan W, Zhang Z (2020) Finding useful solutions in online knowledge communities: A theory-driven design and multilevel analysis. Inform. Systems Res. 31(3):731–752.LinkGoogle Scholar
  • Liu Y, Pu J, Chen Y, Qiu L, Cheng HK (2025) Departmental boundaries and knowledge sharing in corporate online communities. Inform. Systems Res., ePub ahead of print June 9, https://doi.org/10.1287/isre.2023.0086.LinkGoogle Scholar
  • Lysyakov M, Viswanathan S (2022) Threatened by AI: Analyzing users’ responses to the introduction of AI in a crowd-sourcing platform. Inform. Systems Res. 34(3):1191–1210.LinkGoogle Scholar
  • Ma M, Agarwal R (2007) Through a glass darkly: Information technology design, identity verification, and knowledge contribution in online communities. Inform. Systems Res. 18(1):42–67.LinkGoogle Scholar
  • Marton F (2006) Sameness and difference in transfer. J. Learn. Sci. 15(4):499–535.CrossrefGoogle Scholar
  • Moqri M, Mei X, Qiu L, Bandyopadhyay S (2018) Effect of “following” on contributions to open source communities. J. Management Inform. Systems 35(4):1188–1217.CrossrefGoogle Scholar
  • Nerdynav (2023) 91 important ChatGPT statistics & user numbers in April 2023 (GPT-4, plugins update). Accessed July 18, 2025, https://nerdynav.com/chatgpt-statistics/.Google Scholar
  • OpenAI (2022) Introducing ChatGPT. OpenAI (November 30), https://openai.com/blog/chatgpt.Google Scholar
  • Paas F, Renkl A, Sweller J (2003) Cognitive load theory and instructional design: Recent developments. Educ. Psychol. 18(1):1–4.CrossrefGoogle Scholar
  • Pamuru V, Khern-Am-Nuai W, Kannan K (2021) The impact of an augmented reality game on local businesses: A study of Pokémon Go on restaurants. Inform. Systems Res. 32(3):950–966.LinkGoogle Scholar
  • Pan Y, Qiu L (2022) How ride‐sharing is shaping public transit system: A counterfactual estimator approach. Production Oper. Management 31(3):906–927.CrossrefGoogle Scholar
  • Pu J, Chen Y, Qiu L, Cheng HK (2020) Does identity disclosure help or hurt user content generation? Social presence, inhibition, and displacement effects. Inform. Systems Res. 31(2):297–322.LinkGoogle Scholar
  • Pu J, Liu Y, Chen Y, Qiu L, Cheng HK (2022) What questions are you inclined to answer? Effects of hierarchy in corporate Q&A communities. Inform. Systems Res. 33(1):244–264.LinkGoogle Scholar
  • Qiao D, Lee SY, Whinston AB, Wei Q (2020) Financial incentives dampen altruism in online prosocial contributions: A study of online reviews. Inform. Systems Res. 31(4):1361–1375.LinkGoogle Scholar
  • Qiu L, Kumar S (2017) Understanding voluntary knowledge provision and content contribution through a social-media-based prediction market: A field experiment. Inform. Systems Res. 28(3):529–546.LinkGoogle Scholar
  • Qiu L, Cheng HK, Pu J (2017) Hidden profiles in corporate prediction markets: The impact of public information precision and social interactions. MIS Quart. 41(4):1249–1273.CrossrefGoogle Scholar
  • Quinn M, Gutt D (2025) Heterogeneous effects of generative AI on knowledge seeking in online communities. J. Management Inform. Systems 42(2):370–399.CrossrefGoogle Scholar
  • Sanatizadeh A, Lu Y, Zhao K, Hu Y (2025) Information foraging in the era of AI: Exploring the effect of ChatGPT on digital Q&A platforms. Inform. Management 62(6):104178.Google Scholar
  • Schanke S, Burtch G, Ray G (2021) Estimating the impact of “humanizing” customer service chatbots. Inform. Systems Res. 32(3):736–751.LinkGoogle Scholar
  • Shearer A (2022) I used ChatGPT to answer questions on Stack Overflow. DEV (December 4), https://dev.to/andrews1022/ive-been-using-chatgpt-to-answer-questions-on-stack-overflow-2ib3.Google Scholar
  • Shi C, Hu P, Fan W, Qiu L (2021) How learning effects influence knowledge contribution in online Q&A community? A social cognitive perspective. Decision Support Systems 149:113610.CrossrefGoogle Scholar
  • Shi C, Hu P, Fan W, Qiu L (2024) Competitive peer influence on knowledge contribution behaviors in online Q&A communities: A social comparison perspective. Internet Res. 34(5):1577–1601.CrossrefGoogle Scholar
  • Solaiman I, Brundage M, Clark J, Askell A, Herbert-Voss A, Wu J, Radford A, et al. (2019) Release strategies and the social impacts of language models. Preprint, submitted August 24, https://arxiv.org/abs/1908.09203.Google Scholar
  • Song T, Huang J, Tan Y, Yu Y (2019) Using user-and marketer-generated content for box office revenue prediction: Differences between microblogging and third-party platforms. Inform. Systems Res. 30(1):191–203.LinkGoogle Scholar
  • StackOverflow (2022) Temporary policy: ChatGPT is banned. Stack Overlfow (December 5), https://meta.stackoverflow.com/questions/421831/temporary-policy-chatgpt-is-banned.Google Scholar
  • Stewart OG, Jordan ME (2017) “Some explanation here”: A case study of learning opportunities and tensions in an informal science learning environment. Instructional Sci. 45(2):137–156.CrossrefGoogle Scholar
  • Su Y, Wang Q, Qiu L, Chen R (2025a) Navigating the sea of reviews: Unveiling the effects of introducing AI-generated summaries in e-commerce. Preprint, submitted July 14, https://doi.org/10.2139/ssrn.4872205.Google Scholar
  • Su Y, Zhang K, Wang Q, Qiu L (2025b) Generative AI and human knowledge sharing: Evidence from a natural experiment. Preprint, submitted May 5, https://doi.org/10.2139/ssrn.4628786.Google Scholar
  • Susarla A, Gopal R, Thatcher JB, Sarker S (2023) The Janus effect of generative AI: Charting the path for responsible conduct of scholarly activities in Information Systems. Inform. Systems Res. 34(2):399–408.LinkGoogle Scholar
  • Tan X, Jin F, Dennis AR (2022) How appreciation and attention affect contributions to electronic networks of practice. J. Management Inform. Systems 39(4):1037–1063.CrossrefGoogle Scholar
  • Temizkan O, Park S, Saydam C (2017) Software diversity for improved network security: Optimal distribution of software-based shared vulnerabilities. Inform. Systems Res. 28(4):828–849.LinkGoogle Scholar
  • Tian S, Jin Q, Yeganova L, Lai PT, Zhu Q, Chen X, Lu Z (2024) Opportunities and challenges for ChatGPT and large language models in biomedicine and health. Brief. Bioinform. 25(1):bbad493.CrossrefGoogle Scholar
  • Vaishya R, Misra A, Vaish A (2023) ChatGPT: Is this version good for healthcare and research? Diabet. Metabol. Syndr. Clinical Res. Rev. 17(4):102744.CrossrefGoogle Scholar
  • Wang J, Li G, Hui KL (2022) Monetary incentives and knowledge spillover: Evidence from a natural experiment. Management Sci. 68(5):3549–3572.LinkGoogle Scholar
  • Wang Q, Qiu L, Xu W (2024) Informal payments and doctor engagement in an online health community: An empirical investigation using generalized synthetic control. Inform. Systems Res. 35(2):706–726.LinkGoogle Scholar
  • Xu Y (2017) Generalized synthetic control method: Causal inference with interactive fixed effects models. Political Anal. (Oxford) 25(1):57–76.CrossrefGoogle Scholar
  • Xu L, Nian T, Cabral L (2020) What makes geeks tick? A study of Stack Overflow careers. Management Sci. 66(2):587–604.LinkGoogle Scholar
  • Xue M, Cao X, Feng X, Gu B, Zhang Y (2022) Is college education less necessary with AI? Evidence from firm-level labor structure changes. J. Management Inform. Systems 39(3):865–905.CrossrefGoogle Scholar
  • Xue J, Wang L, Zheng J, Li Y, Tan Y (2023) Can ChatGPT kill user-generated Q&A platforms? Preprint, submitted May 21, http://dx.doi.org/10.2139/ssrn.4448938.Google Scholar
  • Yan Z, Kuang L, Qiu L (2022) Prosocial behaviors and economic performance: Evidence from an online mental healthcare platform. Production Oper. Management 31(10):3859–3876.CrossrefGoogle Scholar
  • Yaraghi N, Du AY, Sharman R, Gopal RD, Ramesh R (2015) Health information exchange as a multisided platform: Adoption, usage, and practice involvement in service co-production. Inform. Systems Res. 26(1):1–18.LinkGoogle Scholar
  • Yilmaz ED, Naumovska I, Aggarwal VA (2023) AI-driven labor substitution: Evidence from Google translate and ChatGPT. Preprint, submitted June 7, http://dx.doi.org/10.2139/ssrn.4400516.Google Scholar
  • Yin D, Bond SD, Zhang H (2021) Anger in consumer reviews: Unhelpful but persuasive? MIS Quart. 45(3):1059–1086.CrossrefGoogle Scholar
  • You S, Yang CL, Li X (2022) Algorithmic versus human advice: Does presenting prediction performance matter for algorithm appreciation? J. Management Inform. Systems 39(2):336–365.CrossrefGoogle Scholar
  • Zhai X, Nyaaba M, Ma W (2025) Can generative AI and ChatGPT outperform humans on cognitive-demanding problem-solving tasks in science? Sci. Ed. 34(2):649–670.CrossrefGoogle Scholar
  • Zhang W, Li AW, Wu C (2025) University students’ perceptions of using generative AI in translation practices. Instr. Sci. 53(2025):633–655.Google Scholar
  • Zhang D, Jiang H, Qiang M, Zhang K, Qiu L (2025) Time to stop? An empirical investigation on the consequences of canceling monetary incentives on a digital platform. Inform. Systems Res. 36(2):781–801.LinkGoogle Scholar
  • Zhou E, Lee D (2024) Generative artificial intelligence, human creativity, and art. PNAS Nexus 3(3):1–8.CrossrefGoogle Scholar
INFORMS site uses cookies to store information on your computer. Some are essential to make our site work; Others help us improve the user experience. By using this site, you consent to the placement of these cookies. Please read our Privacy Statement to learn more.