Fighting Fire with Fire: Infusing Artificial Intelligence into Peer Review to Sustain Quality Scholarship

References

• Baumann J, Pei J, Koyejo S, Hovy D (2026) Stop automating peer review without rigorous evaluation. Preprint, submitted May 4, https://arxiv.org/abs/2605.03202.Google Scholar
• Berente N, Recker J (2025) Let’s all cheer for the Journal of the Association for Information Systems. This IS Research (March 19), https://www.janrecker.com/this-is-research-podcast/lets-all-cheer-for-the-journal-of-the-association-for-information-systems-19-march-2025/.Google Scholar
• Bhargava HK, Brown S, Ghose A, Gupta A, Leidner D, Wu DJ (2025) Exploring generative AI’s impact on research: Perspectives from senior scholars in management information systems. ACM Trans. Management Inform. Systems 16(2):1–9.Crossref, Google Scholar
• Boussioux L, Lane JN, Zhang M, Jacimovic V, Lakhani KR (2024) The crowdless future? Generative AI and creative problem-solving. Organ. Sci. 35(5):1589–1607.Google Scholar
• Cambridge University Press (2025) Publishing futures: Working together to deliver radical change in academic publishing. Accessed October 15, 2025, https://coilink.org/20.500.12592/8ht6vqy.Google Scholar
• Doshi AR, Hauser OP (2024) Generative AI enhances individual creativity but reduces the collective diversity of novel content. Sci. Adv. 10(28):eadn5290.Google Scholar
• Gans J (2025) What will AI do to (p)research? Accessed October 15, 2025, https://joshuagans.substack.com/p/what-will-ai-do-to-presearch.Google Scholar
• Gartenberg C, Hasan S, Murray A, Pierce L (2026) More versus better: Artificial intelligence, incentives, and the emerging crisis in peer review. Organ. Sci. 37(3):795–812.Link, Google Scholar
• Gopal RD, Li J, Riemer K, Sarker S, Singh PV, Susarla A, Bichler M, Thatcher JB (2025) Inventing with machines: Generative AI and the evolving landscape of IS research. Inform. Systems Res. 36(4):1949–1967.Link, Google Scholar
• Gottweis J, Weng W-H, Daryin A, Tu T, Palepu A, Sirkovic P, Myaskovsky A, et al. (2025) Towards an AI co-scientist. Preprint, submitted February 26, https://arxiv.org/abs/2502.18864.Google Scholar
• Kumar H, Vincentius J, Jordan E, Anderson A (2025) Human creativity in the age of LLMs: Randomized experiments on divergent and convergent thinking. Proc. 2025 CHI Conf. Human Factors in Comput. Systems (ACM, New York), 1–18.Google Scholar
• Kusumegi K, Yang X, Ginsparg P, de Vaan M, Stuart T, Yin Y (2025) Scientific production in the era of large language models. Science 390(6779):1240–1243.Crossref, Google Scholar
• Latona GR, Ribeiro MH, Davidson TR, Veselovsky V, West R (2025) The AI review lottery: Widespread AI-assisted peer reviews boost paper scores and acceptance rates. Proc. ACM Human-Comput. Interaction 9(7):1–28.Google Scholar
• Liang W, Izzo Z, Zhang Y, Lepp H, Cao H, Zhao X, Chen L, et al. (2024a) Monitoring AI-modified content at scale: A case study on the impact of ChatGPT on AI conference peer reviews. Salakhutdinov R, Kolter Z, Heller K, Weller A, Oliver N, Scarlett J, Berkenkamp F, eds. Proc. 41st Internat. Conf. Machine Learn., Proceedings of Machine Learning Research, vol. 235 (PMLR, New York), 29575–29620.Google Scholar
• Liang W, Zhang Y, Cao H, Wang B, Ding DY, Yang X, Zou J, et al. (2024b) Can large language models provide useful feedback on research papers? A large-scale empirical analysis. NEJM AI 1(8):AIoa2400196.Crossref, Google Scholar
• Liel Y, Zalmanson L (2025) Turning off your better judgment: Algorithmic conformity in artificial intelligence-human collaboration. J. Management Inform. Systems 42(4):1087–1117.Google Scholar
• Ludwig J, Mullainathan S (2024) Machine learning as a tool for hypothesis generation. Quart. J. Econom. 139(2):751–827.Crossref, Google Scholar
• Manning BS, Zhu K, Horton JJ (2024) Automated social science: Language models as scientist and subjects. NBER Working Paper 32381, National Bureau of Economic Research, Cambridge, MA,Google Scholar
• National Institutes of Health (2025) Supporting fairness and originality in NIH research applications. NIH Notice Number NOT-OD-25-132. Accessed October 15, 2025, https://grants.nih.gov/grants/guide/notice-files/NOT-OD-25-132.html.Google Scholar
• Peters U, Chin-Yee B (2025) Generalization bias in large language model summarization of scientific research. Roy. Soc. Open Sci. 12(4):241776.Crossref, Google Scholar
• Pierce L (2026) The annual report. Accessed April 2, 2026, https://orgsci.substack.com/p/the-annual-report.Google Scholar
• Richardson RAK, Hong SS, Byrne JA, Stoeger T, Amaral LAN (2025) The entities enabling scientific fraud at scale are large, resilient, and growing rapidly. Proc. Natl. Acad. Sci. USA 122(32):e2420092122.Crossref, Google Scholar
• Sahu G, Larochelle H, Charlin L, Pal C (2025) Reviewertoo: Should AI join the program committee? A look at the future of peer review. Preprint, submitted October 9, https://arxiv.org/abs/2510.08867.Google Scholar
• Tao T (2025) Machine-assisted proof. Notices Amer. Math. Soc. (January), https://www.ams.org/journals/notices/202501/noti3041/noti3041.html.Google Scholar
• Xu Y, Yang LY (2026) Scaling reproducibility: An AI-assisted workflow for large-scale reanalysis. Preprint, submitted February 17, https://arxiv.org/abs/2602.16733.Google Scholar