Navigating the Sea of Reviews: Unveiling the Effects of Introducing AI-Generated Summaries in E-Commerce

Published Online:https://doi.org/10.1287/isre.2024.1282

Amid the burgeoning incorporation of generative artificial intelligence (AI) into commercial realms, numerous companies are exploring ways to leverage generative AI tools in practice. However, there is still a lack of empirical evidence to examine their effectiveness. In this research, we explore how AI-generated summaries (AIGS), a relatively new generative AI tool, influence consumer review behavior. Whereas one may assume that AI-generated content diminishes users’ incentive to contribute by replacing user-generated content, we find the opposite: the introduction of AIGS actually leads to an increase in the volume of consumer reviews. We propose that this effect is driven by enhanced perceptions of collective efficacy. By highlighting the value of consumer reviews as a collective force, AIGS reinforces contributors’ belief that their individual input meaningfully contributes to a shared body of product knowledge, thus motivating participation. This mechanism is supported by an additional controlled laboratory experiment in which we directly measure perceived collective efficacy and find that it mediates the effect of AIGS on the likelihood of leaving a review. Our moderation analysis results reveal that the positive effect of AIGS on review contributions is more pronounced among products that are well-reviewed (versus under-reviewed) and polarizing (versus nonpolarizing). Moreover, a fine-grained review content analysis shows that reviews after the AIGS introduction exhibit enhanced content richness and provide complementary information beyond the AIGS content. Specifically, contributors discuss fewer product attributes already covered by AIGS, discuss more product attributes not covered by AIGS, and elaborate on AIGS product attributes rather than restating the summary. Taken together, these findings advance our understanding of how AI integration influences consumer review behaviors in e-commerce and offer valuable practical guidance for business strategies on employing generative AI.

History: Bin Gu, Senior Editor; Xitong Li, Associate Editor.

Supplemental Material: The online appendix is available at https://doi.org/10.1287/isre.2024.1282.

INFORMS site uses cookies to store information on your computer. Some are essential to make our site work; Others help us improve the user experience. By using this site, you consent to the placement of these cookies. Please read our Privacy Statement to learn more.