The Pitfalls of Review Solicitation: Evidence from a Natural Experiment on TripAdvisor

Published Online:https://doi.org/10.1287/mnsc.2023.01006

References

  • Angrist JD, Pischke JS (2009) Mostly Harmless Econometrics: An Empiricist’s Companion (Princeton University Press, Princeton, NJ).CrossrefGoogle Scholar
  • Askalidis G, Kim SJ, Malthouse EC (2017) Understanding and overcoming biases in online review systems. Decision Support Systems 97:23–30.CrossrefGoogle Scholar
  • Beadle JN, Sheehan AH, Dahlben B, Gutchess AH (2015) Aging, empathy, and prosociality. J. Gerontology B Psych. Sci. Soc. Sci. 70(2):213–222.CrossrefGoogle Scholar
  • Blei DM, Ng AY, Jordan MI (2003) Latent dirichlet allocation. J. Machine Learn. Res. 3(Jan):993–1022.Google Scholar
  • Burtch G, Hong Y, Bapna R, Griskevicius V (2018) Stimulating online reviews by combining financial incentives and social norms. Management Sci. 64(5):2065–2082.LinkGoogle Scholar
  • Cabral L, Li L (2015) A dollar for your thoughts: Feedback-conditional rebates on eBay. Management Sci. 61(9):2052–2063.LinkGoogle Scholar
  • Casaló LV, Flavián C, Guinalíu M, Ekinci Y (2015) Avoiding the dark side of positive online consumer reviews: Enhancing reviews’ usefulness for high risk-averse travelers. J. Bus. Res. 68(9):1829–1835.CrossrefGoogle Scholar
  • Chen Z, Lurie NH (2013) Temporal contiguity and negativity bias in the impact of online word of mouth. J. Marketing Res. 50(4):463–476.CrossrefGoogle Scholar
  • Chen Y, Harper FM, Li K (2010) Social comparisons and contributions to online communities: A field experiment on Movielens. Amer. Econom. Rev. 100(4):1358–1398.CrossrefGoogle Scholar
  • Chevalier JA, Mayzlin D (2006) The effect of word of mouth on sales: Online book reviews. J. Marketing Res. 43(3):345–354.CrossrefGoogle Scholar
  • Christov-Moore L, Simpson EA, Coudé G, Grigaityte K, Iacoboni M, Ferrari PF (2014) Empathy: Gender effects in brain and behavior. Neurosci. Biobehav. Rev. 46:604–627.CrossrefGoogle Scholar
  • Duan W, Gu B, Whinston AB (2008) Do online reviews matter?—An empirical investigation of panel data. Decision Support Systems 45(4):1007–1016.CrossrefGoogle Scholar
  • Eckel CC, Grossman PJ (2008) Differences in the economic decisions of men and women: Experimental evidence. Plott CR, Smith VL, eds. Handbook of Experimental Economics Results (Elsevier, Amsterdam), 509–519.Google Scholar
  • Eslami SP, Ghasemaghaei M, Hassanein K (2018) Which online reviews do consumers find most helpful? A multi-method investigation. Decision Support Systems 113(9):32–42.CrossrefGoogle Scholar
  • Fang H, Zhang J, Bao Y, Zhu Q (2013) Toward effective online review systems in the Chinese context: A cross-cultural empirical study. Electronic Commerce Res. Appl. 12(3):208–220.CrossrefGoogle Scholar
  • Gardner J (2021) Two-stage differences in differences. Accessed March, 2023, https://jrgcmu.github.io/2sdd_current.pdf.Google Scholar
  • Gilardi F, Alizadeh M, Kubli M (2023) Chatgpt outperforms crowd-workers for text-annotation tasks. Preprint, submitted March 27, https://arxiv.org/abs/2303.15056.Google Scholar
  • Goes PB, Lin M, Yeung CMA (2014) “Popularity effect” in user-generated content: Evidence from online product reviews. Inform. Systems Res. 25(2):222–238.LinkGoogle Scholar
  • Hennig-Thurau T, Gwinner KP, Walsh G, Gremler DD (2004) Electronic word-of-mouth via consumer-opinion platforms: What motivates consumers to articulate themselves on the Internet? J. Interactive Marketing 18(1):38–52.CrossrefGoogle Scholar
  • Hofstede G (2001) Culture’s Consequences: Comparing Values, Behaviors, Institutions and Organizations Across Nations (Sage, Thousand Oaks, CA).Google Scholar
  • Huang N, Hong Y, Burtch G (2017) Social network integration and user content generation: Evidence from natural experiments. Management Inform. Systems Quart. 41(4):1035–1058.CrossrefGoogle Scholar
  • Karaman H (2020) Online review solicitations reduce extremity bias in online review distributions and increase their representativeness. Management Sci. 67(7):3985–4642.Google Scholar
  • Kayes I, Kourtellis N, Quercia D, Iamnitchi A, Bonchi F (2015) Cultures in community question answering. Yesilada Y, Farzan R, Houben GJ, eds. Proc. 26th ACM Conf. Hypertext Social Media (Association for Computing Machinery, New York), 175–184.Google Scholar
  • Ke Z, Liu D, Brass DJ (2020) Do online friends bring out the best in US? The effect of friend contributions on online review provision. Inform. Systems Res. 31(4):1322–1336.LinkGoogle Scholar
  • Khern-am-nuai W, Kannan K, Ghasemkhani H (2018) Extrinsic vs. intrinsic rewards for contributing reviews in an online platform. Inform. Systems Res. 29(4):871–892.LinkGoogle Scholar
  • Kim SJ, Maslowska E, Tamaddoni A (2019) The paradox of (dis) trust in sponsorship disclosure: The characteristics and effects of sponsored online consumer reviews. Decision Support Systems 116:114–124.CrossrefGoogle Scholar
  • Lin Z, Zhang Y, Tan Y (2019) An empirical study of free product sampling and rating bias. Inform. Systems Res. 30(1):260–275.LinkGoogle Scholar
  • Litvin SW, Sobel RN (2019) Organic vs. solicited hotel TripAdvisor reviews: Measuring their respective characteristics. Cornell Hospital Quart. 60(4):370–377.CrossrefGoogle Scholar
  • MacKinnon KA (2012) User generated content vs. advertising: Do consumers trust the word of others over advertisers. Elon J. Undergraduate Res. Comm. 3(1):14–22.Google Scholar
  • Magno F, Cassia F, Bruni A (2018) “Please write a (great) online review for my hotel!” Guests’ reactions to solicited reviews. J. Vacation Marketing 24(2):148–158.CrossrefGoogle Scholar
  • Mayzlin D, Dover Y, Chevalier J (2014) Promotional reviews: An empirical investigation of online review manipulation. Amer. Econom. Rev. 104(8):2421–2455.CrossrefGoogle Scholar
  • Mimno D, Wallach H, Talley E, Leenders M, McCallum A (2011) Optimizing semantic coherence in topic models. Proc. Conf. Empirical Methods Natural Language Processing, 262–272.Google Scholar
  • Mo J, Li ZA (2018) Is product sampling good for brands’ online word of mouth? Proc. Internat. Conf. Inform. Systems.Google Scholar
  • Muchnik L, Aral S, Taylor SJ (2013) Social influence bias: A randomized experiment. Science 341(6146):647–651.CrossrefGoogle Scholar
  • Mudambi SM, Schuff D (2010) What makes a helpful online review? A study of customer reviews on amazon.com. Management Inform. Systems Quart. 34(1):185–200.CrossrefGoogle Scholar
  • Murphy R (2020) Local consumer review survey 2020. BrightLocal (December 9), https://www.brightlocal.com/research/local-consumer-review-survey/.Google Scholar
  • Petrescu M, O’Leary K, Goldring D, Mrad SB (2018) Incentivized reviews: Promising the moon for a few stars. J. Retailing Consumer Service 41:288–295.CrossrefGoogle Scholar
  • Proserpio D, Zervas G (2017) Online reputation management: Estimating the impact of management responses on consumer reviews. Marketing Sci. 36(5):645–665.LinkGoogle Scholar
  • Pu J, Kwark Y, Han SP, Ye Q, Gu B (2023) Uncertainty reduction vs. reciprocity: Understanding the effect of a platform-initiated reviewer incentive program on regular ratings. Inform. Systems Res., ePub ahead of print November 7, https://doi.org/10.1287/isre.2019.0176.Google Scholar
  • Qiao D, Lee SY, Whinston AB, Wei Q (2020) Financial incentives dampen altruism in online prosocial contributions: A study of online reviews. Inform. Systems Res. 31(4):1361–1375.LinkGoogle Scholar
  • ReviewTrackers (2022) Online reviews statistics and trends: A 2022 report. ReviewTrackers (January 9), https://www.reviewtrackers.com/reports/online-reviews-survey/.Google Scholar
  • Roberts ME, Stewart BM, Tingley D, Airoldi EM (2013) The structural topic model and applied social science. Proc. Adv. Neural Inform. Processing Systems Workshop Topic Models Computat. Appl. Evaluation, 1–20.Google Scholar
  • Roberts ME, Stewart BM, Tingley D, Lucas C, Leder‐Luis J, Gadarian SK, Albertson B, et al. (2014) Structural topic models for open‐ended survey responses. Amer. J. Polical Sci. 58(4):1064–1082.CrossrefGoogle Scholar
  • Rosario AB, Sotgiu F, De Valck K, Bijmolt TH (2016) The effect of electronic word of mouth on sales: A meta-analytic review of platform, product, and metric factors. J. Marketing Res. 53(3):297–318.CrossrefGoogle Scholar
  • Schindler RM, Bickart B (2012) Perceived helpfulness of online consumer reviews: The role of message content and style. J. Consumer Behav. 11(3):234–243.CrossrefGoogle Scholar
  • Shen W, Hu YJ, Ulmer JR (2015) Competing for attention: An empirical study of online reviewers’ strategic behavior. Management Inform. Systems Quart. 39(3):683–696.CrossrefGoogle Scholar
  • Stephen A, Bart Y, Du Plessis C, Goncalves D (2012) Does paying for online product reviews pay off? The effects of monetary incentives on content creators and consumers. Adv. Consumer Res. 40:228–231.Google Scholar
  • Sundaram DS, Mitra K, Webster C (1998) Word-of-mouth communications: A motivational analysis. Adv. Consumer Res. 25:527–531.Google Scholar
  • Sze JA, Gyurak A, Goodkind MS, Levenson RW (2012) Greater emotional empathy and prosocial behavior in late life. Emotion 12(5):1129–1140.CrossrefGoogle Scholar
  • Törnberg P (2023) Chatgpt-4 outperforms experts and crowd workers in annotating political twitter messages with zero-shot learning. Preprint, submitted April 13, https://arxiv.org/abs/2304.06588.Google Scholar
  • TripAdvisor (2017) Key insights from “using guest reviews to pave the path to greater engagement.” Accessed March 2023, https://www.tripadvisor.com/TripAdvisorInsights/w842.Google Scholar
  • Wang J, Ghose A, Ipeirotis P (2012) Bonus, disclosure, and choice: What motivates the creation of high-quality paid reviews? Proc. Internat. Conf. Inform. Systems.Google Scholar
  • Wang S, Pavlou P, Gong J (2016) On monetary incentives, online product reviews, and sales. Proc. Internat. Conf. Inform. Systems.Google Scholar
  • Wang Y, Goes P, Wei Z, Zeng D (2019) Production of online word‐of‐mouth: Peer effects and the moderation of user characteristics. Production Oper. Management 28(7):1621–1640.CrossrefGoogle Scholar
  • Yin D, Mitra S, Han Z (2016) Research note—When do consumers value positive vs. negative reviews? An empirical investigation of confirmation bias in online word of mouth. Inform. Systems Res. 27(1):131–144.LinkGoogle Scholar
  • Yu Y, Khern-am-nuai W, Pinsonneault A (2022) When paying for reviews pays off: The case of performance-contingent monetary rewards. Management Inform. Systems Quart. 46(1):609–626.CrossrefGoogle Scholar
  • Zhu F, Zhang X (2010) Impact of online consumer reviews on sales: The moderating role of product and consumer characteristics. J. Marketing 74(2):133–148.CrossrefGoogle Scholar
INFORMS site uses cookies to store information on your computer. Some are essential to make our site work; Others help us improve the user experience. By using this site, you consent to the placement of these cookies. Please read our Privacy Statement to learn more.