Open Access

Do Incentives to Review Help the Market? Evidence from a Field Experiment on Airbnb

Andrey Fradkin
Corresponding Author
Andrey Fradkin
[email protected]
https://orcid.org/0000-0002-3238-0592
Questrom School of Business, Boston University, Boston, Massachusetts 02215;
Search for more papers by this author
,
David Holtz
David Holtz
[email protected]
https://orcid.org/0000-0002-0896-8628
Management of Organizations and Entrepreneurship and Innovation, Haas School of Business, University of California, Berkeley, California 94720;MIT Initiative on the Digital Economy, MIT Sloan School of Management, Cambridge, Massachusetts 02142
Search for more papers by this author

Andrey Fradkin

Corresponding Author

Andrey Fradkin

[email protected]

https://orcid.org/0000-0002-3238-0592

Questrom School of Business, Boston University, Boston, Massachusetts 02215;

Search for more papers by this author

David Holtz

[email protected]

https://orcid.org/0000-0002-0896-8628

Management of Organizations and Entrepreneurship and Innovation, Haas School of Business, University of California, Berkeley, California 94720;MIT Initiative on the Digital Economy, MIT Sloan School of Management, Cambridge, Massachusetts 02142

Search for more papers by this author

Published Online:7 Apr 2023https://doi.org/10.1287/mksc.2023.1439

References

Acemoglu D, Makhdoumi A, Malekian A, Ozdaglar A (2022) Learning from reviews: The selection effect and the speed of learning. Econometrica 90(6):2857–2899.Crossref, Google Scholar
Avery C, Resnick P, Zeckhauser R (1999) The market for evaluations. Amer. Econom. Rev. 89(3):564–584.Crossref, Google Scholar
Benson A, Sojourner A, Umyarov A (2020) Can reputation discipline the gig economy? Experimental evidence from an online labor market. Management Sci. 66(5):1802–1825.Link, Google Scholar
Besbes O, Scarsini M (2018) On information distortions in online ratings. Oper. Res. 66(3):597–610.Link, Google Scholar
Brandes L, Godes D, Mayzlin D (2022) Extremity bias in online reviews: The role of attrition. J. Marketing Res. 59(4):675–695.Google Scholar
Burtch G, Hong Y, Bapna R, Griskevicius V (2018) Stimulating online reviews by combining financial incentives and social norms. Management Sci. 64(5):2065–2082.Link, Google Scholar
Cabral L, Li L (2015) A dollar for your thoughts: Feedback-conditional rebates on eBay. Management Sci. 61(9):2052–2063.Link, Google Scholar
Cui R, Li J, Zhang DJ (2020) Reducing discrimination with reviews in the sharing economy: Evidence from field experiments on Airbnb. Management Sci. 66(3):1071–1094.Link, Google Scholar
Dellarocas C, Wood CA (2007) The sound of silence in online feedback: Estimating trading risks in the presence of reporting bias. Management Sci. 54(3):460–476.Link, Google Scholar
Farronato C, Fradkin A, Larsen B, Brynjolfsson E (2020) Consumer Protection in an Online World: An Analysis of Occupational Licensing (National Bureau of Economic Research, Cambridge, MA).Crossref, Google Scholar
Filippas A, Horton JJ, Golden J (2022) Reputation inflation. Marketing Sci. 41(4):733–745.Link, Google Scholar
Fradkin A, Grewal E, Holtz D (2021) Reciprocity and unveiling in two-sided reputation systems: Evidence from an experiment on Airbnb. Marketing Sci. 40(6):1013–1029.Link, Google Scholar
Fradkin A, Grewal E, Holtz D, Pearson M (2015) Bias and reciprocity in online reviews: Evidence from field experiments on Airbnb. Proc. 16th ACM Conf. Econom. Comput. (Association for Computing Machinery, New York), 641.Google Scholar
Garg N, Johari R (2021) Designing informative rating systems: Evidence from an online labor market. Manufacturing Service Oper. Management 23(3):589–605.Link, Google Scholar
He S, Hollenbeck B, Proserpio D (2022) The market for fake reviews. Marketing Sci. 41(5):896–921.Google Scholar
Huang Y (2022) Seller-pricing frictions and platform remedies. Unpublished manuscript.Google Scholar
Hui X, Klein TJ, Stahl K (2021) When and why do buyers rate in online markets? Unpublished manuscript, University of Bonn and University of Mannheim, Germany.Google Scholar
Hui X, Liu Z, Zhang W (2023) From high bar to uneven bars: The impact of information granularity in quality certification. Management Sci., ePub ahead of print January 20, https://doi.org/10.1287/mnsc.2022.4666.Google Scholar
Ifrach B, Maglaras C, Scarsini M, Zseleva A (2019) Bayesian social learning from consumer reviews. Oper. Res. 67(5):1209–1221.Link, Google Scholar
Karaman H (2020) Online review solicitations reduce extremity bias in online review distributions and increase their representativeness. Management Sci. 67(7):4420–4445.Link, Google Scholar
Laouénan M, Rathelot R (2020) Can information reduce ethnic discrimination? Evidence from Airbnb. Amer. Econom. J. Appl. Econom. 14(1):107–132.Crossref, Google Scholar
Lewis G, Zervas G (2016) The welfare impact of consumer reviews: A case study of the hotel industry. Unpublished manuscript.Google Scholar
Li L (2010) Reputation, trust, and rebates: How online auction markets can improve their feedback mechanisms. J. Econom. Management Strategy 19(2):303–331.Crossref, Google Scholar
Li L, Tadelis S, Zhou X (2020) Buying reputation as a signal of quality: Evidence from an online marketplace. RAND J. Econom. 51(4):965–988.Crossref, Google Scholar
Li L, Xiao E (2014) Money talks: Rebate mechanisms in reputation system design. Management Sci. 60(8):2054–2072.Link, Google Scholar
Luca M, Zervas G (2016) Fake it till you make it: Reputation, competition, and Yelp review fraud. Management Sci. 62(12):3412–3427.Link, Google Scholar
Marinescu I, Chamberlain A, Smart M, Klein N (2021) Incentives can reduce bias in online employer reviews. J. Experiment. Psych. Appl. 27(2):393–407.Crossref, Google Scholar
Mayzlin D, Dover Y, Chevalier J (2014) Promotional reviews: An empirical investigation of online review manipulation. Amer. Econom. Rev. 104(8):2421–2455.Crossref, Google Scholar
Nosko C, Tadelis S (2015) The Limits of Reputation in Platform Markets: An Empirical Analysis and Field Experiment (National Bureau of Economic Research, Cambridge, MA).Crossref, Google Scholar
Pallais A (2014) Inefficient hiring in entry-level labor markets. Amer. Econom. Rev. 104(11):3565–3599.Crossref, Google Scholar
Papanastasiou Y, Bimpikis K, Savva N (2018) Crowdsourcing exploration. Management Sci. 64(4):1727–1746.Link, Google Scholar
Park S, Shin W, Xie J (2021) The fateful first consumer review. Marketing Sci. 40(3):481–507.Link, Google Scholar
Reimers I, Waldfogel J (2021) Digitization and pre-purchase information: The causal and welfare impacts of reviews and crowd ratings. Amer. Econom. Rev. 111(6):1944–1971.Crossref, Google Scholar
Tadelis S (2016) Reputation and feedback systems in online platform markets. Annual Rev. Econom. 8:321–340.Crossref, Google Scholar
Vana P, Lambrecht A (2021) The effect of individual online reviews on purchase likelihood. Marketing Sci. 40(4):708–730.Link, Google Scholar
Wu C, Che H, Chan TY, Lu X (2015) The economic value of online reviews. Marketing Sci. 34(5):739–754.Link, Google Scholar

Volume 42, Issue 5

September-October 2023

Pages 839-1028, ii

Article Information

Supplemental Material

Metrics

Information

Received:March 28, 2022
Accepted:October 03, 2022
Published Online:April 07, 2023

Cite as

Andrey Fradkin, David Holtz (2023) Do Incentives to Review Help the Market? Evidence from a Field Experiment on Airbnb. Marketing Science 42(5):853-865.

https://doi.org/10.1287/mksc.2023.1439

Keywords

Acknowledgments

The authors thank Dean Eckles, Chiara Farronato, Shane Greenstein, John Horton, Caroline Hoxby, Xiang Hui, Ramesh Johari, Garrett Johnson, Tobias Klein, Jon Levin, Tesary Lin, Mike Luca, Steve Tadelis, Catherine Tucker, Giorgos Zervas, and Olivia Natan as well as seminar participants at Microsoft, the ACM Conference on Economics and Computation (2015), National Bureau of Economic Research Summer Institute, Conference on Digital Experimentation, The Workshop on Information Systems and Economics, Marketing Science (2021), and the University of Rochester for comments. They thank Elena Grewal and Riley Newman for giving them the initial opportunity to work on this project, Matthew Pearson for early conversations about the project, and Peter Coles and Mike Egesdal for their tireless efforts in helping this paper be approved. The views expressed in this paper are solely the authors’ and do not necessarily reflect the views of Airbnb, Inc. The authors were employed by Airbnb, Inc., for part of the time that this paper was written and have held stock that may constitute a material financial position. Andrey Fradkin was an employee of Airbnb between 2012 and 2016 and is currently an unpaid contractor. He has previously held a material financial interest in Airbnb, Inc. David Holtz was an employee of Airbnb between 2015 and 2016 and is currently an unpaid contractor. He currently holds a material financial interest in Airbnb, Inc. Airbnb, Inc. had the right to review the paper subject to the following stipulations:Delaying disclosure or publication until any intellectual property rights have been adequately protected.Removing Airbnb confidential information from the work product.Compliance with Airbnb’s obligations as it relates to applicable laws, including the Data Protection Law, security laws, confidentiality requirements, and contractual commitments.Adding an appropriate disclosure concerning Airbnb’s support of the project.

PDF download

Available Issues

Available Issues

Available Issues

Available Issues

Available Issues

Available Issues

Do Incentives to Review Help the Market? Evidence from a Field Experiment on Airbnb

References

Volume 42, Issue 5

Article Information

Supplemental Material

Metrics

Information

Cite as

Keywords

Sign Up for INFORMS Publications Updates and News