Designing Informative Rating Systems: Evidence from an Online Labor Market

References

• Acemoglu D , Makhdoumi A , Malekian A , Ozdaglar A (2017) Fast and slow learning from reviews. NBER Working Paper 24046, National Bureau of Economic Research, Cambridge, MA.Google Scholar
• Adomavicius G , Bockstedt J , Curley S , Zhang J (2019) Reducing recommender systems biases: An investigation of rating display designs. MIS Quart. 43(4):1321–1341.Crossref, Google Scholar
• Akoglu L , Chandy R , Faloutsos C (2013) Opinion fraud detection in online reviews by network effects. Ellison NB, Hogan B, Resnick P, Soboroff I, eds. Seventh Internat. AAAI Conf. Weblogs Social Media (Association for the Advancement of Artificial Intelligence, Menlo Park, CA), 2–11.Google Scholar
• Aperjis C , Johari R (2010) Optimal windows for aggregating ratings in electronic marketplaces. Management Sci. 56(5):864–880.Link, Google Scholar
• Blum D (2017) Nine potential solutions to abate grade inflation at regionally accredited online US universities: An intrinsic case study. Qualitative Rep. 22(9):2288–2311.Google Scholar
• Bolton G , Greiner B , Ockenfels A (2013) Engineering trust: Reciprocity in the production of reputation information. Management Sci. 59(2):265–285.Link, Google Scholar
• Cabral L , Hortacsu A (2010) The dynamics of seller reputation: Evidence from eBay. J. Indust. Econom. 58(1):54–78.Crossref, Google Scholar
• Cabral L , Li L (2015) A dollar for your thoughts: Feedback-conditional rebates on eBay. Management Sci. 61(9):2052–2063.Link, Google Scholar
• Che YK , Horner J (2015) Optimal design for social learning. Preprint, submitted April 30, https://papers.ssrn.com/sol3/papers.cfm?abstract_id=2600931.Google Scholar
• Chen C , Lee S-y , Stevenson HW (1995) Response style and cross-cultural comparisons of rating scales among East Asian and North American students. Psych. Sci. 6(3):170–175.Crossref, Google Scholar
• Chen PY , Hong Y , Liu Y (2017) The value of multidimensional rating systems: Evidence from a natural experiment and randomized experiments. Management Sci. 64(10):4629–4647.Link, Google Scholar
• Cook J (2015) Uber’s internal charts show how its driver-rating system actually works. Accessed October 30, 2018, http://www.businessinsider.com/leaked-charts-show-how-ubers-driver-rating-system-works-2015-2.Google Scholar
• Dembo A , Zeitouni O (2010) Large Deviations Techniques and Applications , Stochastic Modelling and Applied Probability, vol. 38 (Springer, Berlin).Crossref, Google Scholar
• Filippas A , Horton JJ , Golden JM (2019) Reputation inflation. NBER Working Paper 25857, National Bureau of Economic Research, Cambridge, MA.Google Scholar
• Fradkin A , Grewal E , Holtz D (2018) The determinants of online review informativeness: Evidence from field experiments on AirBnb. Preprint, submitted June 27, https://papers.ssrn.com/sol3/papers.cfm?abstract_id=2939064.Google Scholar
• Gaikwad SNS , Morina D , Ginzberg A , Mullings C , Goyal S, Gamage D, Diemert C, et al.. (2016) Boomerang: Rebounding the Consequences of Reputation Feedback on Crowdsourcing Platforms (ACM, New York), 625–637.Crossref, Google Scholar
• Garg N , Johari R (2019) Designing optimal binary rating systems. Chaudhuri K, Sugiyama M, eds. Proc. 22nd Internat. Conf. Artificial Intelligence Statist. (PMLR), 1930–1939.Google Scholar
• Gines S (2017) Tastes for true talent: How professional baseball scouts define talent and decide who gets to play. Education doctoral dissertations in leadership, University of St. Thomas, St. Paul, MN.Google Scholar
• Glynn P , Juneja S (2004) A large deviations perspective on ordinal optimization. Ingalls RG, Rossetti MD, Smith JS, Peters BA, eds. Proc. 2004 Winter Simulation Conf. 2004, vol. 1 (IEEE, Piscataway, NJ), 585.Google Scholar
• Hamamura T , Heine SJ , Paulhus DL (2008) Cultural differences in response styles: The role of dialectical thinking. Personality Individual Differences 44(4):932–942.Google Scholar
• Hicks F , Valentine L , Morrow J , McDonald I (2000) Choosing natural adjective ladders. Accessed November 11, 2020, http://www.mcdonald.me.uk/storytelling/lichert_article.htm.Google Scholar
• Hooi B , Shah N , Beutel A , Günnemann S , Akoglu L , Kumar M , Makhija D , Faloutsos C (2016) Birdnest: Bayesian inference for ratings-fraud detection. Venkatasubramanian SC, Meira W, eds. Proc. 2016 SIAM Internat. Conf. Data Mining (SIAM, Philadelphia), 495–503.Google Scholar
• Hu N , Liu L , Sambamurthy V (2011) Fraud detection in online consumer reviews. Decision Support Systems 50(3):614–626.Crossref, Google Scholar
• Hu N , Zhang J , Pavlou PA (2009) Overcoming the J-shaped distribution of product reviews. Comm. ACM 52(10):144–147.Crossref, Google Scholar
• Ifrach B , Maglaras C , Scarsini M , Zseleva A (2013) Bayesian social learning from consumer reviews. Preprint, submitted July 13, https://papers.ssrn.com/sol3/papers.cfm?abstract_id=2293158.Crossref, Google Scholar
• Immorlica N , Lucier B , Rogers B (2010) Emergence of cooperation in anonymous social networks through social capital. Dellarocas C, Tennenholtz M, eds. Proc. 11th ACM Conf. Electronic Commerce (ACM, New York).Google Scholar
• Johari R , Kamble V , Kanoria Y (2017) Matching while learning. Babaioff M, Moulin H, eds. EC’17: Proc. 2017 ACM Conf. Econom. Comput. (ACM, New York).Google Scholar
• Johnson VE (2006) Grade Inflation: A Crisis in College Education (Springer Science & Business Media, New York).Google Scholar
• Klockars AJ , Yamagishi M (1988) The influence of labels and positions in rating scales. J. Educational Measurement 25(2):85–96.Crossref, Google Scholar
• Koh NS , Hu N , Clemons EK (2010) Do online reviews reflect a product’s true perceived quality? An investigation of online movie reviews across cultures. Electronic Commerce Res. Appl. 9(5):374–385.Crossref, Google Scholar
• Kokkodis M (2019) Reputation deflation through dynamic expertise assessment in online labor markets. Liu L, White R, eds. World Wide Web Conf. (ACM, New York), 896–905.Google Scholar
• Kokkodis M , Ipeirotis PG (2015) Reputation transferability in online labor markets. Management Sci. 62(6):1687–1706.Link, Google Scholar
• Krosnick JA (1999) Survey research. Annual Rev. Psych. 50(1):537–567.Crossref, Google Scholar
• Lackey LW , Lackey WJ (2006) Grade inflation: Potential causes and solutions. Internat. J. Engrg. Ed. 22(1):130–139.Google Scholar
• Li L , Xiao E (2014) Money talks: Rebate mechanisms in reputation system design. Management Sci. 60(8):2054–2072.Link, Google Scholar
• Luca M , Zervas G (2016) Fake it till you make it: Reputation, competition, and Yelp review fraud. Management Sci. 62(12):3412–3427.Link, Google Scholar
• Mazar N , Amir O , Ariely D (2008) The dishonesty of honest people: A theory of self-concept maintenance. J. Marketing Res. 45(6):633–644.Crossref, Google Scholar
• Nosko C , Tadelis S (2015) The limits of reputation in platform markets: An empirical analysis and field experiment. NBER Working Paper 20830, National Bureau of Economic Research, Cambridge, MA.Google Scholar
• Papanastasiou Y , Bimpikis K , Savva N (2017) Crowdsourcing exploration. Management Sci. 64(4):1727–1746.Google Scholar
• Parasuraman A , Grewal D , Krishnan R (2006) Marketing Research (Houghton Mifflin Company, Boston).Google Scholar
• Reiter B (2018) Astroball: The New Way to Win It All (Crown Archetype, New York).Google Scholar
• Shaout A , Yousif MK (2014) Performance evaluation—methods and techniques survey. Internat. J. Comput. Inform. Tech. 3(5):966–979.Google Scholar
• Tadelis S (2016) Reputation and feedback systems in online platform markets. Annual Rev. Econom. 8(2016):321–340.Crossref, Google Scholar
• Tsekouras D (2017) The effect of rating scale design on extreme response tendency in consumer product ratings. Internat. J. Electronic Commerce 21(2):270–296.Crossref, Google Scholar
• Wang HC , Yeo TH , Nobarany S , Hsieh G (2015) Problem with cross-cultural comparison of user-generated ratings on Mechanical Turk. Wang H-C, Hsieh G, Bi X, eds. Proc. 3rd Internat. Sympos. Chinese CHI (ACM, New York), 9–12.Google Scholar
• Zervas G , Proserpio D , Byers J (2015) A first look at online reputation on Airbnb, where every stay is above average. Technical Report 2554500, Social Science Research Network, Amsterdam.Crossref, Google Scholar
• Zhang Y , Bian J , Zhu W (2013) Trust fraud: A crucial challenge for China’s e-commerce market. Electronic Commerce Res. Appl. 12(5):299–308.Crossref, Google Scholar