When the Stars Shine Too Bright: The Influence of Multidimensional Ratings on Online Consumer Ratings

References

• Archak N , Ghose A , Ipeirotis PG (2011) Deriving the pricing power of product features by mining consumer reviews. Management Sci. 57(8):1485–1509.Link, Google Scholar
• Ba S , Pavlou PA (2002) Evidence of the effect of trust building technology in electronic markets: Price premiums and buyer behavior. Management Inform. Systems Quart. 26(3):243–268.Crossref, Google Scholar
• Baayen RH , Davidson DJ , Bates DM (2008) Mixed-effects modeling with crossed random effects for subjects and items. J. Memory Language 59(4):390–412.Crossref, Google Scholar
• Bates D , Mächler M , Bolker BM , Walker SC (2015) Fitting linear mixed-effects models using lme4. J. Statist. Software 67(1):1–51.Crossref, Google Scholar
• Baumeister RF , Bratslavsky E , Finkenauer C , Vohs KD (2001) Bad is stronger than good. Rev. General Psych. 5(4):323–370.Crossref, Google Scholar
• Bettman JR , Sujan M (1987) Effects of framing on evaluation of comparable and noncomparable alternatives by expert and novice consumers. J. Consumer Res. 14(2):141–154.Crossref, Google Scholar
• Bickart B , Schindler RM (2001) Internet forums as influential sources of consumer information. J. Interactive Marketing 15(3):31–40.Crossref, Google Scholar
• Bolton GE , Katok E , Ockenfels A (2004) How effective are electronic reputation mechanisms? An experimental investigation. Management Sci. 50(11):1587–1602.Link, Google Scholar
• Bürkner PC (2017) brms: An R package for Bayesian multilevel models using Stan. J. Statist. Software 80(1):1–28.Crossref, Google Scholar
• Burtch G , Hong Y , Bapna R , Griskevicius V (2017) Stimulating online reviews by combining financial incentives and social norms. Management Sci. 64(5):2065–2082.Link, Google Scholar
• Chen PY , Hong Y , Liu Y (2018) The value of multidimensional rating systems: Evidence from a natural experiment and randomized experiments. Management Sci. 64(10):4629–4647.Link, Google Scholar
• Chen Y , Xie J (2005) Third-party product review and firm marketing strategy. Marketing Sci. 24(2):218–240.Link, Google Scholar
• Chevalier JA , Mayzlin D (2006) The effect of word of mouth on sales: Online book reviews. J. Marketing Res. 43(3):345–354.Crossref, Google Scholar
• Chintagunta PK , Gopinath S , Venkataraman S (2010) The effects of online user reviews on movie box office performance: Accounting for sequential rollout and aggregation across local markets. Marketing Sci. 29(5):944–957.Link, Google Scholar
• Cohen J (1988) Statistical Power Analysis for the Behavioral Sciences, 2nd ed. Lawrence Erlbaum Associates, Hillsdale, NJ.Google Scholar
• Darby MR , Karni E (1973) Free competition and the optimal amount of fraud. J. Law Econom. 16(1):67–88.Crossref, Google Scholar
• de Langhe B , Fernbach PM , Lichtenstein DR (2016) Navigating by the stars: Investigating the actual and perceived validity of online user ratings. J. Consumer Res. 42(6):817–833.Crossref, Google Scholar
• Decker R , Trusov M (2010) Estimating aggregate consumer preferences from online product reviews. Internat. J. Res. Marketing 27(4):293–307.Crossref, Google Scholar
• Dellarocas C (2003) The digitization of word of mouth: Promise and challenges of online feedback mechanisms. Management Sci. 49(10):1407–1424.Link, Google Scholar
• Dellarocas C (2006) Strategic manipulation of internet opinion forums: Implications for consumers and firms. Management Sci. 52(10):1577–1593.Link, Google Scholar
• Dellarocas C , Wood CA (2008) The sound of silence in online feedback: Estimating trading risks in the presence of reporting bias. Management Sci. 54(3):460–476.Link, Google Scholar
• Dellarocas C , Zhang XM , Awad NF (2007) Exploring the value of online product reviews in forecasting sales: The case of motion pictures. J. Interactive Marketing 21(4):23–45.Crossref, Google Scholar
• Duan W , Gu B , Whinston AB (2008) Do online reviews matter?—An empirical investigation of panel data. Decision Support Systems 45(4):1007–1016.Crossref, Google Scholar
• Faul F , Erdfelder E , Buchner A , Lang AG (2009) Statistical power analyses using G*Power 3.1: Tests for correlation and regression analyses. Behav. Res. Methods 41(4):1149–1160.Crossref, Google Scholar
• Feldman JM (1992) Constructive processes as a source of context effects in survey research: Explorations in self-generated validity. Schwarz N , Sudman S , eds. Context Effects in Social and Psychological Research (Springer, New York), 49–61.Crossref, Google Scholar
• Feldman JM , Lynch JG (1988) Self-generated validity and other effects of measurement on belief, attitude, intention, and behavior. J. Appl. Psych. 73(3):421–435.Crossref, Google Scholar
• Forman C , Ghose A , Wiesenfeld B (2008) Examining the relationship between reviews and sales: The role of reviewer identity disclosure in electronic markets. Inform. Systems Res. 19(3):291–313.Link, Google Scholar
• Gao G , Greenwood BN , Agarwal R , McCullough JS (2015) Vocal minority and silent majority: How do online ratings reflect population perceptions of quality? Management Inform. Systems Quart. 39(3):565–589.Crossref, Google Scholar
• Ge Y , Li J (2015) Measure and mitigate the dimensional bias in online reviews and ratings. Proc. Internat. Conf. Inform. Systems (Fort Worth, TX), 1–11.Google Scholar
• Gelman A , Hill J (2007) Data Analysis Using Regression and Multilevel/Hierarchical Models (Cambridge University Press, New York).Crossref, Google Scholar
• Ghose A , Ipeirotis PG , Li B (2012) Designing ranking systems for hotels on travel search engines by mining user-generated and crowdsourced content. Marketing Sci. 31(3):493–520.Link, Google Scholar
• Godes D , Mayzlin D (2004) Using online conversations to study word-of-mouth communication. Marketing Sci. 23(4):545–560.Link, Google Scholar
• Godes D , Silva JC (2012) Sequential and temporal dynamics of online opinion. Marketing Sci. 31(3):448–473.Link, Google Scholar
• Goes PB , Lin M , Yeung CA (2014) “Popularity effect” in user-generated content: Evidence from online product reviews. Inform. Systems Res. 25(2):222–238.Link, Google Scholar
• Gonzales JE , Cunningham CA (2015) The promise of pre-registration in psychological research. https://www.apa.org/science/about/psa/2015/08/pre-registration.Google Scholar
• He SX , Bond SD (2013) Word-of-mouth and the forecasting of consumption enjoyment. J. Consumer Psych. 23(4):464–482.Crossref, Google Scholar
• Hennig-Thurau T , Gwinner KP , Walsh G , Gremler DD (2004) Electronic word-of-mouth via consumer-opinion platforms: What motivates consumers to articulate themselves on the internet? J. Interactive Marketing 18(1):38–52.Crossref, Google Scholar
• Higgins ET (1978) “Saying is believing”: Effects of message modification on memory and liking for the person described. J. Experiment. Soc. Psych. 14(4):363–378.Crossref, Google Scholar
• Higgins ET , Brendl CM (1995) Accessibility and applicability: Some “activation rules” influencing judgment. J. Experiment. Soc. Psych. 31(3):218–243.Crossref, Google Scholar
• Hippler HJ , Schwarz N , Sudman S (1987) Social Information Processing and Survey Methodology (Springer, New York).Crossref, Google Scholar
• Ho YC , Wu J , Tan Y (2017) Disconfirmation effect on online rating behavior: A structural model. Inform. Systems Res. 28(3):626–642.Link, Google Scholar
• Hong YK , Pavlou PA (2014) Product fit uncertainty in online markets: Nature, effects, and antecedents. Inform. Systems Res. 25(2):328–344.Link, Google Scholar
• Hu N , Pavlou PA , Zhang J (2017) On self-selection biases in online product ratings. Management Inform. Systems Quart. 41(2):449–471.Crossref, Google Scholar
• Hu N , Zhang J , Pavlou PA (2009) Overcoming the J-shaped distribution of product reviews. Comm. ACM . 52(10):144–147.Crossref, Google Scholar
• Hu N , Bose I , Gao Y , Liu L (2011) Manipulation in digital word-of-mouth: A reality check for book reviews. Decision Support Systems 50(3):627–635.Crossref, Google Scholar
• Hyman HH , Sheatsley PB (1950) The current status of American public opinion. Payne JC, ed. The Teaching of Contemporary Affairs: Twenty-First Yearbook of the National Council for the Social Studies (National Education Association, New York), 11–34.Google Scholar
• Ihaka R , Gentleman R (1996) R: A language for data analysis and graphics. J. Comput. Graphical Statist. 5(3):299–314.Google Scholar
• Jabine TB , Straff ML , Tanur JM , Tourangeau R (1984) Cognitive Aspects of Survey Methodology: Building a Bridge Between Disciplines (The National Academies Press, Washington, DC).Google Scholar
• Jiang Y , Guo H (2015) Design of consumer review systems and product pricing. Inform. Systems Res. 26(4):714–730.Link, Google Scholar
• Kanouse DE , Hanson LR Jr (1987) Negativity in evaluations. Jones EE, Kanouse DE, Kelley HH, Nisbett RE, Valins S, Weiner B, eds. Attribution: Perceiving the Causes of Behavior (Lawrence Erlbaum Associates, Hillsdale, NJ), 47–62.Google Scholar
• Keller KL (1987) Memory factors in advertising: The effect of advertising retrieval cues on brand evaluations. J. Consumer Res. 14(3):316–333.Crossref, Google Scholar
• Kittur A , Chi EH , Suh B (2008) Crowdsourcing user studies with Mechanical Turk. Proc. 2008 CHI Conf. Human Factors Comput. Systems (Florence, Italy), 453–456.Google Scholar
• Kumar N , Benbasat I (2006) The influence of recommendations and consumer reviews on evaluations of websites. Inform. Systems Res. 17(4):425–439.Link, Google Scholar
• Kwark Y , Chen J , Raghunathan S (2014) Online product reviews: Implications for retailers and competing manufacturers. Inform. Systems Res. 25(1):93–110.Link, Google Scholar
• Lee YJ , Hosanagar K , Tan Y (2015) Do I follow my friends or the crowd? Information cascades in online movie ratings. Management Sci. 61(9):2241–2258.Link, Google Scholar
• Li X , Hitt LM (2008) Self-selection and information role of online product reviews. Inform. Systems Res. 19(4):456–474.Link, Google Scholar
• Liu Y (2006) Word of mouth for movies: Its dynamics and impact on box office revenue. J. Marketing 70(3):74–89.Crossref, Google Scholar
• Liu Y , Chen PY , Hong Y (2014) Value of multi-dimensional rating systems: An information transfer view. Proc. Internat. Conf. Inform. Systems (Auckland, New Zealand), 1–18.Google Scholar
• Matlin MW , Stang DJ (1978) The Pollyanna Principle: Selectivity in Language, Memory, and Thought (Schenkman, Cambridge, UK).Google Scholar
• McCloskey H (2015) The 1-2-3’s of A/B testing: An intro to split and multivariate tests for product managers. https://community.uservoice.com/blog/ab-split-testing-product.Google Scholar
• Moe WW , Schweidel DA (2012) Online product opinions: Incidence, evaluation, and evolution. Marketing Sci. 31(3):372–386.Link, Google Scholar
• Moe WW , Trusov M (2011) The value of social dynamics in online product ratings forums. J. Marketing Res. 48(3):444–456.Crossref, Google Scholar
• Muchnik L , Aral S , Taylor SJ (2013) Social influence bias: A randomized experiment. Sci . 341(6146):647–651.Crossref, Google Scholar
• Mudambi SM , Schuff D (2010) What makes a helpful online review? A study of customer reviews on Amazon.com. Management Inform. Systems Quart. 34(1):185–200.Crossref, Google Scholar
• Parasuraman A , Zeithaml VA , Berry LL (1988) SERVQUAL—A multiple-item scale for measuring consumer perceptions of service quality. J. Retailing 64(1):12–40.Google Scholar
• Pavlou PA , Gefen D (2004) Building effective online marketplaces with institution-based trust. Inform. Systems Res. 15(1):37–59.Link, Google Scholar
• Peterson RA , Wilson WR (1992) Measuring customer satisfaction: Fact and artifact. J. Acad. Marketing Sci. 20(1):61–71.Crossref, Google Scholar
• Resnick P , Zeckhauser R , Friedman E , Kuwabara K (2000) Reputation systems. Comm. ACM . 43(12):45–48.Crossref, Google Scholar
• Schlosser AE (2005) Posting vs. lurking: Communicating in a multiple audience context. J. Consumer Res. 32(2):260–265.Crossref, Google Scholar
• Schuman H , Ludwig J (1982) The norm of even-handedness in surveys as in life. Amer. Sociol. Rev. 48(1):112–120.Crossref, Google Scholar
• Schwarz N (1998) Accessible content and accessibility experiences: The interplay of declarative and experiential information in judgment. Personality Soc. Psych. Rev. 2(2):87–99.Crossref, Google Scholar
• Schwarz N (1999) Self-reports: How the questions shape the answers. Amer. Psych. 54(2):93–105.Crossref, Google Scholar
• Schwarz N , Bless H (2007) Mental construal processes: The inclusion/exclusion model. Stapel D, Suls J, eds. Assimilation and Contrast in Social Psychology (Psychology Press, Philadelphia), 119–141.Google Scholar
• Schwarz N , Hippler HJ (1995) Subsequent questions may influence answers to preceding questions in mail surveys. Public Opinion Quart. 59(1):93–97.Crossref, Google Scholar
• Schwarz N , Strack F (1991) Context effects in attitude surveys: Applying cognitive theory to social research. Eur. Rev. Soc. Psych. 2(1):31–50.Crossref, Google Scholar
• Schwarz N , Strack F , Mai HP (1991) Assimilation and contrast effects in part-whole question sequences: A conversational logic analysis. Public Opinion Quart. 55(1):3–23.Crossref, Google Scholar
• Sherman SJ , Ahlm K , Berman L , Lynn SJ (1978) Contrast effects and their relationship to subsequent behavior. J. Experiment. Soc. Psych. 14(4):340–350.Crossref, Google Scholar
• Simonson I (2016) Imperfect progress: An objective quality assessment of the role of user reviews in consumer decision making, a commentary on de Langhe, Fernbach, and Lichtenstein. J. Consumer Res. 42(6):840–845.Crossref, Google Scholar
• Siroker D , Koomen P (2015) A/B Testing: The Most Powerful Way to Turn Clicks into Costumers (John Wiley & Sons, Hoboken, NJ).Google Scholar
• Smith A , Anderson M (2016) Online Shopping and E-commerce . Technical report, Pew Research Center, Washington, DC.Google Scholar
• Srull TK , Wyer RS (1979) The role of category accessibility in the interpretation of information about persons: Some determinants and implications. J. Personality Soc. Psych. 37(10):1660–1672.Crossref, Google Scholar
• Stevens P , Knutson B , Patton M (1995) DINESERV: A tool for measuring service quality in restaurants. Cornell Hotel Restaurant Admin. Quart. 36(2):56–60.Crossref, Google Scholar
• Sudman S , Bradburn NM , Schwarz N (1996) Thinking About Answers: The Application of Cognitive Processes to Survey Methodology (Jossey-Bass, San Francisco).Google Scholar
• Sundaram DS , Mitra K , Webster C (1998) Word-of-mouth communications: A motivational analysis. Adv. Consumer Res. 25:527–531.Google Scholar
• Surowiecki J (2004) The Wisdom of Crowds (Little, Brown and Company, New York).Google Scholar
• Thaler RH , Sunstein CR , Balz JP (2012) Choice architecture. Shafir E, ed. Behavioral Foundations of Public Policy (University Press Group, West Sussex, UK), 428–439.Google Scholar
• Tourangeau R , Rasinski KA (1988) Cognitive processes underlying context effects in attitude measurement. Psych. Bull. 103(3):299–314.Crossref, Google Scholar
• Tsekouras D (2015) Variations on a rating scale: The effect on extreme response tendency in product ratings. Proc. Eur. Conf. Inform. Systems (Münster, Germany), 1–16.Google Scholar
• Tsekouras D (2017) The effect of rating scale design on extreme response tendency in consumer product ratings. Internat. J. Electronic Commerce 21(2):270–296.Crossref, Google Scholar
• Tunc MM , Cavusoglu H , Raghunathan S (2017) Single-dimensional vs. multi-dimensional product ratings in online marketplaces for experience goods. Proc. Internat. Conf. Inform. Systems (Seoul, South Korea), 1–16.Google Scholar
• Wang A , Zhang M , Hann IH (2018) Socially nudged: A quasi-experimental study of friends’ social influence in online product ratings. Inform. Systems Res. 29(3):641–655.Link, Google Scholar
• Whelan S , Wohlfeil M (2006) Communicating brands through engagement with “lived” experiences. J. Brand Management 13(4–5):313–329.Crossref, Google Scholar
• Wyer RS , Srull TK (1986) Human cognition in its social context. Psych. Rev. 93(3):322–359.Crossref, Google Scholar
• Zhu F , Zhang XM (2010) Impact of online consumer reviews on sales: The moderating role of product and consumer characteristics. J. Marketing 74(2):133–148.Crossref, Google Scholar