Research Note—The Halo Effect in Multicomponent Ratings and Its Implications for Recommender Systems: The Case of Yahoo! Movies

References

• Adomavicius G., Kwon Y. O. New recommendation techniques for multicriteria rating systems. IEEE Intelligent Systems (2007) 22(3):48–55Crossref, Google Scholar
• Adomavicius G., Tuzhilin A. Toward the next generation of recommender systems: A survey of the state-of-the-art and possible extensions. IEEE Trans. Knowledge Data Engrg. (2005) 17(6):734–749Crossref, Google Scholar
• Adomavicius G., Sankaranarayanan R., Sen S., Tuzhilin A. Incorporating contextual information in recommender systems using a multidimensional approach. ACM Trans. Information Systems (2005) 23(1):103–145Crossref, Google Scholar
• Baeza-Yates R. A., Ribeiro-Neto B. A.Modern Information Retrieval (1999) (ACM Press, Addison-Wesley, New York) Google Scholar
• Billsus D., Pazzani M. J.Learning Collaborative Information Filters (1998) (Morgan Kaufmann Publishers, San Francisco) Google Scholar
• Borgatta E. F., Mann J. H., Cottrell L. S. The spectrum of individual interaction characteristics: An interdimensional analysis. Psych. Rep. (1958) 4:279–319Crossref, Google Scholar
• Borman W. C. Format and training effects on rating accuracy. J. Appl. Psych. (1979) 64(4):410–421Crossref, Google Scholar
• Breese J. S., Heckerman D., Kadie C. Empirical analysis of predictive algorithms for collaborative filtering. (1998) . Technical report, Microsoft Research, Redmond, WAGoogle Scholar
• Chien Y. H., George E. I. A Bayesian model for collaborative filtering. Proc. 7th Internat. Workshop on Artificial Intelligence Statist. (1999) FT Lauderdale, FL http://uncertainty99.microsoft.com/proceedings.comGoogle Scholar
• Chow C. K., Liu C. N. Approximating discrete probability distributions with dependence trees. IEEE Trans. Information Theory (1968) 14(3):462–467Crossref, Google Scholar
• Cooper W. H. Ubiquitous halo. Psych. Bull. (1981) 90(2):218–244Crossref, Google Scholar
• Dempster A. P., Laird N. M., Rubin D. B. Maximum likelihood from incomplete data via the EM algorithm. J. Roy. Statist. Soc. (1977) 39(1):1–38Google Scholar
• Feeley T. H. Comment on halo effects in rating and evaluation research. Human Comm. Res. (2002) 28(4):578–586Crossref, Google Scholar
• Fisicaro S. A. A reexamination of the relation between halo error and accuracy. J. Appl. Psych. (1988) 73(2):239–244Crossref, Google Scholar
• Getoor L., Sahami M. Using probabilistic relational models for collaborative filtering. Workshop on Web Usage Analysis User Profiling (WEBKDD'99) (1999) San DiegoGoogle Scholar
• Green P. E., Srinivasan V. Conjoint analysis in consumer research: Issues and outlook. J. Consumer Res. (1978) 5(2):103–123Crossref, Google Scholar
• Heckerman D., Chickering D. M., Meek C., Rounthwaite R., Kadie C. Dependency networks for inference, collaborative filtering, and data visualization. J. Machine Learn. Res. (2001) 1:49–75Google Scholar
• Heneman H. G. Comparision of self and superior ratings of managerial performance. J. Appl. Psych. (1974) 59(5):638–642Crossref, Google Scholar
• Herlocker J. L., Konstan J. A., Terveen L. G., Riedl J. T. Evaluating collaborative filtering recommender systems. ACM Trans. Inform. Systems (2004) 22(1):5–53Crossref, Google Scholar
• Hofmann T. Latent semantic models for collaborative filtering. ACM Trans. Inform. Systems (TOIS) (2004) 22(1):89–115Crossref, Google Scholar
• Hofmann T., Puzicha J., Thomas D. Latent class models for collaborative filtering. Proc. 16th Internat. Joint Conf. Artificial Intelligence (IJCAI-99-Vol2) (1999) (Morgan Kaufmann Publishers, San Francisco) 688–693Google Scholar
• Holzbach R. L. Rater bias in performance ratings: Superior, self, and peer ratings. J. Appl. Psych. (1978) 63(5):579–588Crossref, Google Scholar
• Ivancevich J. M. Longtudinal study of the effects of rater training on psychometric error in ratings. J. Appl. Psych. (1979) 64(5):502–508Crossref, Google Scholar
• Kafry D., Zedeck S., Jacobs R. Discriminability in multidimensional performance evaluations. Appl. Psych. Measurement (1979) 3(2):187–192Crossref, Google Scholar
• Kevin R. M., Reynolds D. H. Does true halo affect observed halo? J. Appl. Psych. (1988) 73(2):235–238Crossref, Google Scholar
• Koller D., Friedman N.Structured Probabilistic Models: Principles and Techniques (2009) (MIT Press, Cambridge, MA) Google Scholar
• Koltuv B. B. Some characteristics of intrajudge trait intercorrelations. Psych. Monograph (1962) 76:1–24Crossref, Google Scholar
• Landy F. J., Farr J. L. Performance rating. Psych. Bull. (1980) 87(1):72–107Crossref, Google Scholar
• Landy F. J., Vance R. J., Barnes-Farrell J. L., Steele J. W. Statistical control of halo error in performance ratings. J. Appl. Psych. (1980) 65(5):501–506Crossref, Google Scholar
• Latham G. P., Pursell E. D., Wexley K. N. Training managers to minimize rating errors in observation of behavior. J. Appl. Psych. (1980) 60(5):550–555Crossref, Google Scholar
• Lee H. H., Teng W. G. Incorporating multi-criteria ratings in recommendation systems. IEEE Internat. Conf. Inform. Reuse and Integration (2007) Las Vegas, NV:273–278Crossref, Google Scholar
• MacKay D. J. C.Information Theory, Inference, and Learning Algorithms (2003) (Cambridge University Press, New York) Google Scholar
• Mahalanobis P. C. On the generalised distance in statistics. Proc. Natl. Inst. Sci. (1936) 2(1):49–55Google Scholar
• Mitchell T.Machine Learning (1997) (McGraw-Hill Book Company, New York) Google Scholar
• Moon S., Russell G. J. Predicting product purchase from inferred customer similarity: An autologistic model approach. Management Sci. (2008) 54(1):71–82Link, Google Scholar
• Morrison D. F.Multivariate Statistical Methods (1967) (McGraw-Hill Book Company, New York) Google Scholar
• Myers J. H. Removing halo from job evaluation factor structure. J. Appl. Psych. (1965) 49(3):217–221Crossref, Google Scholar
• Netflix, Inc. Form 10-K annual report pursuant to Section 13 or 15(d) of the Securities Exchange Act of 1934. (2006) . United States Securities and Exchange Commission, Washington, DCGoogle Scholar
• Friedman N., Goldszmidt M.Learning in Graphical Models (1998) (Kluwer Academic Publishers, Dordrecht, The Netherlands) 431–432Chapter 15Google Scholar
• Pearl J.Causality: Models, Reasoning, and Inference (2000) (Cambridge University Press, New York) Google Scholar
• Resnick P., Iacovou N., Suchak M., Bergstrom P., Riedl J. GroupLens: An open architecture for collaborative filtering of netnews. Proc. Conf. Comput.-Supported Cooperative Work, CSCW'94 (1994) Chapel Hill, NC:175–186Crossref, Google Scholar
• Rizzo W. A., Frank F. D. Influence of irrelevant cues and alternate forms of graphic rating scales on the halo effect. Personnel Psych. (1977) 30(3):405–417Crossref, Google Scholar
• Shardanand U., Maes P. Social information filtering: Algorithms for automating “word of mouth”. In CHI: Proc. SIGCHI Conf. Human Factors Computing Systems (1995) (ACM Press/Addison-Wesley Publishing, New York) 210–217Crossref, Google Scholar
• Shweder R. A. How relevant is an individual difference in personality? J. Personality (1975) 43(3):455–484Crossref, Google Scholar
• Shweder R. A., D'Andrade R. G., Schweder R. A., Fiske D. W. The systematic distortion hypothesis. New Directions for Methodology of Behavioral Science: Fallible Judgment Behavioral Res. (1980) (Jossey Bass, San Franciso) 37–58Google Scholar
• Si L., Jin R. Flexible mixture model for collaborative filtering. Proc. Twentieth Internat. Conf. Machine Learning (ICML) (2003) (AAAI Press, San Francisco) 704–711Google Scholar
• Thorndike E. L. A constant error in psychological ratings. J. Appl. Psych. (1920) 4(1):25–29Crossref, Google Scholar
• Ungar L. H., Foster D. P. Clustering methods for collaborative filtering. Proc. Workshop Recommendation Systems (1998) (AAAI, Menlo Park, CA) 112–125Google Scholar
• Voorhees E. M. The TREC-8 question answering track report. Proc. Eighth Text Retrieval Conf. (2000) Gaithersburg, MD:77–82 http://trec.nist.gov/pubs/trec8/t8_proceedings.htmlCrossref, Google Scholar
• Wells F. L., Woodworth R. S.A Statistical Study of Literary Merit (1907) (Science Press, New York) Google Scholar