Are We Wise About the Wisdom of Crowds? The Use of Group Judgments in Belief Revision

Published Online:https://doi.org/10.1287/mnsc.1090.1031

References

  • Allen V. L. Situational factors in conformity. Adv. Experiment. Soc. Psych. (1965) 2(3):133–175CrossrefGoogle Scholar
  • Armstrong J. S.Principles of Forecasting: A Handbook for Researchers and Practitioners (2001) (Kluwer Academic, Boston) CrossrefGoogle Scholar
  • Asch S. E., Guetzkow H. S. Effects of group pressure on the modification and distortion of judgments. Groups, Leadership and Men: Research in Human Relations (1951) (Carnegie Press, Pittsburgh) 177–190Google Scholar
  • Birnbaum M. H., Stegner S. E. Source credibility in social judgment: Bias, expertise, and the judge's point of view. J. Personality Soc. Psych. (1979) 37(1):48–74CrossrefGoogle Scholar
  • Bonaccio S., Dalal R. S. Advice taking and decision-making: An integrative literature review, and implications for the organizational sciences. Organ. Behav. Human Decision Processes (2006) 101(2):127–151CrossrefGoogle Scholar
  • Bond R. Group size and conformity. Group Processes Intergroup Relations (2005) 8(4):331–354CrossrefGoogle Scholar
  • Braver S. L., Sheets V. L. Monotonic hypotheses in multiple group designs: A Monte Carlo study. Psych. Bull. (1993) 113(2):379–395CrossrefGoogle Scholar
  • Brunswik E. Representative design and probabilistic theory in a functional psychology. Psych. Rev. (1955) 62(3):193–217CrossrefGoogle Scholar
  • Budescu D. V., Fiedler K., Juslin P. Confidence in aggregation of opinions from multiple sources. Information Sampling and Adaptive Cognition (2006) (Cambridge University Press, New York) 327–352Google Scholar
  • Budescu D. V., Rantilla A. K. Confidence in aggregation of expert opinions. Acta Psychologica (2000) 104(3):371–398CrossrefGoogle Scholar
  • Budescu D. V., Rantilla A. K., Yu H. T., Karelitz T. M. The effects of asymmetry among advisors on the aggregation of their opinions. Organ. Behav. Human Decision Processes (2003) 90(1):178–194CrossrefGoogle Scholar
  • Campbell J. D., Fairey P. J. Informational and normative routes to conformity: The effect of faction size as a function of norm extremity and attention to the stimulus. J. Personality Soc. Psych. (1989) 57(3):457–468CrossrefGoogle Scholar
  • Clemen R. T. Combining forecasts: A review and annotated bibliography. Int. J. Forecasting (1989) 5(4):559–583CrossrefGoogle Scholar
  • Cooksey R. W.Judgment Analysis: Theory, Methods, and Applications (1996) (Academic Press, San Diego) Google Scholar
  • Darke P. R., Chaiken S., Bohner G., Einwiller S., Erb H. P., Hazlewood J. D. Accuracy motivation, consensus information, and the law of large numbers: Effects on attitude judgment in the absence of argumentation. Pers. Soc. Psych. Bull. (1998) 24(11):1205–1215CrossrefGoogle Scholar
  • Dawes R. M., Corrigan B. Linear models in decision making. Psych. Bull. (1974) 81(2):95–106CrossrefGoogle Scholar
  • Deutsch M., Gerard H. B. A study of normative and informational social influences upon individual judgment. J. Abnormal Soc. Psych. (1955) 51:629–636CrossrefGoogle Scholar
  • Devine D. J., Clayton L. D., Philips J. L., Dunford B. B., Melner S. B. Teams in organizations: Prevalence, characteristics, and effectiveness. Small Group Res. (1999) 30(6):678–711CrossrefGoogle Scholar
  • Economist, The Market, market, on the wall. (2005) December 10):12Google Scholar
  • Edwards W., Kahneman D., Slovic P., Tversky A. Conservatism in human information processing. Judgment Under Uncertainty: Heuristics and Biases (1982) (Cambridge University Press, Cambridge, UK) 359–369CrossrefGoogle Scholar
  • Einhorn H. J., Hogarth R. M. Unit weighting schemes for decision making. Organ. Behav. Human Performance (1975) 13(2):171–192CrossrefGoogle Scholar
  • Einhorn H. J., Hogarth R. M., Klempner E. Quality of group judgment. Psych. Bull. (1977) 84(1):158–172CrossrefGoogle Scholar
  • Festinger L. A theory of social comparison processes. Human Relations (1954) 7(2):117–140CrossrefGoogle Scholar
  • Fischer I., Harvey N. Combining forecasts: What information do judges need to outperform the simple average? Int. J. Forecasting (1999) 15(3):227–246CrossrefGoogle Scholar
  • Gigone D., Hastie R. Proper analysis of the accuracy of group judgments. Psych. Bull. (1997) 121(1):149–167CrossrefGoogle Scholar
  • Goldberg S. C. Three situational determinants of conformity to social norms. J. Abnormal Soc. Psych. (1954) 49(3):325–329CrossrefGoogle Scholar
  • Harvey N., Fischer I. Taking advice: Accepting help, improving judgment, and sharing responsibility. Organ. Behav. Human Decision Processes (1997) 70(2):117–133CrossrefGoogle Scholar
  • Harvey N., Harries C. Effects of judges' forecasting on their later combination of forecasts for the same outcomes. Int. J. Forecasting (2004) 20(3):391–409CrossrefGoogle Scholar
  • Harvey N., Harries C., Fischer I. Using advice and assessing its quality. Organ. Behav. Human Decision Processes (2000) 81(2):252–273CrossrefGoogle Scholar
  • Hastie R., Grofman B., Owen G. Experimental evidence on group accuracy. Information Pooling and Group Decision Making (1986) 2(JAI Press, London) 129–157Google Scholar
  • Hill G. W. Group versus individual performance: Are N + 1 heads better than one? Psych. Bull. (1982) 91(3):517–539CrossrefGoogle Scholar
  • Hinsz V. B., Tindale R. S., Vollrath D. A. The emerging conceptualization of groups as information processors. Psych. Bull. (1997) 121(1):43–64CrossrefGoogle Scholar
  • Hoffman P. J. The paramorphic representation of clinical judgment. Psych. Bull. (1960) 57(2):116–131CrossrefGoogle Scholar
  • Hogarth R. M. Note on aggregating opinions. Organ. Behav. Human Performance (1978) 21(1):40–46CrossrefGoogle Scholar
  • Hogarth R. M., Einhorn H. J. Order effects in belief updating: The belief-adjustment model. Cognitive Psych. (1992) 24(1):1–55CrossrefGoogle Scholar
  • Hsee C. K., Rottenstreich Y., Xiao Z. X. When is more better? On the relationship between magnitude and subjective value. Current Directions Psych. Sci. (2005) 14(5):234–237CrossrefGoogle Scholar
  • Hsee C. K., Loewenstein G. F., Blount S., Bazerman M. H. Preference reversals between joint and separate evaluations of options: A review and theoretical analysis. Psych. Bull. (1999) 125(5):576–590CrossrefGoogle Scholar
  • Jenness A. The role of discussion in changing opinion regarding a matter of fact. J. Abnormal Soc. Psych. (1932) 27(3):279–296CrossrefGoogle Scholar
  • Kaplan M. F. Task, situational, and personal determinants of influence processes in groups decision making. Adv. Group Processes (1989) 6:87–105Google Scholar
  • Kelman H. C. Compliance, identification, and internalization: Three processes of attitude change. J. Conflict Resolution (1958) 2(1):51–60CrossrefGoogle Scholar
  • Keppel G.Design and Analysis: A Researcher's Handbook (1982) 2nd ed.(Prentice-Hall, Englewood Cliffs, NJ) Google Scholar
  • Koehler D. J., Beauregard T. A. Illusion of confirmation from exposure to another's hypothesis. J. Behav. Decision Making (2006) 19(1):61–78CrossrefGoogle Scholar
  • Larrick R. P., Soll J. B. Intuitions about combining opinions: Misappreciation of the averaging principle. Management Sci. (2006) 52(1):111–127LinkGoogle Scholar
  • Latané B. The psychology of social impact. Amer. Psychologist (1981) 36(4):343–356CrossrefGoogle Scholar
  • Latané B., Wolf S. The social impact of majorities and minorities. Psych. Rev. (1981) 88(5):438–453CrossrefGoogle Scholar
  • Libby R., Blashfield R. K. Performance of a composite as a function of the number of judges. Organ. Behav. Human Decision Processes (1978) 21(2):121–129CrossrefGoogle Scholar
  • Lim J. S., O'Connor M. Judgmental adjustment of initial forecasts: Its effectiveness and biases. J. Behav. Decision Making (1995) 8(3):149–168CrossrefGoogle Scholar
  • Maines L. A. An experimental examination of subjective forecast combination. Int. J. Forecasting (1996) 12(2):223–233CrossrefGoogle Scholar
  • Milgram S. Liberating effects of group pressure. J. Personality Soc. Psych. (1965) 1(2):127–134CrossrefGoogle Scholar
  • Raudenbush S. W., Bryk A. S.Hierarchical Linear Models: Applications and Data Analysis Methods (2002) 2nd ed.(Sage Publications, Thousand Oaks, CA) Google Scholar
  • Schkade D. A., Kahneman D. Does living in California make people happy? A focusing illusion in judgments of life satisfaction. Psych. Sci. (1998) 9(5):340–346CrossrefGoogle Scholar
  • Sherif M. A study of some social factors in perception. Arch. Psych. (1935) 187:5–59Google Scholar
  • Sniezek J. A., Van Swol L. M. Trust, confidence, and expertise in a Judge-Advisor System. Organ. Behav. Human Decision Processes (2001) 84(2):288–307CrossrefGoogle Scholar
  • Soll J. B., Larrick R. P. Strategies for revising judgment: How (and how well) people use others' opinions. J. Exp. Psych.: Learn., Memory, Cognition (2009) 35(3):780–805CrossrefGoogle Scholar
  • Surowiecki J.The Wisdom of Crowds: Why the Many Are Smarter Than the Few and How Collective Wisdom Shapes Business, Economies, Societies, and Nations (2004) (Little, Brown, London) Google Scholar
  • Tajfel H., Lindzey G., Aronson E. Social and cultural factors in perception. The Handbook of Social Psychology (1969) 32nd ed.(Addison-Wesley, London) 315–394Google Scholar
  • Tanford S., Penrod S. Social influence model: A formal integration of research on majority and minority influence processes. Psych. Bull. (1984) 95(2):189–225CrossrefGoogle Scholar
  • Thaler R. H., Tversky A., Kahneman D. Toward a positive theory of consumer choice. Choices, Values, and Frames (2000) (Cambridge University Press, Cambridge, UK) 269–287CrossrefGoogle Scholar
  • Tversky A., Kahneman D. Belief in the law of small numbers. Psych. Bull. (1971) 76(2):105–110CrossrefGoogle Scholar
  • Tversky A., Kahneman D. Judgment under uncertainty: Heuristics and biases. Science (1974) 185:1124–1131CrossrefGoogle Scholar
  • Tversky A., Koehler D. J. Support theory: A nonextensional representation of subjective probability. Psych. Rev. (1994) 101(4):547–567CrossrefGoogle Scholar
  • Wilder D. A. Perception of groups, size of opposition, and social influence. J. Exper. Soc. Psych. (1977) 13(3):253–268CrossrefGoogle Scholar
  • Wilson T. D., Wheatley T., Meyers J. M., Gilbert D. T., Axsom D. Focalism: A source of durability bias in affective forecasting. J. Personality Soc. Psych. (2000) 78(5):821–836CrossrefGoogle Scholar
  • Yaniv I. Weighting and trimming: Heuristics for aggregating judgments under uncertainty. Organ. Behav. Human Decision Processes (1997) 69(3):237–249CrossrefGoogle Scholar
  • Yaniv I. Receiving other people's advice: Influence and benefit. Organ. Behav. Human Decision Processes (2004) 93(1):1–13CrossrefGoogle Scholar
  • Yaniv I., Kleinberger E. Advice taking in decision making: Egocentric discounting and reputation formation. Organ. Behav. Human Decision Processes (2000) 83(2):260–281CrossrefGoogle Scholar
  • Yaniv I., Milyavsky M. Using advice from multiple sources to revise and improve judgments. Organ. Behav. Human Decision Processes (2007) 103(1):104–120CrossrefGoogle Scholar
INFORMS site uses cookies to store information on your computer. Some are essential to make our site work; Others help us improve the user experience. By using this site, you consent to the placement of these cookies. Please read our Privacy Statement to learn more.