An Axiomatic Approach to Expert Resolution

Peter A. Morris
Peter A. Morris
Applied Decision Analysis, Inc., Menlo Park, California
Search for more papers by this author

Applied Decision Analysis, Inc., Menlo Park, California

Published Online:1 Jan 1983https://doi.org/10.1287/mnsc.29.1.24

Abstract

This paper proposes a set of axioms for combining expert probability assessments. The axioms provide a framework for understanding previous results, and are used to derive a new method for combining event probabilities from different sources into a single estimate.

Cited by
- Three and a half stages of crowd wisdom
  30 March 2026 | Collective Intelligence, Vol. 5, No. 1
- Forecasts as repeated cheap talk from an expert of unknown statistical bias
  Journal of Economic Behavior & Organization, Vol. 233
- Opinion Pooling
  30 January 2025 | , Vol. 178
- Updating on the evidence of others
  10 August 2024 | Philosophical Studies, Vol. 181, No. 10
- RETRACTED ARTICLE: Prescriptive analytics applications in sustainable operations research: conceptual framework and future research challenges
  1 March 2023 | Annals of Operations Research, Vol. 337, No. S1
- Geometric Pooling: A User's Guide
  17 August 2023 | The British Journal for the Philosophy of Science, Vol. 16
- Review of Probability Elicitation and Examination of Approaches for Large Bayesian Networks
- The Epistemology of Disagreement: Why Not Bayesianism?
  13 September 2019 | Episteme, Vol. 18, No. 4
- A survey of human judgement and quantitative forecasting methods
  24 February 2021 | Royal Society Open Science, Vol. 8, No. 2
- Assessing the relevance of an information source to trading from an adaptive-markets hypothesis perspective
  7 April 2020 | Quantitative Finance, Vol. 20, No. 7
- Expert Judgment Based Nuclear Threat Assessment for Vessels Arriving in the US
  18 November 2017
- Revisiting the Relevance of Financial-Statement for CDS Trading From an Adaptive-Markets Hypothesis Perspective
  SSRN Electronic Journal, Vol. 84
- Deriving the probability of a linear opinion pooling method being superior to a set of alternatives
  Reliability Engineering & System Safety, Vol. 158
- Information Markets, Elections and Threshold Contracts
  8 April 2017
- Some Contributions of Integrated Assessment Models of Global Climate Change
  Review of Environmental Economics and Policy, Vol. 11, No. 1
- Elicitation
  5 August 2016
- Autonomy: Risk Assessment
- Integrated assessment of climate change: state of the literature
  27 May 2015 | Journal of Benefit-Cost Analysis, Vol. 5, No. 03
- Elicitation
  29 September 2014
- Well‐Calibrated Forecasts
  29 September 2014
- Aggregation of forecasts from multiple simulation models
- The expert problem: a survey
  10 July 2013 | Economics of Governance, Vol. 14, No. 4
- Unraveling Short- and Farsightedness in Politics
  SSRN Electronic Journal, Vol. 37
- Flexible pensions for politicians
  19 December 2009 | Public Choice, Vol. 145, No. 1-2
- A Kullback-Leibler View of Linear and Log-Linear Pools
  Ali E. Abbas,
  6 February 2009 | Decision Analysis, Vol. 6, No. 1
- Getting the Right Mix of Experts
  Jason R. W. Merrick,
  1 March 2008 | Decision Analysis, Vol. 5, No. 1
- Aggregating Probability Distributions
- Experts and Non-Experts
  SSRN Electronic Journal, Vol. 86
- To Bayes or Not to Bayes? A Comparison of Two Classes of Models of Information Aggregation
  David V. Budescu,
  Hsiu-Ting Yu,
  1 September 2006 | Decision Analysis, Vol. 3, No. 3
- MULTIPLICATIVE PROPERTIES IN EVALUATION OF DECISION TREES
  21 November 2011 | International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems, Vol. 14, No. 03
- Elections, Contracts and Markets
  SSRN Electronic Journal, Vol. 14
- Confidence in Aggregation of Opinions from Multiple Sources
- Elicitation
  15 August 2006
- Well‐Calibrated Forecasts
  15 August 2006
- Information markets vs. opinion pools
  5 June 2005
- Analysis of Correlated Expert Judgments from Extended Pairwise Comparisons
  Jason R. W. Merrick,
  J. Rene van Dorp,
  Amita Singh,
  1 March 2005 | Decision Analysis, Vol. 2, No. 1
- Elicitation
  15 October 2004
- Well‐Calibrated Forecasts
  15 October 2004
- The myth of purchasing professionals’ expertise. More evidence on whether computers can make better procurement decisions
  Journal of Purchasing and Supply Management, Vol. 10, No. 4-5
- Anniversary Article: Decision Analysis in Management Science
  James E. Smith,
  Detlof von Winterfeldt,
  1 May 2004 | Management Science, Vol. 50, No. 5
- Averaging probability judgments: Monte Carlo analyses of asymptotic diagnostic value
  11 April 2001 | Journal of Behavioral Decision Making, Vol. 14, No. 2
- Fiducial inference in combining expert judgements
  Statistical Methods & Applications, Vol. 10, No. 1-3
- Understanding pooled subjective probability estimates
  Mathematical Social Sciences, Vol. 41, No. 1
- Combining Probability Distributions From Experts in Risk Analysis
  29 May 2006 | Risk Analysis, Vol. 19, No. 2
- Subjective estimation of the delay time distribution in maintenance modelling
  European Journal of Operational Research, Vol. 99, No. 3
- Modeling and fusing uncertain multi-sensory data
  Journal of Robotic Systems, Vol. 13, No. 2
- Catastrophe Risk Analysis in Technical Systems Using Bayesian Statistics
- Coherent combination of experts' opinions
  Test, Vol. 4, No. 2
- Risk analysis of catastrophes using experts' judgements: An empirical study on risk analysis of major civil aircraft accidents in Europe
  European Journal of Operational Research, Vol. 87, No. 3
- The search for information — A patient perspective on multiple opinions
  European Journal of Operational Research, Vol. 85, No. 2
- Modelling Probabilistic Agent Opinion
  5 December 2018 | Journal of the Royal Statistical Society Series B: Statistical Methodology, Vol. 54, No. 1
- A theoretical justification for Japanese nemawashi / ringi group decision making and an implementation of a nemawashi / ringi group decision support system
  Decision Support Systems, Vol. 8, No. 2
- A multi-run interactive method for bicriterion optimization problems
  Naval Research Logistics, Vol. 39, No. 1
- Experience with probabilistic risk assessment in the nuclear power industry
  Journal of Hazardous Materials, Vol. 29, No. 3
- A review of expert judgment techniques with reference to nuclear safety
  Progress in Nuclear Energy, Vol. 27, No. 2-3
- Bayesian modeling of expert-to-expert variability and dependence in estimating rare event frequencies
  Reliability Engineering & System Safety, Vol. 38, No. 1-2
- Consensus theoretic classification methods
  IEEE Transactions on Systems, Man, and Cybernetics, Vol. 22, No. 4
- Expert judgment in maintenance optimization
  IEEE Transactions on Reliability, Vol. 41, No. 3
- Measures of confidence associated with combining classification results
  IEEE Transactions on Systems, Man, and Cybernetics, Vol. 21, No. 3
- Integration of linguistic probabilities
  International Journal of Man-Machine Studies, Vol. 33, No. 6
- The expected value of frequency calibration
  Organizational Behavior and Human Decision Processes, Vol. 46, No. 1
- A combination of expert opinion approach to probabilistic information retrieval, part 1: The conceptual model
  Information Processing & Management, Vol. 26, No. 3
- A combination of expert opinion approach to probabilistic information retrieval, part 2: Mathematical treatment of CEO model 3
  Information Processing & Management, Vol. 26, No. 3
- Eliciting and Combining Subjective Judgments About Uncertainty
  10 March 2009 | International Journal of Technology Assessment in Health Care, Vol. 5, No. 4
- Image analysis in quantitative cytopathology and histopathology
  Human Pathology, Vol. 20, No. 6
- A model of decision-making involving two information processors
  Computer Science in Economics and Management, Vol. 2, No. 2
- Filtering information from human experts
  IEEE Transactions on Systems, Man, and Cybernetics, Vol. 19, No. 1
- On the Aggregation of Expert Probability Distributions
  IFAC Proceedings Volumes, Vol. 21, No. 19
- ORTHOGONAL INFORMATION STRUCTURES—A MODEL TO EVALUATE THE INFORMATION PROVIDED BY A SECOND OPINION
  7 June 2007 | Decision Sciences, Vol. 19, No. 2
- Impact scaling: Method and application
  Technological Forecasting and Social Change, Vol. 32, No. 3
- On Combining Expert Opinions
  American Journal of Mathematical and Management Sciences, Vol. 7, No. 3-4
- Conflicting information integration for decision support
  Decision Support Systems, Vol. 2, No. 4
- Probability and uncertainty in nuclear safety decisions
  Nuclear Engineering and Design, Vol. 93, No. 2-3
- Combining Individual Judgments
- A Conflict between Two Axioms for Combining Subjective Distributions
  5 December 2018 | Journal of the Royal Statistical Society Series B: Statistical Methodology, Vol. 46, No. 3

Volume 29, Issue 1

January 1983

Pages 1-150

Article Information

Metrics

Information

Published Online:January 01, 1983

Cite as

Peter A. Morris, (1983) An Axiomatic Approach to Expert Resolution. Management Science 29(1):24-32.

https://doi.org/10.1287/mnsc.29.1.24

Keywords

PDF download

Available Issues

Available Issues

Available Issues

Available Issues

Available Issues

Available Issues

Available Issues

Available Issues

Available Issues

An Axiomatic Approach to Expert Resolution

Abstract

Volume 29, Issue 1

Article Information

Metrics

Information

Cite as

Keywords

Sign Up for INFORMS Publications Updates and News