Some Comparisons among Quadratic, Spherical, and Logarithmic Scoring Rules

J. Eric Bickel
J. Eric Bickel
[email protected]
Department of Industrial and Systems Engineering, Texas A&M University, 236-B Zachry Engineering Center, 3131 TAMU, College Station, Texas 77843-3131
Search for more papers by this author

Department of Industrial and Systems Engineering, Texas A&M University, 236-B Zachry Engineering Center, 3131 TAMU, College Station, Texas 77843-3131

Search for more papers by this author

Published Online:1 Jun 2007https://doi.org/10.1287/deca.1070.0089

Supplemental Material

deca.1070.0089-sm-qsl_online_supplement.pdf (33 KB)

Cited by
- Decision-Tailored Uncertainty Quantification for Probability Estimates
  Zachary Smith,
  J. Eric Bickel,
  Richard Field
  Michael Darling
  20 May 2026 | Decision Analysis, Vol. 0, No. 0
- Predicting Lockean from gradational accuracy
  International Journal of Approximate Reasoning, Vol. 192
- Gender, Confidence, and the Mismeasure of Intelligence, Competitiveness, and Literacy
  Journal of Political Economy, Vol. 134, No. 2
- Variance and skewness in density forecasts: assessing world GDP growth
  19 April 2025 | Empirical Economics, Vol. 68, No. 6
- Assessing inference to the best explanation posteriors for the estimation of economic agent-based models
  International Journal of Approximate Reasoning, Vol. 180
- How to Conclude a Suspended Sports League?
  Ali Hassanzadeh,
  Mojtaba Hosseini,
  John G. Turner
  18 June 2024 | Manufacturing & Service Operations Management, Vol. 26, No. 5
- Trends in Decision Analysis: A Reflection on the First 20 Years of the Journal
  Vicki M. Bier
  4 March 2024 | Decision Analysis, Vol. 21, No. 1
- Evaluating the discrimination ability of proper multi-variate scoring rules
  18 March 2022 | Annals of Operations Research, Vol. 334, No. 1-3
- Integrating individual and social learning: accuracy and evolutionary viability
  26 December 2022 | Computational and Mathematical Organization Theory, Vol. 30, No. 1
- The Wisdom of Strategic Voting
  7 July 2023
- Epistemic Consequentialism, Veritism, and Scoring Rules
  10 June 2021 | Erkenntnis, Vol. 88, No. 4
- Financial risk assessment in shipping: a holistic machine learning based methodology
  4 January 2021 | Maritime Economics & Logistics, Vol. 25, No. 1
- Performance-Weighted Aggregation: Ferreting Out Wisdom Within the Crowd
  3 June 2023
- Drone imagery protocols to map vegetation are transferable between dryland sites across an elevational gradient
  28 December 2022 | Ecosphere, Vol. 13, No. 12
- Weighted Scoring Rules and Convex Risk Measures
  Zachary J. Smith,
  J. Eric Bickel
  11 January 2022 | Operations Research, Vol. 70, No. 6
- Evaluating Real-Time Probabilistic Forecasts With Application to National Basketball Association Outcome Prediction
  21 September 2021 | The American Statistician, Vol. 76, No. 3
- Forecasting: theory and practice
  International Journal of Forecasting, Vol. 38, No. 3
- Elicitability of Instance and Object Ranking
  Tino Werner
  25 January 2022 | Decision Analysis, Vol. 19, No. 2
- VIBE: A Design Space for VIsual Belief Elicitation in Data Journalism
  12 August 2022 | Computer Graphics Forum, Vol. 41, No. 3
- Securities Based Decision Markets
  11 January 2022
- Scoring, truthlikeness, and value
  28 April 2021 | Synthese, Vol. 199, No. 3-4
- Towards high quality mobile crowdsensing: Incentive mechanism design based on fine-grained ability reputation
  Computer Communications, Vol. 180
- A score-driven model of short-term demand forecasting for retail distribution centers
  Journal of Retailing, Vol. 97, No. 4
- Scoring Probability Forecasts by a User’s Bets Against a Market Consensus
  David Johnstone,
  Stewart Jones,
  Oliver Jones,
  Steve Tulig
  14 June 2021 | Decision Analysis, Vol. 18, No. 3
- Sysrev: A FAIR Platform for Data Curation and Systematic Evidence Review
  5 August 2021 | Frontiers in Artificial Intelligence, Vol. 4
- A Simulation-Based Approach to Understanding the Wisdom of Crowds Phenomenon in Aggregating Expert Judgment
  4 August 2020 | Business & Information Systems Engineering, Vol. 63, No. 4
- Guidelines for effective evaluation and comparison of wildland fire occurrence prediction models
  29 January 2021 | International Journal of Wildland Fire, Vol. 30, No. 4
- Predicting the causative pathogen among children with osteomyelitis using Bayesian networks – improving antibiotic selection in clinical practice
  Artificial Intelligence in Medicine, Vol. 107
- Additive Scoring Rules for Discrete Sample Spaces
  Zachary J. Smith,
  J. Eric Bickel
  16 March 2020 | Decision Analysis, Vol. 17, No. 2
- Will Coral Reefs in the North Atlantic Ocean Bleach During the Next Season? A Probabilistic Answer
  2 May 2020 | Geophysical Research Letters, Vol. 47, No. 9
- Scoring in context
  6 July 2018 | Synthese, Vol. 197, No. 4
- Bregman Divergence Bounds and Universality Properties of the Logarithmic Loss
  IEEE Transactions on Information Theory, Vol. 66, No. 3
- Machine learning workflows to estimate class probabilities for precision cancer diagnostics on DNA methylation microarray data
  13 January 2020 | Nature Protocols, Vol. 15, No. 2
- A Score for Probability Forecasts of Binary Events Based on the User’s Cost–Loss Relations
  15 January 2020 | Weather and Forecasting, Vol. 35, No. 1
- Probability Forecasts and Their Combination: A Research Perspective
  Robert L. Winkler,
  Yael Grushka-Cockayne,
  Kenneth C. Lichtendahl,
  Victor Richmond R. Jose
  6 November 2019 | Decision Analysis, Vol. 16, No. 4
- A Probability Scoring Rule for Simultaneous Events
  Andrew Grant,
  David Johnstone,
  Oh Kang Kwon
  12 November 2019 | Decision Analysis, Vol. 16, No. 4
- Proper scoring rules with general preferences: A dual characterization of optimal reports
  Games and Economic Behavior, Vol. 117
- Verification of Medium- to Long-Range Hydrological Forecasts
  5 January 2019
- Incentive compatibility in prediction markets: Costly actions and external incentives
  International Journal of Forecasting, Vol. 35, No. 1
- Accounting Theory as a Bayesian Discipline
  28 December 2018 | Foundations and Trends® in Accounting, Vol. 13, No. 1-2
- A Mechanism for Eliciting Second-Order Beliefs and the Inclination to Choose
  American Economic Journal: Microeconomics, Vol. 10, No. 2
- El Niño, Sea Surface Temperature Anomaly and Coral Bleaching in the South Atlantic: A Chain of Events Modeled With a Bayesian Approach
  13 April 2018 | Journal of Geophysical Research: Oceans, Vol. 123, No. 4
- Verification in the presence of observation errors: Bayesian point of view
  31 August 2018 | Quarterly Journal of the Royal Meteorological Society, Vol. 144, No. 713
- Hierarchical Fully Probabilistic Design for Deliberator-Based Merging in Multiple Participant Systems
  IEEE Transactions on Systems, Man, and Cybernetics: Systems, Vol. 48, No. 4
- Necessary and sufficient conditions of proper estimators based on self density ratio for unnormalized statistical models
  Neural Networks, Vol. 98
- Do managerial skills matter? An analysis of the impact of managerial features on performance for Italian football
  4 December 2017 | Journal of the Operational Research Society, Vol. 69, No. 2
- Performance Measures
  23 October 2018
- Verification of Medium- to Long-Range Hydrological Forecasts
  14 February 2018
- Averaging Probability Forecasts: Back to the Future
  SSRN Electronic Journal, Vol. 11
- LogitBoost autoregressive networks
  Computational Statistics & Data Analysis, Vol. 112
- Modeling Fixed Odds Betting For Future Event Prediction1
  1 June 2017 | MIS Quarterly, Vol. 41, No. 2
- An IRT forecasting model: linking proper scoring rules to item response theory
  1 January 2023 | Judgment and Decision Making, Vol. 12, No. 2
- Evaluating electronic health record data sources and algorithmic approaches to identify hypertensive individuals
  7 August 2016 | Journal of the American Medical Informatics Association, Vol. 24, No. 1
- An Overview of Applications of Proper Scoring Rules
  Arthur Carvalho
  11 November 2016 | Decision Analysis, Vol. 13, No. 4
- Inclusive Flavour Tagging Algorithm
  21 November 2016 | Journal of Physics: Conference Series, Vol. 762
- Hierarchical Bayesian LASSO for a negative binomial regression
  29 October 2015 | Journal of Statistical Computation and Simulation, Vol. 86, No. 11
- The Brier Rule Is not a Good Measure of Epistemic Utility (and Other Useful Facts about Epistemic Betterness)
  14 December 2015 | Australasian Journal of Philosophy, Vol. 94, No. 3
- Verification of Medium- to Long-Range Hydrological Forecasts
  11 December 2016
- THE USE OF ANNUAL MILEAGE AS A RATING VARIABLE
  18 December 2015 | ASTIN Bulletin, Vol. 46, No. 1
- The Future Prospects of Energy Technologies: Insights from Expert Elicitations
  SSRN Electronic Journal, Vol. 110
- Probabilistic estimation of link travel times in dynamic road networks
  3 November 2015
- Probabilistic Seasonal Prediction of Meteorological Drought Using the Bootstrap and Multivariate Information
  Journal of Applied Meteorology and Climatology, Vol. 54, No. 7
- On the assessment of reliability in probabilistic hydrometeorological event forecasting
  1 June 2015 | Water Resources Research, Vol. 51, No. 6
- Identifying Expertise to Extract the Wisdom of Crowds
  David V. Budescu,
  Eva Chen
  23 May 2014 | Management Science, Vol. 61, No. 2
- The Fundamental Nature of the Log Loss Function
  5 September 2015
- Modelling Fixed Odds Betting for Future Event Prediction
  SSRN Electronic Journal, Vol. 82
- Measuring and adjusting for overconfidence
  6 November 2013 | Decisions in Economics and Finance, Vol. 37, No. 2
- Bayesian Measures of Confirmation from Scoring Rules
  1 January 2022 | Philosophy of Science, Vol. 81, No. 1
- Choosing a Strictly Proper Scoring Rule
  Edgar C. Merkle,
  Mark Steyvers
  2 December 2013 | Decision Analysis, Vol. 10, No. 4
- From the Editor—Median Aggregation, Scoring Rules, Expert Forecasts, Choices with Binary Attributes, Portfolio with Dependent Projects, and Information Security
  Rakesh K. Sarin
  2 December 2013 | Decision Analysis, Vol. 10, No. 4
- Plastic Surgeon Expertise in Predicting Breast Reconstruction Outcomes for Patient Decision Analysis
  Plastic and Reconstructive Surgery Global Open, Vol. 1, No. 8
- Assessing performance and tradeoffs of bioforensic signature systems
- Contrasting probabilistic scoring rules
  Journal of Statistical Planning and Inference, Vol. 143, No. 10
- Decreasing Marginal Value of Information Under Symmetric Loss
  Sushil Bikhchandani,
  John W. Mamer
  9 October 2013 | Decision Analysis, Vol. 10, No. 3
- Testing the Conditions for Acquiring Intuitive Expertise in Judgment
  30 September 2013 | Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Vol. 57, No. 1
- An incentive compatible scoring rule for ordinal judgments of expected utility maximizers
  Economics Letters, Vol. 120, No. 2
- Assessing the quality of bioforensic signatures
- The construction of causal networks to estimate coral bleaching intensity
  Environmental Modelling & Software, Vol. 42
- From the Editors: Probability Approximations, Anti-Terrorism Strategy, and Bull's-Eye Display for Performance Feedback
  Rakesh K. Sarin,
  L. Robin Keller,
  1 March 2013 | Decision Analysis, Vol. 10, No. 1
- EPISTEMIC VALUE AND EPISTEMIC COMPROMISE: A REPLY TO MOSS
  25 March 2013 | Episteme, Vol. 10, No. 1
- Can theories be tested?
  9 January 2013
- Approaching utopia
  9 January 2013
- From the Editors—Brainstorming, Multiplicative Utilities, Partial Information on Probabilities or Outcomes, and Regulatory Focus
  L. Robin Keller,
  Ali Abbas,
  J. Eric Bickel,
  Vicki M. Bier,
  David V. Budescu,
  John C. Butler,
  Enrico Diecidue,
  Robin L. Dillon-Merrill,
  Raimo P. Hämäläinen,
  Kenneth C. Lichtendahl,
  Jason R. W. Merrick,
  Jay R. Simon,
  George Wu,
  1 December 2012 | Decision Analysis, Vol. 9, No. 4
- Proper Scoring Rules and Risk Aversion
  SSRN Electronic Journal, Vol. 4
- Tailored Scoring Rules for Probabilities
  David J. Johnstone,
  Victor Richmond R. Jose,
  Robert L. Winkler,
  14 October 2011 | Decision Analysis, Vol. 8, No. 4
- From the Editors—Probability Scoring Rules, Ambiguity, Multiattribute Terrorist Utility, and Sensitivity Analysis
  L. Robin Keller,
  Ali Abbas,
  J. Eric Bickel,
  Vicki M. Bier,
  David V. Budescu,
  John C. Butler,
  Philippe Delquié,
  Kenneth C. Lichtendahl,
  Jason R. W. Merrick,
  Ahti Salo,
  George Wu,
  1 December 2011 | Decision Analysis, Vol. 8, No. 4
- Scoring Rules
  15 February 2011
- A comparison between ensemble and deterministic hydrological forecasts in an operational context
  3 March 2011 | Advances in Geosciences, Vol. 29
- Scoring Rules and Decision Analysis Education
  J. Eric Bickel,
  3 September 2010 | Decision Analysis, Vol. 7, No. 4
- From the Editors…
  L. Robin Keller,
  Ali Abbas,
  Manel Baucells,
  Vicki M. Bier,
  David Budescu,
  John C. Butler,
  Philippe Delquié,
  Jason R. W. Merrick,
  Ahti Salo,
  George Wu,
  1 December 2010 | Decision Analysis, Vol. 7, No. 4
- Proper scoring rules with arbitrary value functions
  Journal of Mathematical Economics, Vol. 46, No. 6
- Managing Project Failure Risk Through Contingent Contracts in Procurement Auctions
  Jianqing Chen,
  Lizhen Xu,
  Andrew Whinston,
  13 October 2009 | Decision Analysis, Vol. 7, No. 1
- From the Editors …
  L. Robin Keller,
  Manel Baucells,
  John C. Butler,
  Philippe Delquié,
  Jason R. W. Merrick,
  Gregory S. Parnell,
  Ahti Salo,
  1 December 2009 | Decision Analysis, Vol. 6, No. 4
- From the Editor…
  L. Robin Keller,
  1 September 2009 | Decision Analysis, Vol. 6, No. 3
- A Kullback-Leibler View of Linear and Log-Linear Pools
  Ali E. Abbas,
  6 February 2009 | Decision Analysis, Vol. 6, No. 1
- From the Editor…
  L. Robin Keller,
  1 March 2009 | Decision Analysis, Vol. 6, No. 1
- Scoring Rules, Generalized Entropy, and Utility Maximization
  Victor Richmond R. Jose,
  Robert F. Nau,
  Robert L. Winkler,
  21 August 2008 | Operations Research, Vol. 56, No. 5
- From the Editor…
  L. Robin Keller,
  1 September 2008 | Decision Analysis, Vol. 5, No. 3

Volume 4, Issue 2

June 2007

Pages 47-109

Article Information

Supplemental Material

Metrics

Information

Received:January 26, 2007
Accepted:May 14, 2007
Published Online:June 01, 2007

Cite as

J. Eric Bickel, (2007) Some Comparisons among Quadratic, Spherical, and Logarithmic Scoring Rules. Decision Analysis 4(2):49-65.

https://doi.org/10.1287/deca.1070.0089

Keywords

PDF download

Available Issues

Available Issues

Available Issues

Available Issues

Some Comparisons among Quadratic, Spherical, and Logarithmic Scoring Rules

Supplemental Material

Volume 4, Issue 2

Article Information

Supplemental Material

Metrics

Information

Cite as

Keywords

Sign Up for INFORMS Publications Updates and News