Neutral Pivoting: Strong Bias Correction for Shared Information

Published Online:https://doi.org/10.1287/deca.2024.0227

In the absence of historical data for use as forecasting inputs, decision makers often ask a panel of judges to predict the outcome of interest, leveraging the wisdom of the crowd [Surowiecki J (2005) The Wisdom of Crowds (Anchor, New York)]. Even if the crowd is large and skilled, shared information can bias the simple mean of judges’ estimates. Addressing the issue of bias, Palley and Soll [Palley AB, Soll JB (2019) Extracting the wisdom of crowds when information is shared. Management Sci. 65(5):2291–2309] introduces a novel approach called pivoting. Pivoting can take several forms, most notably the powerful and reliable minimal pivot. We build on the intuition of the minimal pivot and propose a more aggressive bias correction known as the neutral pivot. The neutral pivot achieves the largest bias correction of its class that both avoids the need to directly estimate crowd composition or skill and maintains a smaller expected squared error than the simple mean for all considered settings. Empirical assessments on real data sets confirm the effectiveness of the neutral pivot compared with current methods.

Funding: This research includes calculations carried out on HPC resources supported in part by the National Science Foundation through major research instrumentation [Grant 1625061] and by the US Army Research Laboratory [contract number W911NF-16-2-0189].

Supplemental Material: The online appendix is available at https://doi.org/10.1287/deca.2024.0227.

INFORMS site uses cookies to store information on your computer. Some are essential to make our site work; Others help us improve the user experience. By using this site, you consent to the placement of these cookies. Please read our Privacy Statement to learn more.