The ABCs of Who Benefits from Working with AI: Ability, Beliefs, and Calibration

References

• Agarwal N, Moehring A, Rajpurkar P, Salz T (2023) Combining human expertise with artificial intelligence: Experimental evidence from radiology. NBER Working Paper No. 31422, National Bureau of Economic Research, Cambridge, MA.Google Scholar
• Autor D (2024) Applying AI to rebuild middle class jobs. NBER Working Paper No. 32140, National Bureau of Economic Research, Cambridge, MA.Google Scholar
• Bamber D (1975) The area above the ordinal dominance graph and the area below the receiver operating characteristic graph. J. Math. Psych. 12(4):387–415.Crossref, Google Scholar
• Benjamin DJ (2019) Errors in probabilistic reasoning and judgment biases. Bernheim DB, DellaVigna S, Laibson D, eds. Handbook of Behavioral Economics: Applications and Foundations 1, vol. 2 (North-Holland, Amsterdam), 69–186.Crossref, Google Scholar
• Benson PG, Önkal D (1992) The effects of feedback and training on the performance of probability forecasters. Internat. J. Forecasting 8(4):559–573.Crossref, Google Scholar
• Benson AM, Shaw KL (2025) What do managers do? An economist’s perspective. NBER Working Paper No. 33431, National Bureau of Economic Research, Cambridge, MA.Google Scholar
• Brynjolfsson E, Li D, Raymond L (2025) Generative AI at work. Quart. J. Econom. 140(2):889–942.Google Scholar
• Caplin A, Csaba D, Leahy J, Nov O (2020) Rational inattention, competitive supply, and psychometrics. Quart. J. Econom. 135(3):1681–1724.Crossref, Google Scholar
• Caplin A, Deming DJ, Leth-Petersen S, Weidmann B (2023) Economic decision-making skill predicts income in two countries. NBER Working Paper No. 31674, National Bureau of Economic Research, Cambridge, MA.Google Scholar
• Chalfin A, Danieli O, Hillis A, Jelveh Z, Luca M, Ludwig J, Mullainathan S (2016) Productivity and selection of human capital with machine learning. Amer. Econom. Rev. 106(5):124–127.Crossref, Google Scholar
• Choi JH, Monahan A, Schwarcz D (2024) Lawyering in the age of artificial intelligence. Minnesota Law Rev. 109:147.Google Scholar
• Danz D, Vesterlund L, Wilson AJ (2022) Belief elicitation and behavioral incentive compatibility. Amer. Econom. Rev. 112(9):2851–2883.Crossref, Google Scholar
• Dargnies M-P, Hakimov R, Kübler D (2024) Aversion to hiring algorithms: Transparency, gender profiling, and self-confidence. Management Sci., ePub ahead of print June 19, https://doi.org/10.1287/mnsc.2022.02774.Link, Google Scholar
• DeGroot MH, Fienberg SE (1983) The comparison and evaluation of forecasters. J. Roy. Statist. Soc. Ser. D (Statist.) 32(1–2):12–22.Google Scholar
• Gillen B, Snowberg E, Yariv L (2019) Experimenting with measurement error: Techniques with applications to the Caltech cohort study. J. Political Econom. 127(4):1826–1863.Crossref, Google Scholar
• Grether DM (1980) Bayes rule as a descriptive model: The representativeness heuristic. Quart. J. Econom. 95(3):537–557.Crossref, Google Scholar
• Gruber J, Handel BR, Kina SH, Kolstad JT (2020) Managing intelligence: Skilled experts and AI in markets for complex products. NBER Working Paper No. 27038, National Bureau of Economic Research, Cambridge, MA.Google Scholar
• Gruetzemacher R, Lee KB, Paradice D (2024) Calibration training for improving probabilistic judgments using an interactive app. Futures Foresight Sci. 6(2):e177.Crossref, Google Scholar
• Haddara N, Rahnev D (2022) The impact of feedback on perceptual decision-making and metacognition: Reduction in bias but no change in sensitivity. Psych. Sci. 33(2):259–275.Crossref, Google Scholar
• Hanley JA, McNeil BJ (1982) The meaning and use of the area under a receiver operator characteristic (ROC) curve. Radiology 143(1):29–36.Crossref, Google Scholar
• Hoffman M, Kahn LB, Li D (2018) Discretion in hiring. Quart. J. Econom. 133(2):765–800.Crossref, Google Scholar
• Hossain T, Okui R (2013) The binarized scoring rule. Rev. Econom. Stud. 80(3):984–1001.Crossref, Google Scholar
• Lichtenstein S, Fischhoff B (1980) Training for calibration. Organ. Behav. Human Performance 26(2):149–171.Crossref, Google Scholar
• Merali A (2024) Scaling laws for economic productivity: Experimental evidence in LLM-assisted translation. Preprint, submitted September 4, https://arxiv.org/abs/2409.02391.Google Scholar
• Moore DA, Healy PJ (2008) The trouble with overconfidence. Psych. Rev. 115(2):502–517.Crossref, Google Scholar
• Noy S, Zhang W (2023) Experimental evidence on the productivity effects of generative artificial intelligence. Science 381(6654):187–192.Crossref, Google Scholar
• Rothe R, Timofte R, Van Gool L (2018) Deep expectation of real and apparent age from a single image without facial landmarks. Internat. J. Comput. Vision 126(2):144–157.Crossref, Google Scholar
• Tejeda H, Kumar A, Smyth P, Steyvers M (2022) AI-assisted decision-making: A cognitive modeling approach to infer latent reliance strategies. Comput. Brain Behav. 5(4):491–508.Crossref, Google Scholar