Algorithm-Augmented Work and Domain Experience: The Countervailing Forces of Ability and Aversion

References

• Agrawal AK, Gans JS, Goldfarb A (2018) Prediction, judgment and complexity. NBER Working Paper No. 24243, National Bureau of Economic Research, Cambridge, MA.Google Scholar
• Agrawal A, Gans J, Goldfarb A, eds. (2019) The Economics of Artificial Intelligence: An Agenda (University of Chicago Press).Google Scholar
• Arkes HR, Dawes RM, Christensen C (1986) Factors influencing the use of a decision rule in a probabilistic task. Organ. Behav. Human Decision Processes 37(1):93–110.Crossref, Google Scholar
• Arthur F, Hossein KR (2019) Deep learning in medical image analysis: A third eye for doctors. J. Stomatology Oral Maxillofacial Surgery 120(4):279–288.Crossref, Google Scholar
• Autor DH (2015) Why are there still so many jobs? The history and future of workplace automation. J. Econom. Perspect. 29(3):3–30.Crossref, Google Scholar
• Barley SR (1986) Technology as an occasion for structuring: Evidence from observations of CT scanners and the social order of radiology departments. Admin. Sci. Quart. 31(1):78–108.Crossref, Google Scholar
• Becker GS (1962) Investment in human capital: A theoretical analysis. J. Political Econom. 70(5):9–49.Crossref, Google Scholar
• Brynjolfsson E, Mitchell T (2017) What can machine learning do? Workforce implications. Science 358(6370):1530–1534.Crossref, Google Scholar
• Brynjolfsson E, Mitchell T, Rock D (2018) What can machines learn and what does it mean for occupations and the economy? AEA Papers Proc. 108:43–47.Crossref, Google Scholar
• Charness G, Gneezy U, Kuhn MA (2012) Experimental methods: Between-subject and within-subject design. J. Econom. Behav. Organ. 81(1):1–8.Crossref, Google Scholar
• Chari VV, Hopenhayn H (1991) Vintage human capital, growth, and the diffusion of new technology. J. Political Econom. 99(6):1142–1165.Google Scholar
• Chase WG, Simon HA (1973) Perception in chess. Cognitive Psych. 4(1):55–81.Crossref, Google Scholar
• Choudhury P, Allen RT, Endres MG (2020a) Machine learning for pattern discovery in management research. Strategic Management J. 42(1):30–57.Crossref, Google Scholar
• Choudhury P, Starr E, Agarwal R (2020b) Machine learning and human capital complementarities: Experimental evidence on bias mitigation. Strategic Management. J. 41(8):1381–1411.Crossref, Google Scholar
• Christin A (2017) Algorithms in practice: Comparing web journalism and criminal justice. Big Data Soc. 4(2). https://journals.sagepub.com/doi/full/10.1177/2053951717718855.Crossref, Google Scholar
• Cowgill B (2018a) Bias and productivity in humans and algorithms: Theory and evidence from résumé screening. Working paper, Columbia Business School, 29, 1–58. http://conference.iza.org/conference_files/MacroEcon_2017/cowgill_b8981.pdf.Google Scholar
• Cowgill, B. (2018b) The impact of algorithms on judicial discretion: Evidence from regression discontinuities. Working paper, Columbia Business School.Google Scholar
• Dane E, Rockmann KW, Pratt MG (2012) When should I trust my gut? Linking domain expertise to intuitive decision-making effectiveness. Organ. Behav. Human Decision Processes 119(2):187–194.Crossref, Google Scholar
• Dasgupta P, David PA (1994) Toward a new economics of science. Res. Policy 23(5):487–521.Google Scholar
• Dawes RM (1979) The robust beauty of improper linear models in decision making. Amer. Psychologist 34(7):571.Google Scholar
• Dietvorst BJ, Simmons JP, Massey C (2015) Algorithm aversion: People erroneously avoid algorithms after seeing them err. J. Experiment. Psych. General 143(6):1–13.Google Scholar
• Dietvorst BJ, Simmons JP, Massey C (2018) Overcoming algorithm aversion: People will use imperfect algorithms if they can (even slightly) modify them. Management Sci. 64(3):1155–1170.Google Scholar
• Dreyfus HL, Dreyfus SE (1984) From Socrates to expert systems: The limits of calculative rationality. Tech. Soc. 6(3):217–233.Google Scholar
• Edmondson A, Bohmer R, Pisano G (2001) Disrupted routines: Team learning and new technology implementation in hospitals. Admin. Sci. Quart. 46(4):685–716.Crossref, Google Scholar
• Eggers JP, Kaul A (2018) Motivation and ability? A behavioral perspective on the pursuit of radical invention in multi-technology incumbents. Acad. Management J. 61(1):67–93.Crossref, Google Scholar
• Ericsson KA, Krampe RT, Tesch-R?mer C (1993) The role of deliberate practice in the acquisition of expert performance. Psych. Rev. 100(3):363.Google Scholar
• Fildes R, Goodwin P (2007) Against your better judgment? How organizations can improve their use of management judgment in forecasting. Interfaces 37(6):570–576.Link, Google Scholar
• Foster AD, Rosenzweig MR (1995) Learning by doing and learning from others: Human capital and technical change in agriculture. J. Political Econom. 103(6):1176–1209.Google Scholar
• Garfinkel S, Matthews J, Shapiro SS, Smith JM (2017) Toward algorithmic transparency and accountability. Comm. ACM 60(9):5.Crossref, Google Scholar
• Gino F, Moore DA (2007) Effects of task difficulty on use of advice. J. Behav. Decision Making 20(1):21–35.Crossref, Google Scholar
• Glaeser EL, Hillis A, Kim H, Kominers SD, Luca M (2021) Decision authority and the returns to algorithms. Harvard Business School Working Paper.Google Scholar
• Greenwood BN, Agarwal R, Agarwal R, Gopal A (2019) The role of individual and organizational expertise in the adoption of new practices. Organ. Sci. 30(1):191–213.Google Scholar
• Grove WM, Meehl PE (1996) Comparative efficiency of informal (subjective, impressionistic) and formal (mechanical, algorithmic) prediction procedures: The clinical-statistical controversy. Psych. Public Policy Law 2(2):293–323.Crossref, Google Scholar
• Grove WM, Zald DH, Lebow BS, Snitz BE, Nelson C (2000) Clinical versus mechanical prediction: A meta-analysis. Psych. Assessment 12(1):19.Google Scholar
• Helfat CE, Peteraf MA (2003) The dynamic resource-based view: Capability lifecycles. Strategic Management J. 24(10):997–1010.Google Scholar
• Henderson R (1993) Underinvestment and incompetence as responses to radical innovation: Evidence from the photolithographic alignment equipment industry. RAND J. Econom. 24(2):248–270.Crossref, Google Scholar
• Herlocker JL, Konstan JA, Terveen LG, Riedl JT (2004) Evaluating collaborative filtering recommender systems. ACM Trans. Inform. Systems 22(1):5–53.Google Scholar
• Judd CM, Kenny DA, McClelland GH (2001) Estimating and testing mediation and moderation in within-subject designs. Psych. Methods 6(2):115–134.Crossref, Google Scholar
• Kahneman D, Klein G (2009) Conditions for intuitive expertise: A failure to disagree. Amer. Psychologist 64(6):515–526.Crossref, Google Scholar
• Kellogg KC (2014) Brokerage professions and implementing reform in an age of experts. Amer. Sociol. Rev. 79(5):912–941.Crossref, Google Scholar
• Kellogg KC, Valentine MA, Christin A (2020) Algorithms at work: The new contested terrain of control. Acad. Management Ann. 14(1):366–410.Crossref, Google Scholar
• Kleinberg J, Lakkaraju H, Leskovec J, Ludwig J, Mullainathan S (2018) Human decisions and machine predictions. Quart. J. Econom. 133(1):237–293.Google Scholar
• Lebovitz S, Lifshitz-Assaf H, Levina N (2020) To incorporate or not to incorporate AI for critical judgments: The importance of ambiguity in professionals’ judgment process. New York University Stern School of Business, New York.Google Scholar
• Lesgold A, Rubinson H, Feltovich P, Glaser R, Klopfer D, Wang Y (1988) Expertise in a complex skill: Diagnosing x-ray pictures. Chi MTH, Glaser R, Farr MJ, eds. The Nature of Expertise (Lawrence Erlbaum Associates, Inc., Mahwah, NJ), 311–342.Google Scholar
• Li D (2017) Expertise vs. bias in evaluation: Evidence from the NIH. Amer. Econom. J. Appl. Econom. 9(2):60–92.Crossref, Google Scholar
• Liu BS (2013) The expertise paradox: Examining the role of different aspects of expertise in biased evaluation of scientific information. Unpublished doctoral dissertation, University of California, Irvine.Google Scholar
• Liu BS (2017) Knowledge, attitudes, and biased evaluation of science: Testing the expertise paradox. Unpublished Working paper. https://hbr.org/2018/03/research-learning-a-little-about-something-makes-us-overconfident.Google Scholar
• Logg JM, Haran U, Moore DA (2018) Is overconfidence a motivated bias? Experimental evidence. J. Experiment. Psych. General 147(10):1445–1465.Crossref, Google Scholar
• Logg JM, Minson JA, Moore DA (2019) Algorithm appreciation: People prefer algorithmic to human judgment. Organ. Behav. Human Decision Processes 151:90–103.Google Scholar
• McKenzie CRM, Liersch MJ, Yaniv I (2008) Overconfidence in interval estimates: What does expertise buy you? Organ. Behav. Human Decision Processes 107(2):179–191.Crossref, Google Scholar
• Meehl P (1954) Clinical Versus Statistical Prediction: A Theoretical Analysis and a Review of the Evidence (University of Minnesota Press, Minneapolis).Google Scholar
• Miller CC (2015) Can an algorithm hire better than a human? New York Times (June 15). https://www.nytimes.com/2015/06/26/upshot/can-an-algorithm-hire-better-than-a-human.html.Google Scholar
• Miller AP (2018) Want less-biased decisions? Use algorithms. Harvard. Bus. Rev. https://hbr.org/2018/07/want-less-biased-decisions-use-algorithms.Google Scholar
• Mithas S, Krishnan M (2008) Human capital and institutional effects in the compensation of information technology professionals in the United States. Management Sci. 54(3):415–428.Link, Google Scholar
• Pearl J (2009) Causality: Models, Reasoning, and Inference. 2nd ed. (Cambridge University Press, Cambridge, England).Google Scholar
• Pearl J, Mackenzie D (2018) The Book of Why: The New Science of Cause and Effect (Basic Books, New York).Google Scholar
• Polanyi M (1966) The logic of tacit inference. Philosophy 41(155):1–18.Crossref, Google Scholar
• Pustejovsky JE, Tipton E (2018) Small-sample methods for cluster-robust variance estimation and hypothesis testing in fixed effects models. J. Bus. Econom. Statist. 36(4):672–683.Crossref, Google Scholar
• Raisch S, Krakowski S (2020) Artificial intelligence and management: The automation-augmentation paradox. Acad. Management Rev. 46(1):1–48.Google Scholar
• Salas E, Rosen MA, DiazGranados D (2010) Expertise-based intuition and decision making in organizations. J. Management 36(4):941–973.Crossref, Google Scholar
• Sanchez C, Dunning D (2018) Research: Learning a little about something makes us overconfident. Harvard Bus. Rev. (March 29), https://hbr.org/2018/03/research-learning-a-little-about-something-makes-us-overconfident.Google Scholar
• Sanders NR, Manrodt KB (2003) The efficacy of using judgmental vs. quantitative forecasting methods in practice. Omega 31(6):511–522.Crossref, Google Scholar
• Shin D, Park YJ (2019) Role of fairness, accountability, and transparency in algorithmic affordance. Comput. Human Behav. 98:277–284.Google Scholar
• Shrestha YR, Ben-Menahem SM, von Krogh G (2019) Organizational decision-making structures in the age of artificial intelligence. Calif. Management Rev. 61(4):66–83.Crossref, Google Scholar
• Simon HA (1991) Bounded rationality and organizational learning. Organ. Sci. 2(1):125–134.Link, Google Scholar
• Simonsohn U (2018) Two-lines: A valid alternative to the invalid testing of U-shaped relationships with quadratic regressions. Adv. Methods Practice Psych. Sci. 1(4):538–555.Crossref, Google Scholar
• Soll JB, Mannes AE (2011) Judgmental aggregation strategies depend on whether the self is involved. Internat. J. Forecasting 27(1):81–102.Crossref, Google Scholar
• Teplitskiy M, Ranu H, Gray G, Menietti M, Guinan E, Lakhani KR (2019) Do experts listen to other experts? Field experimental evidence from scientific peer review. Harvard Business School Working paper.Google Scholar
• Tetlock PE (2009) Expert Political Judgment: How Good Is It? How Can We Know? (Princeton University Press, Princeton, NJ).Crossref, Google Scholar
• Vrieze SI, Grove WM (2009) Survey on the use of clinical and mechanical prediction methods in clinical psychology. Professional Psych. Res. Practice. 40(5):525–531.Google Scholar
• Yang H (2021) Cognitive reflection and algorithmic aversion. Working paper, MIT Sloan School of Business.Google Scholar
• Yaniv I, Kleinberger E (2000) Advice taking in decision making: Egocentric discounting and reputation formation. Organ. Behav. Human Decision Processes 83(2):260–281.Crossref, Google Scholar
• Yeomans M, Shah A, Mullainathan S, Kleinberg J (2019) Making sense of recommendations. J. Behav. Decision Making 32(4):403–414.Google Scholar