Cognitive Challenges in Human–Artificial Intelligence Collaboration: Investigating the Path Toward Productive Delegation

References

• Agrawal A, Gans J, Goldfarb A (2018) Prediction Machines: The Simple Economics of Artificial Intelligence (Harvard Business Review Press, Boston).Google Scholar
• Arechar AA, Rand DG (2021) Turking in the time of COVID. Behav. Res. Methods, 53:2591–2595.Crossref, Google Scholar
• Aruguete MS, Huynh H, Browne BL, Jurs B, Flint E, McCutcheon LE (2019) How serious is the “carelessness” problem on Mechanical Turk? Internat. J. Soc. Res. Methodol. 22(5):441–449.Crossref, Google Scholar
• Autor DH (2014) Polanyis’ paradox and the shape of employment growth. Proc. Federal Reserve Bank Kansas City—Jackson Hole Econom. Policy Sympos., 129–179.Google Scholar
• Autor DH, Levy F, Murnane RJ (2003) The skill content of recent technological change: An empirical exploration. Quart. J. Econom. 118(4):1279–1333.Crossref, Google Scholar
• Baird A, Maruping LM (2021) The next generation of research on is use: A theoretical framework of delegation to and from agentic is artifacts. MIS Quart. 45(1):315–341.Crossref, Google Scholar
• Bazerman MH (1985) Norms of distributive justice in interest arbitration. Indust. Labor Relations Rev. 38(4):558–570.Crossref, Google Scholar
• Brezis M, Orkin-Bedolach Y, Fink D, Kiderman A (2018) Does physician’s training induce overconfidence that hampers disclosing errors? J Patient Safety 15(4):296–298.Crossref, Google Scholar
• Brynjolfsson E, Mitchell TM (2017) What can machine learning do? Workforce implications. Science 358(6370):1530–1534.Crossref, Google Scholar
• Brynjolfsson E, Mitchell T, Rock D (2018) What can machines learn, and what does it mean for occupations and the economy? AEA Papers Proc. 108(May):43–47.Crossref, Google Scholar
• Buhrmester M, Kwang T, Gosling SD (2016) Amazon’s Mechanical Turk: A new source of inexpensive, yet high-quality data? Kazdin AE, ed. Methodological Issues and Strategies in Clinical Research, 4th ed. (American Psychological Association, Washington, DC), 133–139.Crossref, Google Scholar
• Chandler J, Rosenzweig C, Moss AJ, Robinson J, Litman L (2019) Online panels in social science research: Expanding sampling methods beyond Mechanical Turk. Behav. Res. Methods 51(5):2022–2038.Crossref, Google Scholar
• Coppock A (2019) Generalizing from survey experiments conducted on Mechanical Turk: A replication approach. Political Sci. Res. Methods 7(3):613–628.Crossref, Google Scholar
• Dawes RM (1979) The robust beauty of improper linear models in decision making. Amer. Psych. 34(7):571–582.Crossref, Google Scholar
• Deng L, Yu D (2013) Deep learning: Methods and applications. Foundations Trends Signal Processing 7(3–4):197–387.Crossref, Google Scholar
• Dietvorst BJ, Simmons JP, Massey C (2015) Algorithm aversion: People erroneously avoid algorithms after seeing them err. J. Experiment. Psych. General 144(1):114–126.Crossref, Google Scholar
• Dietvorst BJ, Simmons JP, Massey C (2018) Overcoming algorithm aversion: People will use imperfect algorithms if they can (even slightly) modify them. Management Sci. 64(3):1155–1170.Link, Google Scholar
• Difallah DE, Catasta M, Demartini G, Ipeirotis PG, Cudré-Mauroux P (2015) The dynamics of micro-task crowdsourcing: The case of Amazon MTurk. Proc. 24th Internat. Conf. World Wide Web (ACM, New York), 238–247.Google Scholar
• Dijkstra JJ (1999) User agreement with incorrect expert system advice. Behav. Inform. Tech. 18(6):399–411.Crossref, Google Scholar
• Esteva A, Kuprel B, Novoa RA, Ko J, Swetter SM, Blau HM, Thrun S (2017) Dermatologist-level classification of skin cancer with deep neural networks. Nature 542(7639):115–118.Crossref, Google Scholar
• Evans JA, Foster JG (2011) Metaknowledge. Science 331(6018):721–725.Crossref, Google Scholar
• Foster ED, Deardorff A (2017) Open Science Framework (OSF). J. Medical Library Assoc. 105(2):203–206.Google Scholar
• Fügener A, Grahl J, Gupta A, Ketter W (2021) Will humans-in-the-loop become borgs? Merits and pitfalls of working with AI. MIS Quart. 45(3):1527–1556.Crossref, Google Scholar
• Ge R, Zheng Z, Tian X, Liao L (2021) Human–robot interaction: When investors adjust the usage of robo-advisors in peer-to-peer lending. Inform. Systems Res. 32(3):774–785.Link, Google Scholar
• Hansson P, Juslin P, Winman A (2008) The role of short-term memory capacity and task experience for overconfidence in judgment under uncertainty. J. Experiment. Psych. General 34(5):1027–1042.Google Scholar
• Hara K, Adams A, Milland K, Savage S, Callison-Burch C, Bigham JP (2018) A data-driven analysis of workers’ earnings on Amazon Mechanical Turk. Mandryk R, Hancock M, Perry M, Cox A, eds. Proc. 2018 CHI Conf. Human Factors Comput. Systems (ACM Press, New York), 1–14.Crossref, Google Scholar
• Hinton G, Deng L, Yu D, Dahl G, Mohamed A, Jaitly N, Senior A, et al. (2012) Deep neural networks for acoustic modeling in speech recognition. IEEE Signal Processing Magazine 29(6):82–97.Crossref, Google Scholar
• Horton JJ, Rand DG, Zeckhauser RJ (2011) The online laboratory: Conducting experiments in a real labor market. Experiment. Econom. 14(3):399–425.Crossref, Google Scholar
• Huber GP (1990) A theory of the effects of advanced information technologies on organizational design, intelligence, and decision making. Acad. Management Rev. 15(1):47–71.Crossref, Google Scholar
• Jussupow E, Spohrer K, Heinzl A, Gawlitza J (2021) Augmenting medical diagnosis decisions? An investigation into physicians’ decision-making process with artificial intelligence. Inform. Systems Res. 32(3):713–735.Link, Google Scholar
• Ketter W, Peters M, Collins J, Gupta A (2016) A multiagent competitive gaming platform to address societal challenges. MIS Quart. 40(2):447–460.Crossref, Google Scholar
• Kikkawa Y, Mavin TJ (2017) A review of debriefing practices: Toward a framework for airline pilot debriefing. Aviation Psych. Appl. Human Factors 7(1):42–54.Crossref, Google Scholar
• Kleinmuntz B (1990) Why we still use our heads instead of formulas: Toward an integrative approach. Psych. Bull. 107(3):296–310.Crossref, Google Scholar
• Kononenko I (2001) Machine learning for medical diagnosis: History, state of the art and perspective. Artificial Intelligence Medicine 23(1):89–109.Crossref, Google Scholar
• Kremer M, Moritz B, Siemsen E (2011) Demand forecasting behavior: System neglect and change detection. Management Sci. 57(10):1827–1843.Link, Google Scholar
• LeCun Y, Bengio Y, Hinton G (2015) Deep learning. Nature 521(7553):436–444.Crossref, Google Scholar
• Lee YS, Seo YW, Siemsen E (2018) Running behavioral operations experiments using Amazon’s Mechanical Turk. Production Oper. Management 27(5):973–989.Crossref, Google Scholar
• Logg JM, Minson JA, Moore DA (2019) Algorithm appreciation: People prefer algorithmic to human judgment. Organ. Behav. Human Decision Processes 151(March):90–103.Crossref, Google Scholar
• Lories G, Dardenne B, Yzerbyt VY (1998) From social cognition to metacognition. Yzerbyt VY, Lories G, Dardenne B, eds. Metacognition: Cognitive and Social Dimensions (Sage Publications, London), 1–15.Crossref, Google Scholar
• McAfee A (2013) Big data’s biggest challenge? Convincing people NOT to trust their judgement. Harvard Bus. Rev. (December), https://hbr.org/2013/12/big-datas-biggest-challenge-convincing-people-not-to-trust-their-judgment.Google Scholar
• McAfee A, Brynjolfsson E (2017) Machine, Platform, Crowd: Harnessing Our Digital, 1st ed. (W.W. Norton & Company, New York).Google Scholar
• Meehl PE (1954) Clinical Versus Statistical Prediction: A Theoretical Analysis and a Review of the Evidence (University of Minnesota Press, Minneapolis).Crossref, Google Scholar
• Nosek BA, Ebersole CR, DeHaven AC, Mellor DT (2018) The preregistration revolution. Proc. Natl. Acad. Sci. USA 115(11):2600–2606.Crossref, Google Scholar
• Pink DH (2011) Drive: The Surprising Truth About What Motivates Us, 1st paperback ed. (Riverhead Books, New York).Google Scholar
• Pulford BD, Colman AM (1997) Overconfidence: Feedback and item difficulty effects. Personality Individual Differences 23(1):125–133.Google Scholar
• Russakovsky O, Deng J, Su H, Krause J, Satheesh S, Ma S, Huang Z, et al. (2015) ImageNet large scale visual recognition challenge. Internat. J. Comput. Vision 115(3):211–252.Crossref, Google Scholar
• Russo JE, Schoemaker PJH (1992) Managing overconfidence. Sloan Management Rev. 33(2):7–17.Google Scholar
• Schanke S, Burtch G, Ray G (2021) Estimating the impact of “humanizing” customer service chatbots. Inform. Systems Res. 32(3):736–751.Link, Google Scholar
• Schmidhuber J (2015) Deep learning in neural networks: An overview. Neural Networks 61(January):85–117.Google Scholar
• Szegedy C, Vanhoucke V, Ioffe S, Shlens J, Wojna Z (2016) Rethinking the inception architecture for computer vision. Proc. IEEE Conf. Comput. Vision Pattern Recognition (IEEE, Piscataway, NJ), 2818–2826.Crossref, Google Scholar
• Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A (2015) Going deeper with convolutions. 2015 IEEE Conf. Comput. Vision Pattern Recognition (IEEE, Piscataway, NJ), 1–9.Crossref, Google Scholar
• Zanzotto FM (2019) Human-in-the-loop artificial intelligence. J. Artificial Intelligence Res. 64:243–252.Crossref, Google Scholar