Enhancing AI Use: How Complementary System Information Drives Delegation Frequency and Effectiveness

References

• Adam M, Roethke K, Benlian A (2023) Human vs. automated sales agents: How and why customer responses shift across sales stages. Inform. Systems Res. 34(3):1148–1168.Link, Google Scholar
• Adam M, Diebel C, Goutier M, Benlian A (2024) Navigating autonomy and control in human-AI delegation: User responses to technology- versus user-invoked task allocation. Decision Support Systems 180:114193.Crossref, Google Scholar
• Aggarwal P, Mazumdar T (2008) Decision delegation: A conceptualization and empirical investigation. Psych. Marketing 25(1):71–93.Crossref, Google Scholar
• Ahn D, Almaatouq A, Gulabani M, Hosanagar K (2021) Will we trust what we don’t understand? Impact of model interpretability and outcome feedback on trust in AI. Preprint, submitted November 16, https://arxiv.org/abs/2111.08222.Google Scholar
• Autor DH (2015) Why are there still so many jobs? The history and future of workplace automation. J. Econom. Perspect. 29(3):3–30.Crossref, Google Scholar
• Baird A, Maruping LM (2021) The next generation of research on IS use: A theoretical framework of delegation to and from agentic IS artifacts. MIS Quart. 45(1):315–341.Crossref, Google Scholar
• Bansal G, Nushi B, Kamar E, Lasecki WS, Weld DS, Horvitz E (2019a) Beyond accuracy: The role of mental models in human-AI team performance (HCOMP-19). Law E, Vaughan JW, eds. Proc. Seventh AAAI Conf. Human Comput. Crowdsourcing (AAAI Press, Palo Alto, CA), 2–11.Google Scholar
• Bansal G, Nushi B, Kamar E, Weld DS, Lasecki WS, Horvitz E (2019b) Updates in human-AI teams: Understanding and addressing the performance/compatibility tradeoff. Proc. 33rd AAAI Conf. Artificial Intelligence (AAAI Press, Palo Alto, CA), 2429–2437.Google Scholar
• Bansal G, Wu T, Zhou J, Fok R, Nushi B, Kamar E, Ribeiro MT, Weld D (2021) Does the whole exceed its parts? The effect of AI explanations on complementary team performance. CHI’21 Proc. 2021 CHI Conf. Human Factors Comput. Systems (Association for Computing Machinery, New York), 81.Google Scholar
• Bauer K, von Zahn M, Hinz O (2023) Expl(AI)ned: The impact of explainable artificial intelligence on users’ information processing. Inform. Systems Res. 34(4):1582–1602.Link, Google Scholar
• Bhattacherjee A (2001) Understanding information systems continuance: An expectation-confirmation model. MIS Quart. 25(3):351–370.Crossref, Google Scholar
• Bolton GE, Katok E, Stangl T (2022) Failures in the communication of risk: Decisions and numeracy. Production Oper. Management 31(12):4616–4627.Crossref, Google Scholar
• Brown SA, Venkatesh V, Goyal S (2014) Expectation confirmation in information systems research: A test of six competing models. MIS Quart. 38(3):729–756.Crossref, Google Scholar
• Burton-Jones A, Grange C (2013) From use to effective use: A representation theory perspective. Inform. Systems Res. 24(3):632–658.Link, Google Scholar
• Burton-Jones A, Straub DW (2006) Reconceptualizing system usage: An approach and empirical test. Inform. Systems Res. 17(3):228–246.Link, Google Scholar
• Burton-Jones A, Bremhorst M, Liu F, Trieu TVH (2018) IT use: Notes from a journey from use to effective use. Galliers R, Stein MK, eds. The Routledge Companion to Management Information Systems, 1st ed. (Routledge, Abingdon, UK), 152–165.Google Scholar
• Chen JYC, Barnes MJ (2015) Agent transparency for human-agent teaming effectiveness. 2015 IEEE Internat. Conf. Systems Man Cybernetics (IEEE, Piscataway, NJ), 1381–1385.Google Scholar
• Cramer H, Evers V, Ramlal S, van Someren M, Rutledge L, Stash N, Aroyo L, Wielinga B (2008) The effects of transparency on trust in and acceptance of a content-based art recommender. User Model. User-Adapted Interaction 18(5):455–496.Crossref, Google Scholar
• Dietvorst BJ, Simmons JP, Massey C (2015) Algorithm aversion: People erroneously avoid algorithms after seeing them err. J. Experiment. Psych. General 144(1):114–126.Crossref, Google Scholar
• Dietvorst BJ, Simmons JP, Massey C (2018) Overcoming algorithm aversion: People will use imperfect algorithms if they can (even slightly) modify them. Management Sci. 64(3):1155–1170.Link, Google Scholar
• Douglas BD, Ewell PJ, Brauer M (2023) Data quality in online human-subjects research: Comparisons between MTurk, Prolific, CloudResearch, Qualtrics, and SONA. PLoS One 18(3):e0279720.Crossref, Google Scholar
• Dzindolet MT, Peterson SA, Pomranky RA, Pierce LG, Beck HP (2003) The role of trust in automation reliance. Internat. J. Human-Comput. Stud. 58(6):697–718.Crossref, Google Scholar
• Eisenhardt KM (1989) Agency theory: An assessment and review. Acad. Management Rev. 14(1):57–74.Crossref, Google Scholar
• Endsley MR (1995) Toward a theory of situation awareness in dynamic systems. Human Factors J. Human Factors Ergonomics Soc. 37(1):32–64.Crossref, Google Scholar
• Foster ED, Deardorff A (2017) Open Science Framework (OSF). J. Medical Library Assoc. 105(2):203–206.Google Scholar
• Fügener A, Walzner DD, Gupta A (2026) Roles of artificial intelligence in collaboration with humans: Automation, augmentation, and the future of work. Management Sci. 72(1):538–557.Link, Google Scholar
• Fügener A, Grahl J, Gupta A, Ketter W (2021) Will humans-in-the-loop become borgs? Merits and pitfalls of working with AI. MIS Quart. 45(3):1527–1556.Crossref, Google Scholar
• Fügener A, Grahl J, Gupta A, Ketter W (2022) Cognitive challenges in human–artificial intelligence collaboration: Investigating the path toward productive delegation. Inform. Systems Res. 33(2):678–696.Link, Google Scholar
• Ge R, Zheng Z, Tian X, Liao L (2021) Human–robot interaction: When investors adjust the usage of robo-advisors in peer-to-peer lending. Inform. Systems Res. 32(3):774–785.Link, Google Scholar
• Geirhos R, Narayanappa K, Mitzkus B, Thieringer T, Bethge M, Wichmann FA, Brendel W (2021) Partial success in closing the gap between human and machine vision. Preprint, submitted October 25, https://arxiv.org/abs/2106.07411.Google Scholar
• Gonzalez C, Heidari H (2025) A cognitive approach to human–AI complementarity in dynamic decision-making. Nature Rev. Psych. 4(12):808–822.Crossref, Google Scholar
• Grimes GM, Schuetzler RM, Giboney JS (2021) Mental models and expectation violations in conversational AI interactions. Decision Support Systems 144:113515.Crossref, Google Scholar
• Hemmer P, Schemmer M, Kühl N, Vössing M, Satzger G (2022) On the effect of information asymmetry in human-AI teams. Preprint, submitted May 3, https://arxiv.org/abs/2205.01467.Google Scholar
• Hemmer P, Schemmer M, Kühl N, Vössing M, Satzger G (2025) Complementarity in human-AI collaboration: Concept, sources, and evidence. Eur. J. Inform. Systems 34(6):979–1002.Crossref, Google Scholar
• Inkpen K, Chappidi S, Mallari K, Nushi B, Ramesh D, Michelucci P, Mandava V, Vepřek LH, Quinn G (2023) Advancing human-AI complementarity: The impact of user expertise and algorithmic tuning on joint decision making. ACM Trans. Comput.-Human Interaction 30(5):1–29.Crossref, Google Scholar
• Johnson-Laird PN (1983) Mental Models: Towards a Cognitive Science of Language, Inference, and Consciousness (Harvard University Press, Cambridge, MA).Google Scholar
• Jussupow E, Benbasat I, Heinzl A (2024) An integrative perspective on algorithm aversion and appreciation in decision-making. MIS Quart. 48(4):1575–1590.Crossref, Google Scholar
• Jussupow E, Spohrer K, Heinzl A, Gawlitza J (2021) Augmenting medical diagnosis decisions? An investigation into physicians’ decision-making process with artificial intelligence. Inform. Systems Res. 32(3):713–735.Link, Google Scholar
• Lai V, Carton S, Bhatnagar R, Liao QV, Zhang Y, Tan C (2022) Human-AI collaboration via conditional delegation: A case study of content moderation. CHI’22 Proc. 2022 CHI Conf. Human Factors Comput. Systems (Association for Computing Machinery, New York), 54.Google Scholar
• Leana CR (1986) Predictors and consequences of delegation. Acad. Management J. 29(4):754–774.Crossref, Google Scholar
• Lehmann CA, Haubitz CB, Fügener A, Thonemann UW (2022) The risk of algorithm transparency: How algorithm complexity drives the effects on the use of advice. Production Oper. Management 31(9):3419–3434.Crossref, Google Scholar
• Liao QV, Varshney KR (2022) Human-centered explainable AI (XAI): From algorithms to user experiences. Preprint, submitted April 19, https://arxiv.org/abs/2110.10790.Google Scholar
• Liu J, Yue WT, Leung ACM, Zhang X (2025) Find the good. Seek the unity: A hidden Markov model of human-AI delegation dynamics. MIS Quart. 49(3):1185–1204.Crossref, Google Scholar
• Lu T, Zhang Y (2025) 1 + 1 > 2? Information, humans, and machines. Inform. Systems Res. 36(1):394–418.Link, Google Scholar
• Ma S, Lei Y, Wang X, Zheng C, Shi C, Yin M, Ma X (2023) Who should I trust: AI or myself? Leveraging human and AI correctness likelihood to promote appropriate trust in AI-assisted decision-making. CHI‘23 Proc. 2023 CHI Conf. Human Factors Comput. Systems (Association for Computing Machinery, New York), 759.Google Scholar
• Montag C, Finck M (2024) Successful implementation of the EU AI Act requires interdisciplinary efforts. Nature Machine Intelligence 6(12):1415–1417.Crossref, Google Scholar
• Norman DA (1987) Some observations on mental models. Gentner D, Stevens AL, eds. Mental Models (Lawrence Erlbaum Associates Inc., Mahwah, NJ), 7–14.Google Scholar
• Oliver RL (1980) A cognitive model of the antecedents and consequences of satisfaction decisions. J. Marketing Res. 17(4):460–469.Crossref, Google Scholar
• Peters E, Västfjäll D, Slovic P, Mertz C, Mazzocco K, Dickert S (2006) Numeracy and decision making. Psych. Sci. 17(5):407–413.Crossref, Google Scholar
• Pinski M, Adam M, Benlian A (2023) AI knowledge: Improving AI delegation through human enablement. CHI’23 Proc. 2023 CHI Conf. Human Factors Comput. Systems (Association for Computing Machinery, New York), 25.Google Scholar
• Polanyi M (1966) The logic of tacit inference. Philosophy 41(155):1–18.Crossref, Google Scholar
• Rechkemmer A, Yin M (2022) When confidence meets accuracy: Exploring the effects of multiple performance indicators on trust in machine learning models. CHI’22 Proc. 2022 CHI Conf. Human Factors Comput. Systems (Association for Computing Machinery, New York), 535.Google Scholar
• Russakovsky O, Deng J, Su H, Krause J, Satheesh S, Ma S, Huang Z, et al. (2015) ImageNet large scale visual recognition challenge. Preprint, submitted January 30, https://arxiv.org/abs/1409.0575.Google Scholar
• Smith DA, Graesser AC (1981) Memory for actions in scripted activities as a function of typicality, retention interval, and retrieval task. Memory Cognition 9(6):550–559.Crossref, Google Scholar
• Taudien A, Fügener A, Gupta A, Ketter W (2022) Calibrating users’ mental models for delegation to AI. ICIS 2022 Proc. (Association for Information Systems, Atlanta), 16.Google Scholar
• Tversky A, Kahneman D (1974) Judgment under uncertainty: Heuristics and biases. Science 185(4157):1124–1131.Crossref, Google Scholar
• Vaccaro M, Almaatouq A, Malone T (2024) When combinations of humans and AI are useful: A systematic review and meta-analysis. Nature Human Behav. 8(12):2293–2303.Crossref, Google Scholar
• Vandenbosch B, Higgins C (1996) Information acquisition and mental models: An investigation into the relationship between behaviour and learning. Inform. Systems Res. 7(2):198–214.Link, Google Scholar
• Venkatesh V, Goyal S (2010) Expectation disconfirmation and technology adoption: Polynomial modeling and response surface analysis. MIS Quart. 34(2):281–303.Crossref, Google Scholar
• von Krogh G (2018) Artificial intelligence in organizations: New opportunities for phenomenon-based theorizing. Acad. Management Discoveries 4(4):404–409.Crossref, Google Scholar
• Wang W, Benbasat I (2008) Attributions of trust in decision support technologies: A study of recommendation agents for e-commerce. J. Management Inform. Systems 24(4):249–273.Crossref, Google Scholar
• Wilder B, Horvitz E, Kamar E (2020) Learning to complement humans. Preprint, submitted May 1, https://arxiv.org/abs/2005.00582.Google Scholar
• You S, Yang CL, Li X (2022) Algorithmic versus human advice: Does presenting prediction performance matter for algorithm appreciation? J. Management Inform. Systems 39(2):336–365.Crossref, Google Scholar
• Zhang Y, Liao QV, Bellamy RKE (2020) Effect of confidence and explanation on accuracy and trust calibration in AI-assisted decision making. FAT*’20 Proc. 2020 Conf. Fairness Accountability Transparency (Association for Computing Machinery, New York), 295–305.Google Scholar