The Role of Expectations and Explicit Accuracy Information in the Utilization of Advice from Human-in-the-Loop Systems

References

• Balakrishnan M, Ferreira KJ, Tong J (2026) Human-algorithm collaboration with private information: Naïve advice-weighting behavior and mitigation. Management Sci. 72(1):265–284.Link, Google Scholar
• Bogert E, Schecter A, Watson RT (2021) Humans rely more on algorithms than social influence as a task becomes more difficult. Sci. Rep. 11(1):8028.Crossref, Google Scholar
• Bonaccio S, Dalal RS (2006) Advice taking and decision-making: An integrative literature review, and implications for the organizational sciences. Organ. Behav. Human Decision Processes 101(2):127–151.Crossref, Google Scholar
• Burton JW, Stein MK, Jensen TB (2020) A systematic review of algorithm aversion in augmented decision making. J. Behav. Decision Making 33(2):220–239.Crossref, Google Scholar
• Cadario R, Longoni C, Morewedge CK (2021) Understanding, explaining, and utilizing medical artificial intelligence. Nat. Human Behav. 5(12):1636–1642.Crossref, Google Scholar
• Castelo N, Bos MW, Lehmann DR (2019) Task-dependent algorithm aversion. J. Marketing Res. 56(5):809–825.Crossref, Google Scholar
• Dietvorst BJ, Simmons JP, Massey C (2015) Algorithm aversion: People erroneously avoid algorithms after seeing them err. J. Experiment. Psych. General 144(1):114–126.Crossref, Google Scholar
• Dietvorst BJ, Simmons JP, Massey C (2018) Overcoming algorithm aversion: People will use imperfect algorithms if they can (even slightly) modify them. Management Sci. 64(3):1155–1170.Link, Google Scholar
• Goodwin P, Gönül M, Önkal D (2013) Antecedents and effects of trust in forecasting advice. Internat. J. Forecasting 29(2):354–366.Crossref, Google Scholar
• Harvey N, Fischer I (1997) Taking advice: Accepting help, improving judgment, and sharing responsibility. Organ. Behav. Human Decision Processes 70(2):117–133.Crossref, Google Scholar
• Himmelstein M, Budescu DV (2023) Preference for human or algorithmic forecasting advice does not predict if and how it is used. J. Behav. Decision Making 36(1):e2285.Crossref, Google Scholar
• Kahr P, Rooks G, Willemsen M, Snijders C (2024) Understanding trust and reliance development in AI advice: Assessing model accuracy, model explanations, and experiences from previous interactions. ACM Trans. Interactive Intelligent Systems 14(4):1–30.Crossref, Google Scholar
• Khosrowabadi N, Hoberg K, Imdahl C (2022) Evaluating human behaviour in response to AI recommendations for judgemental forecasting. Eur. J. Oper. Res. 303(3):1151–1167.Crossref, Google Scholar
• Kim J, Kang S, Bae J (2022) The effects of customer consumption goals on artificial intelligence driven recommendation agents: Evidence from Stitch Fix. Internat. J. Advertising 41:997–1016.Crossref, Google Scholar
• Kuncel NR, Klieger DM, Ones DS (2014) In hiring, algorithms beat instinct. Harvard Bus. Rev. 92(5):32.Google Scholar
• Lawrence M, Goodwin P, O’Connor M, Önkal D (2006) Judgmental forecasting: A review of progress over the last 25 years. Internat. J. Forecasting 22(3):493–518.Crossref, Google Scholar
• Lebovitz S, Lifshitz-Assaf H, Levina N (2022) To engage or not to engage with AI for critical judgments: How professionals deal with opacity when using AI for medical diagnosis. Organ. Sci. 33(1):126–148.Link, Google Scholar
• Liang G, Sloane JF, Donkin C, Newell BR (2022) Adapting to the algorithm: How accuracy comparisons promote the use of a decision aid. Cognitive Res. Principles Implications 7(1):14.Crossref, Google Scholar
• Lim JS, O’Connor M (1995) Judgemental adjustment of initial forecasts: Its effectiveness and biases. J. Behav. Decision Making 8:149–168.Crossref, Google Scholar
• Logg JM, Schlund R (2024) A simple explanation reconciles “algorithm aversion” and “algorithm appreciation”: Hypotheticals vs. real judgments. Preprint, submitted January 8, https://doi.org/10.2139/ssrn.4687557.Google Scholar
• Logg JM, Minson JA, Moore DA (2019) Algorithm appreciation: People prefer algorithmic to human judgment. Organ. Behav. Human Decision Processes 151:90–103.Crossref, Google Scholar
• Longoni C, Cian L (2022) Artificial intelligence in utilitarian vs. hedonic contexts: The “word-of-machine” effect. J. Marketing 86(1):91–108.Crossref, Google Scholar
• Longoni C, Bonezzi A, Morewedge CK (2019) Resistance to medical artificial intelligence. J. Consumer Res. 46(4):629–650.Crossref, Google Scholar
• Mahmud H, Islam AN, Ahmed SI, Smolander K (2022) What influences algorithmic decision-making? A systematic literature review on algorithm aversion. Tech. Forecasting Soc. Change 175:121390.Crossref, Google Scholar
• Moussaïd M, Kämmer JE, Analytis PP, Neth H (2013) Social influence and the collective dynamics of opinion formation. PLoS One 8(11):e78433.Crossref, Google Scholar
• Önkal D, Goodwin P, Thomson M, Gönül S, Pollock A (2009) The relative influence of advice from human experts and statistical methods on forecast adjustments. J. Behav. Decision Making 22(4):390–409.Crossref, Google Scholar
• Pálfi B, Arora K, Kostopoulou O (2022) Algorithm-based advice taking and clinical judgement: Impact of advice distance and algorithm information. Cognitive Res. Principles Implications 7(1):70.Crossref, Google Scholar
• Rader CA, Soll JB, Larrick RP (2015) Pushing away from representative advice: Advice taking, anchoring, and adjustment. Organ. Behav. Human Decision Processes 130:26–43.Crossref, Google Scholar
• Rebholz TR, Biella M, Hütter M (2024) Mixed-effects regression weights for advice taking and related phenomena of information sampling and utilization. J. Behav. Decision Making 37(2):e2369.Crossref, Google Scholar
• Schultze T, Rakotoarisoa AF, Stefan SH (2015) Effects of distance between initial estimates and advice on advice utilization. Judgment Decision Making 10(2):144–171.Crossref, Google Scholar
• Shaffer VA, Probst CA, Merkle EC, Arkes HR, Medow MA (2013) Why do patients derogate physicians who use a computer-based diagnostic support system? Medical Decision Making 33(1):108–118.Crossref, Google Scholar
• Shrestha YR, Ben-Menahem SM, Von Krogh G (2019) Organizational decision-making structures in the age of artificial intelligence. Calif. Management Rev. 61(4):66–83.Crossref, Google Scholar
• Susanto AP, Lyell D, Widyantoro B, Berkovsky S, Magrabi F (2023) Effects of machine learning-based clinical decision support systems on decision-making, care delivery, and patient outcomes: A scoping review. J. Amer. Medical Informatics Assoc. 30(12):2050–2063.Crossref, Google Scholar
• Yaniv I (2004) Receiving other people’s advice: Influence and benefit. Organ. Behav. Human Decision Processes 93(1):1–13.Crossref, Google Scholar
• Yaniv I, Kleinberger E (2000) Advice taking in decision making: Egocentric discounting and reputation formation. Organ. Behav. Human Decision Processes 83(2):260–281.Crossref, Google Scholar
• Yeomans M, Shah A, Mullainathan S, Kleinberg J (2019) Making sense of recommendations. J. Behav. Decision Making 32(4):403–414.Crossref, Google Scholar
• Yin M, Vaughan JW, Wallach H (2019) Understanding the effect of accuracy on trust in machine learning models. Proc. 2019 CHI Conf. Human Factors Comput. Systems (Association for Computing Machinery, New York), 1–12.Google Scholar