Incentives, Framing, and Reliance on Algorithmic Advice: An Experimental Study

References

• Allen RT, Choudhury P (2022) Algorithm-augmented work and domain experience: The countervailing forces of ability and aversion. Organ. Sci. 33(1):149–169.Link, Google Scholar
• Arkes HR, Dawes RM, Christensen C (1986) Factors influencing the use of a decision rule in a probabilistic task. Organ. Behav. Human Decision Processes 37(1):93–110.Crossref, Google Scholar
• Ashton RH (1990) Pressure and performance in accounting decision settings: Paradoxical effects of incentives, feedback, and justification. J. Accounting Res. 28:148–180.Crossref, Google Scholar
• Awasthi V, Pratt J (1990) The effects of monetary incentives on effort and decision performance: The role of cognitive characteristics. Accounting Rev. 65(4):797–811.Google Scholar
• Azrieli Y, Chambers CP, Healy PJ (2018) Incentives in experiments: A theoretical analysis. J. Political Econom. 126(4):1472–1503.Crossref, Google Scholar
• Bauer K, von Zahn M, Hinz O (2023) Expl(AI)ned: The impact of explainable artificial intelligence on users’ information processing. Inform. Systems Res. 34(4):1582–1602.Link, Google Scholar
• Bauer K, Hinz O, van der Aalst W, Weinhardt C (2021) Expl(AI)n it to me—Explainable AI and information systems research. Bus. Inform. Systems Engrg. 63:79–82.Crossref, Google Scholar
• Bonaccio S, Dalal RS (2006) Advice taking and decision-making: An integrative literature review, and implications for the organizational sciences. Organ. Behav. Human Decision Processes 101(2):127–151.Crossref, Google Scholar
• Bonner SE, Sprinkle GB (2002) The effects of monetary incentives on effort and task performance: Theories, evidence, and a framework for research. Accounting Organ. Soc. 27(4–5):303–345.Crossref, Google Scholar
• Bonner SE, Hastie R, Sprinkle GB, Young SM (2000) A review of the effects of financial incentives on performance in laboratory tasks: Implications for management accounting. J. Management Accounting Res. 12(1):19–64.Crossref, Google Scholar
• Burton JW, Stein M-K, Jensen TB (2020) A systematic review of algorithm aversion in augmented decision making. Behav. Decision Making 33(2):220–239.Crossref, Google Scholar
• Camerer CF, Hogarth RM (1999) The effects of financial incentives in experiments: A review and capital-labor-production framework. J. Risk Uncertainty 19(1):7–42.Crossref, Google Scholar
• Cao T, Duh R-R, Tan H-T, Xu T (2022) Enhancing auditors’ reliance on data analytics under inspection risk using fixed and growth mindsets. Accounting Rev. 97(3):131–153.Crossref, Google Scholar
• Castelo N, Bos MW, Lehmann DR (2019) Task-dependent algorithm aversion. J. Marketing Res. 56(5):809–825.Crossref, Google Scholar
• Charness G, Gneezy U, Halladay B (2016) Experimental methods: Pay one or pay all. J. Econom. Behav. Organ. 131:141–150.Crossref, Google Scholar
• Charness G, Gneezy U, Rasocha V (2021) Experimental methods: Eliciting beliefs. J. Econom. Behav. Organ. 189:234–256.Crossref, Google Scholar
• Chen CX, Hudgins R, Wright WF (2022) The effect of advice valence on the perceived credibility of data analytics. J. Management Accounting Res. 34(2):97–116.Crossref, Google Scholar
• Choudhury P, Starr E, Agarwal R (2020) Machine learning and human capital complementarities: Experimental evidence on bias mitigation. Strategic Management J. 41(8):1381–1411.Crossref, Google Scholar
• Commerford BP, Dennis SA, Joe JR, Ulla JW (2022) Man versus machine: Complex estimates and auditor reliance on artificial intelligence. J. Accounting Res. 60(1):171–201.Crossref, Google Scholar
• Costello AM, Down AK, Mehta MN (2020) Machine + man: A field experiment on the role of discretion in augmenting AI-based lending models. J. Accounting Econom. 70(2–3):101360.Crossref, Google Scholar
• Dargnies M-P, Hakimov R, Kübler D (2024) Aversion to hiring algorithms: Transparency, gender profiling, and self-confidence. Management Sci., ePub ahead of print June 19, https://doi.org/10.1287/mnsc.2022.02774.Link, Google Scholar
• Dell’Acqua F, McFowland E, Mollick ER, Lifshitz-Assaf H, Kellogg K, Rajendran S, Krayer L, Candelon F, Lakhani KR (2023) Navigating the jagged technological frontier: Field experimental evidence of the effects of AI on knowledge worker productivity and quality. Harvard Business School Technology & Operations Management Unit Working Paper No. 24-013, Harvard Business School, Boston.Google Scholar
• Dellermann D, Ebel P, Söllner M, Leimeister JM (2019) Hybrid intelligence. Bus. Inform. Systems Engrg. 61:637–643.Crossref, Google Scholar
• Dietvorst BJ, Bharti S (2020) People reject algorithms in uncertain decision domains because they have diminishing sensitivity to forecasting error. Psych. Sci. 31(10):1302–1314.Crossref, Google Scholar
• Dietvorst BJ, Simmons JP, Massey C (2015) Algorithm aversion: People erroneously avoid algorithms after seeing them err. J. Experiment. Psych. General 144(1):114–126.Crossref, Google Scholar
• Dietvorst BJ, Simmons JP, Massey C (2018) Overcoming algorithm aversion: People will use imperfect algorithms if they can (even slightly) modify them. Management Sci. 64(3):1155–1170.Link, Google Scholar
• Ding S, Beaulieu P (2011) The role of financial incentives in balanced scorecard-based performance evaluations: Correcting mood congruency biases. J. Accounting Res. 49(5):1223–1247.Crossref, Google Scholar
• Dohmen T, Falk A, Huffman D, Sunde U, Schupp J, Wagner GG (2011) Individual risk attitudes: Measurement, determinants, and behavioral consequences. J. Eur. Econom. Assoc. 9(3):522–550.Crossref, Google Scholar
• Efendić E, Van de Calseyde PPFM, Evans AM (2020) Slow response times undermine trust in algorithmic (but not human) predictions. Organ. Behav. Human Decision Processes 157:103–114.Crossref, Google Scholar
• Emett SA, Kaplan SE, Mauldin E, Pickerd JS (2023) Auditing with data and analytics: External reviewers’ judgments of audit quality and effort. Contemporary Accounting Res. 40(4):2314–2339.Crossref, Google Scholar
• Estep C, Griffith EE, MacKenzie NL (2024) How do financial executives respond to the use of artificial intelligence in financial reporting and auditing? Rev. Accounting Stud. 29:2798–2831.Crossref, Google Scholar
• Farrell AM, Goh JO, White BJ (2014) The effect of performance-based incentive contracts on system 1 and system 2 processing in affective decision contexts: fMRI and behavioral evidence. Accounting Rev. 89(6):1979–2010.Crossref, Google Scholar
• Frechette GR (2015) Laboratory experiments: Professionals versus students. Frechette GR, Schotter A, eds. Handbook of Experimental Economic Methodology (Oxford University Press, Oxford, UK), 360–390.Crossref, Google Scholar
• Gaessler F, Piezunka H (2023) Training with AI: Evidence from chess computers. Strategic Management J. 44(11):2724–2750.Crossref, Google Scholar
• Glikson E, Woolley AW (2020) Human trust in artificial intelligence: Review of empirical research. Acad. Management Ann. 14(2):627–660.Crossref, Google Scholar
• Goldstein IM, Lawrence J, Miner AS (2017) Human-machine collaboration in cancer and beyond: The centaur care model. JAMA Oncology 3(10):1303–1304.Crossref, Google Scholar
• Greiner B (2015) Subject pool recruitment procedures: Organizing experiments with ORSEE. J. Econom. Sci. Assoc. 1(1):114–125.Crossref, Google Scholar
• Harvey N, Fischer I (1997) Taking advice: Accepting help, improving judgment, and sharing responsibility. Organ. Behav. Human Decision Processes 70(2):117–133.Crossref, Google Scholar
• Hertz N, Wiese E (2019) Good advice is beyond all price, but what if it comes from a machine? J. Experiment. Psych. Appl. 25(3):386–395.Crossref, Google Scholar
• Hoffman M, Kahn LB, Li D (2017) Discretion in hiring. Quart. J. Econom. 133(2):765–800.Crossref, Google Scholar
• Hossain T, Okui R (2013) The binarized scoring rule. Rev. Econom. Stud. 80(3):984–1001.Crossref, Google Scholar
• Jung M, Seiter M (2021) Towards a better understanding on mitigating algorithm aversion in forecasting: An experimental study. J. Management Control 32(4):495–516.Crossref, Google Scholar
• Kawaguchi K (2020) When will workers follow an algorithm? A field experiment with a retail business. Management Sci. 67(3):1670–1695.Link, Google Scholar
• Keding C, Meissner P (2021) Managerial overreliance on AI-augmented decision-making processes: How the use of AI-based advisory systems shapes choice behavior in R&D investment decisions. Tech. Forecasting Soc. Change 171:120970.Crossref, Google Scholar
• Kellogg KC, Valentine MA, Christin A (2020) Algorithms at work: The new contested terrain of control. Acad. Management Ann. 14(1):366–410.Crossref, Google Scholar
• Krakowski S, Luger J, Raisch S (2023) Artificial intelligence and the changing sources of competitive advantage. Strategic Management J. 44(6):1425–1452.Crossref, Google Scholar
• Labro E, Lang M, Omartian JD (2023) Predictive analytics and centralization of authority. J. Accounting Econom. 75(1):101526.Crossref, Google Scholar
• Lazear EP, Rosen S (1981) Rank-order tournaments as optimum labor contracts. J. Political Econom. 89(5):841–864.Crossref, Google Scholar
• Libby R, Lipe MG (1992) Incentives, effort, and the cognitive processes involved in accounting-related judgments. J. Accounting Res. 30(2):249–273.Crossref, Google Scholar
• Libby R, Luft J (1993) Determinants of judgment performance in accounting settings: Ability, knowledge, motivation, and environment. Accounting Organ. Soc. 18(5):425–450.Crossref, Google Scholar
• Libby R, Witz PD (2024) Can artificial intelligence reduce the effect of independence conflicts on audit firm liability? Contemporary Accounting Res. 41(2):1346–1375.Crossref, Google Scholar
• Liu M (2022) Assessing human information processing in lending decisions: A machine learning approach. J. Accounting Res. 60(2):607–651.Crossref, Google Scholar
• Liu M, Tang X, Xia S, Zhang S, Zhu Y, Meng Q (2023) Algorithm aversion: Evidence from ridesharing drivers. Management Sci., ePub ahead of print October 3, https://doi.org/10.1287/mnsc.2022.02475.Google Scholar
• Logg JM, Minson JA, Moore DA (2019) Algorithm appreciation: People prefer algorithmic to human judgment. Organ. Behav. Human Decision Processes 151:90–103.Crossref, Google Scholar
• March C, Ziegelmeyer A, Greiner B, Cyranek R (2016) Pay few subjects but pay them well: Cost-effectiveness of random incentive systems. Preprint, submitted August 11, http://dx.doi.org/10.2139/ssrn.2821053.Google Scholar
• Murray A, Rhymer J, Sirmon DG (2021) Humans and technology: Forms of conjoined agency in organizations. Acad. Management Rev. 46(3):552–571.Crossref, Google Scholar
• Neumann M, Hengeveld M, Niessen ASM, Tendeiro JN, Meijer RR (2022) Education increases decision-rule use: An investigation of education and incentives to improve decision making. J. Experiment. Psych. Appl. 28(1):166–178.Crossref, Google Scholar
• Ottaviani M, Sørensen PN (2006) The strategy of professional forecasting. J. Financial Econom. 81(2):441–466.Crossref, Google Scholar
• Poursabzi-Sangdeh F, Goldstein DG, Hofman JM, Wortman Vaughan JW, Wallach H (2021) Manipulating and measuring model interpretability. Proc. 2021 CHI Conf. Human Factors Comput. Systems CHI ‘21 (Yokohama, Japan), 237, 1–52.Google Scholar
• Prahl A, Van Swol L (2017) Understanding algorithm aversion: When is advice from automation discounted? J. Forecasting 36(6):691–702.Crossref, Google Scholar
• Raisch S, Krakowski S (2021) Artificial intelligence and management: The automation–augmentation paradox. Acad. Management Rev. 46(1):192–210.Crossref, Google Scholar
• Rajpurkar P, Chen E, Banerjee O, Topol EJ (2022) AI in health and medicine. Nature Medicine 28(1):31–38.Crossref, Google Scholar
• Samuels JA, Whitecotton SM (2011) An effort based analysis of the paradoxical effects of incentives on decision-aided performance. Behav. Decision Making 24(4):345–360.Crossref, Google Scholar
• Schlag KH, Tremewan J, van der Weele JJ (2015) A penny for your thoughts: A survey of methods for eliciting beliefs. Experiment. Econom. 18(3):457–490.Crossref, Google Scholar
• Schotter A (2023) Advice, Social Learning and the Evolution of Conventions (Cambridge University Press, Cambridge, MA).Crossref, Google Scholar
• Schotter A, Trevino I (2014) Belief elicitation in the laboratory. Annual Rev. Econom. 6(1):103–128.Crossref, Google Scholar
• Shrestha YR, Ben-Menahem SM, von Krogh G (2019) Organizational decision-making structures in the age of artificial intelligence. Calif. Management Rev. 61(3):66–83.Crossref, Google Scholar
• Sprinkle GB (2000) The effect of incentive contracts on learning and performance. Accounting Rev. 75(3):299–326.Crossref, Google Scholar
• Tasoff J, Zhang W (2022) The performance of time-preference and risk-preference measures in surveys. Management Sci. 68(2):1149–1173.Link, Google Scholar
• Tschandl P, Rinner C, Apalla Z, Argenziano G, Codella N, Halpern A, Janda M, et al. (2020) Human–computer collaboration for skin cancer recognition. Nature Medicine 26(8):1229–1234.Crossref, Google Scholar
• Wang W, Gao G(G), Agarwal R (2024) Friend or foe? Teaming between artificial intelligence and workers with variation in experience. Management Sci. 70(9):5753–5775.Abstract, Google Scholar
• Wilson HJ, Daugherty PR (2018) Collaborative intelligence: Humans and AI are joining forces. Harvard Bus. Rev. 96(4):114–123.Google Scholar
• Zellner M, Abbas AE, Budescu DV, Galstyan A (2021) A survey of human judgement and quantitative forecasting methods. Roy. Soc. Open Sci. 8(2):201187.Crossref, Google Scholar