The Anchoring Effect, Algorithmic Fairness, and the Limits of Information Transparency for Emotion Artificial Intelligence

References

• Adjerid I, Acquisti A, Loewenstein G (2018) Choice architecture, framing, and cascaded privacy choices. Management Sci. 65(5):2267–2290.Google Scholar
• Adomavicius G, Bockstedt JC, Curley SP, Zhang J (2013) Do recommender systems manipulate consumer preferences? A study of anchoring effects. Inform. Systems Res. 24(4):956–975.Link, Google Scholar
• Angwin J, Larson J, Mattu S, Kirchner L (2016) Machine bias. ProPublica (May 23), https://www.propublica.org/article/machine-bias-risk-assessments-in-criminal-sentencing.Google Scholar
• Ariely D, Loewenstein G, Prelec D (2003) “Coherent arbitrariness”: Stable demand curves without stable preferences. Quart. J. Econom. 118(1):73–106.Crossref, Google Scholar
• Awwad Y, Fletcher R, Frey D, Gandhi A, Najafian M, Teodorescu M (2020) Exploring fairness in machine learning for international development. Technical report, CITE MIT D-Laboratory, Cambridge, MA.Google Scholar
• Bänziger T, Grandjean D, Scherer KR (2009) Emotion recognition from expressions in face, voice, and body: The Multimodal Emotion Recognition Test (MERT). Emotion 9(5):691–704.Crossref, Google Scholar
• Barocas S, Selbst AD (2016) Big data’s disparate impact. Calif. Law Rev. 104(3):671–732. Google Scholar
• Barrett LF (2017) How Emotions Are Made: The Secret Life of the Brain (Houghton Mifflin Harcourt, Boston).Google Scholar
• Bartlett R, Morse A, Stanton R, Wallace N (2022) Consumer-lending discrimination in the FinTech era. J. Financial Econom. 143(1):30–56. Google Scholar
• Bassellier G, Ramaprasad J (2023). All external reference prices are not the same: How magnitude, source, and fairness shape payment for digital goods. Inform. Systems Res., ePub ahead of print March 9, https://doi.org/10.1287/isre.2023.1206.Google Scholar
• Bates D, Mächler M, Bolker B, Walker S (2015) Fitting linear mixed-effects models using lme4. J. Statist. Software 67(1):1–48.Crossref, Google Scholar
• Benitez-Quiroz CF, Srinivasan R, Martinez AM (2016) EmotioNet: An accurate, real-time algorithm for the automatic annotation of a million facial expressions in the wild. 2016 IEEE Conf. Comput. Vision Pattern Recognition (CVPR) (IEEE, Piscataway, NJ), 5562–5570.Google Scholar
• Bogert E, Schecter A, Watson RT (2021) Humans rely more on algorithms than social influence as a task becomes more difficult. Sci. Rep. 11(1):8028.Crossref, Google Scholar
• Brewer NT, Chapman GB (2002) The fragile basic anchoring effect. J. Behav. Decision Making 15(1):65–77.Crossref, Google Scholar
• Buolamwini J, Gebru T (2018) Gender shades: Intersectional accuracy disparities in commercial gender classification. Proc. Machine Learn. Res. 81:1–15.Google Scholar
• Cao Z, Yan R, Huang Y, Shi Z (2019) Gigapixel-level image crowd counting using Csrnet. 2019 IEEE Internat. Conf. Multimedia & Expo Workshops (ICMEW) (IEEE, Piscataway, NJ), 426–428.Google Scholar
• Choudhury P, Wang D, Carlson NA, Khanna T (2019) Machine learning approaches to facial and text analysis: Discovering CEO oral communication styles. Strategic Management J. 40(11):1705–1732.Crossref, Google Scholar
• Cohen I, Garg A, Huang TS (2000) Emotion recognition from facial expressions using multilevel HMM. Leen TK, Dietterich TG, Tresp V, eds. Neural Inform. Processing Systems, vol. 2 (MIT Press, Cambridge, MA).Google Scholar
• Corbett-Davies S, Pierson E, Feller A, Goel S, Huq A (2017) Algorithmic decision making and the cost of fairness. Proc. 23rd ACM SIGKDD Internat. Conf. Knowledge Discovery Data Mining (Association for Computing Machinery, New York), 797–806.Google Scholar
• Cowgill B (2017) Bias and productivity in humans and algorithms: Theory and evidence from resume screening. Working paper, IZA world of labor, Washington DC.Google Scholar
• Crawford K (2013) The hidden biases in big data. Harvard Bus. Rev. (April 1), https://hbr.org/2013/04/the-hidden-biases-in-big-data.Google Scholar
• Dehghan A, Ortiz EG, Shu G, Masood SZ (2017) DAGER: Deep age, gender and emotion recognition using convolutional neural network. Preprint, submitted March 4, http://arxiv.org/abs/1702.04280.Google Scholar
• Elfenbein HA, Ambady N (2002) On the universality and cultural specificity of emotion recognition: A meta-analysis. Psych. Bull. 128(2):203–235.Crossref, Google Scholar
• Eslami M, Kumaran SRK, Sandvig C, Karahalios K (2018) Communicating algorithmic process in online behavioral advertising. Conf. Human Factors Comput. Systems Proc. 2018 April (Association for Computing Machinery, New York), 1–13.Google Scholar
• Fu R, Aseri M, Singh PV, Srinivasan K (2022) “Un”fair machine learning algorithms. Management Sci. 68(6):4173–4195.Link, Google Scholar
• Furnham A, Boo HC (2011) A literature review of the anchoring effect. J. Socio-Economics 40(1):35–42.Crossref, Google Scholar
• Gendron M, Roberson D, van der Vyver JM, Barrett LF (2014) Perceptions of emotion from facial expressions are not culturally universal: Evidence from a remote culture. Emotion 14(2):251–262.Crossref, Google Scholar
• Grother P, Ngan M, Hanaoka K (2019) Face recognition vendor test part 3: Demographic effects. NIST Interagency or Internal Report No. 8280, National Institute of Standards and Technology, Gaithersburg, MD.Google Scholar
• Gunaratne J, Zalmanson L, Nov O (2018) The persuasive power of algorithmic and crowdsourced advice. J. Management Inform. Systems 35(4):1092–1120.Crossref, Google Scholar
• Halberstadt AG, Cooke AN, Garner PW, Hughes SA, Oertwig D, Neupert SD (2022) Racialized emotion recognition accuracy and anger bias of children’s faces. Emotion 22(3):403–417.Crossref, Google Scholar
• Hardt M, Price E, Srebro N (2016) Equality of opportunity in supervised learning. Lee D, Sugiyama M, Luxburg U, Guyon I, Garnett R, eds. Adv. Neural Inform. Processing Systems (NIPS), vol. 29 (Curran Associates Inc., Red Hook, NY), 3315–3323.Google Scholar
• Harwell D (2019) A face-scanning algorithm increasingly decides whether you deserve the job. Washington Post (October 22), https://www.washingtonpost.com/technology/2019/10/22/ai-hiring-face-scanning-algorithm-increasingly-decides-whether-you-deserve-job/.Google Scholar
• Johnston PJ, Katsikitis M, Carr VJ (2001) A generalised deficit can account for problems in facial emotion recognition in schizophrenia. Biological Psych. 58(3):203–227.Crossref, Google Scholar
• Kilbride JE, Yarczower M (1983) Ethnic bias in the recognition of facial expressions. J. Nonverbal Behav. 8(1):27–41.Crossref, Google Scholar
• Kirita T, Endo M (1995) Happy face advantage in recognizing facial expressions. Acta Psychologica 89(2):149–163.Google Scholar
• Kleinberg J (2018) Inherent trade-Offs in algorithmic fairness. 2018 ACM Internat. Conf. Measurement and Modeling of Computer Systems (SIGMETRICS ’18) (Association for Computing Machinery, New York), 40.Google Scholar
• Kleinberg J, Ludwig J, Mullainathan S, Rambachan A (2018) Algorithmic fairness. AEA Papers Proc. 108:22–27.Crossref, Google Scholar
• Kotchemidova C (2005) Why we say “cheese”: Producing the smile in snapshot photography. Critical Stud. Media Comm. 22(1):2–25.Crossref, Google Scholar
• Lehmann CA, Haubitz CB, Fügener A, Thonemann UW (2022) The risk of algorithm transparency: How algorithm complexity drives the effects on the use of advice. Production Oper. Management 31(9):3419–3434.Crossref, Google Scholar
• Leppänen JM, Hietanen JK (2004) Positive facial expressions are recognized faster than negative facial expressions, but why? Psych. Res. 69(1):22–29.Crossref, Google Scholar
• Logg JM, Minson JA, Moore DA (2019) Algorithm appreciation: People prefer algorithmic to human judgment. Organ. Behav. Human Decision Processes 151(2):90–103.Crossref, Google Scholar
• Luca M, Kleinberg J, Mullainathan S (2016) Algorithms need managers, too. Harvard Bus. Rev. 94(1):20.Google Scholar
• Mehrabi N, Morstatter F, Saxena N, Lerman K, Galstyan A (2022) A survey on bias and fairness in machine learning. ACM Comput. Surveys 54(6):1–35.Crossref, Google Scholar
• Mejia J, Parker C (2021) When transparency fails: Bias and financial incentives in ridesharing platforms. Management Sci. 67(1):166–184.Link, Google Scholar
• Mochon D, Frederick S (2013) Anchoring in sequential judgments. Organ. Behav. Human Decision Processes 122(1):69–79.Crossref, Google Scholar
• Morse L, Teodorescu MHM, Awwad Y, Kane GC (2022) Do the ends justify the means? Variation in the distributive and procedural fairness of machine learning algorithms. J. Bus. Ethics 181(4):1083–1095.Crossref, Google Scholar
• Nowicki S, Glanville D, Demertzis A (1998) A test of the ability to recognize emotion in the facial expressions of African American adults. J. Black Psych. 24(3):335–350.Crossref, Google Scholar
• Obermeyer Z, Powers B, Vogeli C, Mullainathan S (2019) Dissecting racial bias in an algorithm used to manage the health of populations. Science 366(6464):447–453.Crossref, Google Scholar
• O’Leary L (2022) What if Zoom could read your facial expression? Slate (May 16), https://slate.com/technology/2022/05/emotion-ai-zoom-sales-classroom.html.Google Scholar
• O’Neil C (2016) Weapons of Math Destruction: How Big Data Increases Inequality and Threatens Democracy (Crown, New York).Google Scholar
• Raji ID, Buolamwini J (2019) Actionable auditing: Investigating the impact of publicly naming biased performance results of commercial AI products. Proc. 2019 AAAI/ACM Conf. AI Ethics Soc. (Association for Computing Machinery, New York), 429–435.Google Scholar
• Rhue L, Washington AL (2020) AI’s wide open: Premature artificial intelligence and public policy. Boston Univ. J. Sci. Tech. Law 26(2):353–378.Google Scholar
• Robinson JP, Livitz G, Henon Y, Qin C, Fu Y, Timoner S (2020) Face recognition: Too bias, or not too bias? Proc. IEEE/CVF Conf. Computer Vision and Pattern Recognition Workshops (IEEE, Piscataway, NJ), 1–10.Google Scholar
• Somers M (2019) Emotion AI, explained. MIT Management Sloan (March 8), https://mitsloan.mit.edu/ideas-made-to-matter/emotion-ai-explained.Google Scholar
• Srivastava M, Heidari H, Krause A (2019) Mathematical notions vs. human perception of fairness: A descriptive approach to fairness for machine learning. Proc. 25th ACM SIGKDD Internat. Conf. Knowledge Discovery Data Mining (Association for Computing Machinery, New York), 2459–2468.Google Scholar
• Tambe P, Cappelli P, Yakubovich V (2019) Artificial intelligence in human resources management: Challenges and a path forward. Calif. Management Rev. 61(4):15–42.Crossref, Google Scholar
• Telford T (2019) “Emotion detection” AI is a $20 billion industry. New research says it can’t do what it claims. Washington Post (July 31), https://www.washingtonpost.com/business/2019/07/31/emotion-detection-ai-is-billion-industry-new-research-says-it-cant-do-what-it-claims/.Google Scholar
• Teodorescu M, Morse L, Awwad Y, Kane G (2021) Failures of fairness in automation require a deeper understanding of human-ML augmentation. MIS Quart. 45(3):1483–1500.Crossref, Google Scholar
• Teodorescu MHM, Ordabayeva N, Kokkodis M, Unnam A, Aggarwal V (2022) Determining systematic differences in human graders for machine learning-based automated hiring. Working paper, Brookings Institute, Washington, DC.Google Scholar
• Thomas D (2018) The cameras that know if you’re happy—or a threat. BBC News (July 17), https://www.bbc.com/news/business-44799239.Google Scholar
• Torralba A, Efros AA (2011) Unbiased look at data set bias. CVPR 2011 (IEEE, Piscataway, NJ), 1521–1528.Google Scholar
• Turner Lee N, Resnick P, Barton G (2019) Algorithmic bias detection and mitigation: Best practices and policies to reduce consumer harms. Brookings (May 22), https://www.brookings.edu/research/algorithmic-bias-detection-and-mitigation-best-practices-and-policies-to-reduce-consumer-harms/.Google Scholar
• Tversky A, Kahneman D (1974) Judgment under uncertainty: Heuristics and biases. Science 185(4157):1124–1131.Google Scholar
• Vaish A, Carpenter M, Tomasello M (2009) Sympathy through affective perspective taking and its relation to prosocial behavior in toddlers. Developmental Psych. 45(2):534–543.Crossref, Google Scholar
• van Exel NJA, Brouwer WBF, van den Berg B, Koopmanschap MA (2006) With a little help from an anchor: Discussion and evidence of anchoring effects in contingent valuation. J. Socio-Economics 35(5):836–853.Crossref, Google Scholar
• Xu Y, Price T, Frahm J-M, Monrose F (2016) Virtual U: Defeating face liveness detection by building virtual models from your public photos. 25th USENIX Security Sympos. 4, vol. 17 (ACM, New York), 497–512.Google Scholar
• Xu T, White J, Kalkan S, Gunes H (2020) Investigating bias and fairness in facial expression recognition. Bartoli A, Fusiello A, eds. Computer Vision – ECCV 2020 Workshops. ECCV 2020. Lecture Notes in Computer Science, vol. 12540 (Springer, Cham), 506–523.Google Scholar