Human–Algorithmic Bias: Source, Evolution, and Impact

References

• Alesina AF, Lotti F, Mistrulli PE (2013) Do women pay more for credit? Evidence from Italy. J. Eur. Econom. Assoc. 11(Suppl 1):45–66.Crossref, Google Scholar
• Angwin J, Larson J, Mattu S, Kirchner L (2022) Machine bias. Martin K, ed. Ethics of Data and Analytics: Concepts and Cases (Auerbach Publications, New York), 254–264.Crossref, Google Scholar
• Arnold D, Dobbie W, Yang CS (2018) Racial bias in bail decisions. Quart. J. Econom. 133(4):1885–1932.Crossref, Google Scholar
• Arrow KJ (1973) The theory of discrimination. Ashenfelter O, Rees A, eds. Discrimination in Labor Markets (Princeton University Press, Princeton, NJ), 3–33.Google Scholar
• Barocas S, Selbst AD (2016) Big data’s disparate impact. Calif. Law Rev. 104(3):671–732.Google Scholar
• Bartlett R, Morse A, Stanton R, Wallace N (2022) Consumer-lending discrimination in the FinTech Era. J. Financial Econom. 143(1):30–56.Google Scholar
• Bechavod Y, Ligett K (2018) Penalizing unfairness in binary classification. Preprint, submitted March 8, https://arxiv.org/abs/1707.00044.Google Scholar
• Becker GS (1957) The Economics of Discrimination (University of Chicago Press, Chicago).Google Scholar
• Berente N, Gu B, Recker J, Santhanam R (2021) Managing artificial intelligence. MIS Quart. 45(3):1433–1450.Crossref, Google Scholar
• Bertrand M, Duflo E (2017) Field experiments on discrimination. Banerjee AV, Duflo E, eds. Handbook of Economic Field Experiments, vol. 1 (North-Holland, Amsterdam), 309–393.Crossref, Google Scholar
• Bicchieri C (2016) Norms in the Wild: How to Diagnose, Measure, and Change Social Norms (Oxford University Press, Oxford, UK).Google Scholar
• Blanchflower DG, Levine PB, Zimmerman DJ (2003) Discrimination in the small-business credit market. Rev. Econom. Statist. 85(4):930–943.Crossref, Google Scholar
• Bohren JA, Imas A, Rosenberg M (2019) The dynamics of discrimination: Theory and evidence. Amer. Econom. Rev. 109(10):3395–3436.Crossref, Google Scholar
• Buolamwini J, Gebru T (2018) Gender shades: Intersectional accuracy disparities in commercial gender classification. Conf. Fairness Accountability Transparency (PMLR, New York), 77–91.Google Scholar
• Camerer CF (2019) Artificial intelligence and behavioral economics. Agrawal A, Gans J, Goldfarb A, eds. The Economics of Artificial Intelligence (University of Chicago Press, Chicago), 587–610.Google Scholar
• Chen T, Guestrin C (2016) XGBoost: A scalable tree boosting system. Proc. 22nd ACM SIGKDD Internat. Conf. Knowledge Discovery Data Mining (ACM, New York), 785–794.Google Scholar
• Chen X, Huang B, Ye D (2020) Gender gap in peer-to-peer lending: Evidence from China. J. Banking Finance 112:105633.Crossref, Google Scholar
• Chen D, Li X, Lai F (2017) Gender discrimination in online peer-to-peer credit lending: Evidence from a lending platform in China. Electronic Commerce Res. 17(4):553–583.Crossref, Google Scholar
• Chouldechova A, Roth A (2018) The frontiers of fairness in machine learning. Preprint, submitted October 20, https://arxiv.org/abs/1810.08810.Google Scholar
• Corbett-Davies S, Gaebler JD, Nilforoshan H, Shroff R, Goel S (2023) The measure and mismeasure of fairness. J. Machine Learn. Res. 24(312):1–17.Google Scholar
• Cowgill B, Dell’Acqua F, Deng S, Hsu D, Verma N, Chaintreau A (2020) Biased programmers? Or biased data? A field experiment in operationalizing AI ethics. Proc. 21st ACM Conf. Econom. Comput. (ACM, New York), 679–681.Google Scholar
• Cui X (2019) Occupational identity discrimination in peer-to-peer lending. J. Appl. Finance Banking 9(6):249–278.Google Scholar
• Cumming D, Leung TY, Rui O (2015) Gender diversity and securities fraud. Acad. Management J. 58(5):1572–1593.Crossref, Google Scholar
• Dastin J (2022) Amazon scraps secret AI recruiting tool that showed bias against women. Martin K, ed. Ethics of Data and Analytics: Concepts and Cases (Auerbach Publications, New York), 296–299.Crossref, Google Scholar
• Day TE, Liebowitz SJ (1998) Mortgage lending to minorities: Where’s the bias? Econom. Inquiry 36(1):3–28.Crossref, Google Scholar
• Dobbie W, Liberman A, Paravisini D, Pathania V (2021) Measuring bias in consumer lending. Rev. Econom. Stud. 88(6):2799–2832.Crossref, Google Scholar
• Erdem T, Keane MP (1996) Decision-making under uncertainty: Capturing dynamic brand choice processes in turbulent consumer goods markets. Marketing Sci. 15(1):1–20.Link, Google Scholar
• Erdem T, Keane MP, Sun B (2008) A dynamic model of brand choice when price and advertising signal product quality. Marketing Sci. 27(6):1111–1125.Link, Google Scholar
• Ewens M, Townsend RR (2020) Are early stage investors biased against women? J. Financial Econom. 135(3):653–677.Crossref, Google Scholar
• Fang H, Moro A (2011) Theories of statistical discrimination and affirmative action: A survey. Benhabib J, Bisin A, Jackson MO, eds. Handbook of Social Economics, vol. 1 (North-Holland, Amsterdam), 133–200.Google Scholar
• Fu R, Huang Y, Singh PV (2020) Artificial intelligence and algorithmic bias: Source, detection, mitigation, and implications. Pushing Boundaries Frontiers Impactful OR/OM Res. 2020(November):39–63.Link, Google Scholar
• Fu R, Huang Y, Singh PV (2021) Crowds, lending, machine, and bias. Inform. Systems Res. 32(1):72–92.Link, Google Scholar
• Fuster A, Goldsmith-Pinkham P, Ramadorai T, Walther A (2022) Predictably unequal? The effects of machine learning on credit markets. J. Finance 77(1):5–47.Crossref, Google Scholar
• Gino F, Coffman K (2021) Unconscious bias training that works. Harvard Bus. Rev. 99(5):114–123.Google Scholar
• Hardt M (2014) How big data is unfair: Understanding sources of unfairness in data driven decision making. Medium (September 26), https://medium.com/@mrtz/how-big-data-is-unfair-9aa544d739de.Google Scholar
• Hendershott T, Zhang X, Zhao JL, Zheng Z (2021) Fintech as a game changer: Overview of research frontiers. Inform. Systems Res. 32(1):1–17.Link, Google Scholar
• Hu X, Rudin C, Seltzer M (2019) Optimal sparse decision trees. Adv. Neural Inform. Processing Systems, vol. 32 (Curran Associates).Google Scholar
• Hu X, Huang Y, Li B, Lu T (2022) Credit risk modeling without sensitive features: An adversarial deep learning model for fairness and profit. Bjørn-Andersen N, Beck R, Petter S, Blegind Jensen T, Böhmann T, Hui KL, Venkatesh V, eds. Proc. 43rd Internat. Conf. Inform. Systems, ICIS 2022 (Association for Information Systems, Copenhagen, Denmark).Google Scholar
• Huang Y, Vir Singh P, Srinivasan K (2014) Crowdsourcing new product ideas under consumer learning. Management Sci. 60(9):2138–2159.Link, Google Scholar
• Karlan D, Goldberg N (2011) Microfinance evaluation strategies: Notes on methodology and findings. Armendáriz B, Labie M, eds. The Handbook of Microfinance (World Scientific, Singapore), 17–58.Crossref, Google Scholar
• Kleinberg J, Ludwig J, Mullainathan S, Rambachan A (2018) Algorithmic fairness. AEA Papers Proc. 108:22–27.Crossref, Google Scholar
• Knowles J, Persico N, Todd P (2001) Racial bias in motor vehicle searches: Theory and evidence. J. Political Econom. 109(1):203–229.Crossref, Google Scholar
• Lakkaraju H, Kleinberg J, Leskovec J, Ludwig J, Mullainathan S (2017) The selective labels problem: Evaluating algorithmic predictions in the presence of unobservables. Proc. 23rd ACM SIGKDD Internat. Conf. Knowledge Discovery Data Mining (Association for Computing Machinery, New York), 275–284.Google Scholar
• Lin M, Viswanathan S (2016) Home bias in online investments: An empirical study of an online crowdfunding market. Management Sci. 62(5):1393–1414.Link, Google Scholar
• List JA (2004) The nature and extent of discrimination in the marketplace: Evidence from the field. Quart. J. Econom. 119(1):49–89.Crossref, Google Scholar
• Liu LT, Dean S, Rolf E, Simchowitz M, Hardt M (2018) Delayed impact of fair machine learning. Internat. Conf. Machine Learn. (PMLR, New York), 3150–3158.Google Scholar
• Lu T, Zhang Y (2025) 1 + 1 > 2? Information, humans, and machines. Inform. Systems Res. 36(1):394–418.Link, Google Scholar
• Lu T, Zhang Y, Li B (2023) Profit vs. equality? The case of financial risk assessment and a new perspective on alternative data. MIS Quart. 47(4):1517–1556.Crossref, Google Scholar
• Lu Y, Gu B, Ye Q, Sheng Z (2012) Social influence and defaults in peer-to-peer lending networks. George JF, ed. Proc. Internat. Conf. Inform. Systems, ICIS 2012, vol. 2 (Association for Information Systems, AIS Electronic Library (AISeL), Atlanta), 1797–1813.Google Scholar
• Lucas RE Jr (1976) Econometric policy evaluation: A critique. Carnegie-Rochester Conf. Ser. Public Policy 1:19–46.Crossref, Google Scholar
• Obermeyer Z, Powers B, Vogeli C, Mullainathan S (2019) Dissecting racial bias in an algorithm used to manage the health of populations. Science 366(6464):447–453.Crossref, Google Scholar
• Parsons CA, Sulaeman J, Yates MC, Hamermesh DS (2011) Strike three: Discrimination, incentives, and evaluation. Amer. Econom. Rev. 101(4):1410–1435.Crossref, Google Scholar
• Phelps ES (1972) The statistical theory of racism and sexism. Amer. Econom. Rev. 62(4):659–661.Google Scholar
• Rudin C, Shaposhnik Y (2023) Globally-consistent rule-based summary-explanations for machine learning models: Application to credit-risk evaluation. J. Machine Learn. Res. 24(16):1–44.Google Scholar
• Sellier AL, Scopelliti I, Morewedge CK (2019) Debiasing training improves decision making in the field. Psych. Sci. 30(9):1371–1379.Crossref, Google Scholar
• Stevenson MT, Doleac JL (2024) Algorithmic risk assessment in the hands of humans. Amer. Econom. J.: Econom. Policy 16(4):382–414.Google Scholar
• Sydnor J, Pope D (2011) What’s in a picture? Evidence of discriminations from prosper.com. J. Human Resources 46(1):53–92.Google Scholar
• Tajfel H, Billig MG, Bundy RP, Flament C (1971) Social categorization and intergroup behaviour. Eur. J. Soc. Psych. 1(2):149–178.Crossref, Google Scholar
• Teodorescu MH, Morse L, Awwad Y, Kane GC (2021) Failures of fairness in automation require a deeper understanding of human-ML augmentation. MIS Quart. 45(3):1483–1500.Crossref, Google Scholar
• Zhang N, Xu H (2024) Fairness of ratemaking for catastrophe insurance: Lessons from machine learning. Inform. Systems Res. 35(2):469–488.Google Scholar
• Zhang Y, Li B, Krishnan R (2020) Learning individual behavior using sensor data: The case of global positioning system traces and taxi drivers. Inform. Systems Res. 31(4):1301–1321.Link, Google Scholar
• Zhao EY, Wry T (2016) Not all inequality is equal: Deconstructing the societal logic of patriarchy to understand microfinance lending to women. Acad. Management J. 59(6):1994–2020.Crossref, Google Scholar