Frontiers in Operations: Fair Funnels: Bias, Performance, and Interventions in Multistage Hiring Processes

References

• Agarwal A, Dudík M, Wu ZS (2019) Fair regression: Quantitative definitions and reduction-based algorithms. Internat. Conf. Machine Learning (PMLR, New York), 120–129.Google Scholar
• Agarwal A, Beygelzimer A, Dudík M, Langford J, Wallach H (2018) A reductions approach to fair classification. Internat. Conf. Machine Learning (PMLR, New York), 60–69.Google Scholar
• Aigner DJ, Cain GG (1977) Statistical theories of discrimination in labor markets. ILR Rev. 30(2):175–187.Crossref, Google Scholar
• Akan M, Ata B, Dana JD Jr (2015) Revenue management by sequential screening. J. Econom. Theory 159:728–774.Crossref, Google Scholar
• Altonji JG, Pierret CR (2001) Employer learning and statistical discrimination. Quart J. Econom. 116(1):313–350.Crossref, Google Scholar
• Andscape (2023) How to improve the Rooney Rule. Accessed February 15, 2023, https://andscape.com/features/how-to-improve-the-rooney-rule/.Google Scholar
• Baek J, Bastani H, Chen S (2026) Strategic hiring under algorithmic monoculture. Preprint, submitted February 18, https://arxiv.org/html/2502.20063v2.Google Scholar
• Barocas S, Hardt M, Narayanan A (2023) Fairness and Machine Learning: Limitations and Opportunities (MIT Press, Cambridge, MA).Google Scholar
• Becker GS (1957) The Economics of Discrimination (University of Chicago Press, Chicago).Google Scholar
• Benjamin DJ (2019) Errors in probabilistic reasoning and judgment biases. Bernheim BD, DellaVigna S, Laibson D, eds. Handbook of Behavioral Economics – Foundations and Applications, vol. 2 (Elsevier, Amsterdam), 69–186.Crossref, Google Scholar
• Bureau of Labor Statistics (2024a) Employee tenure in 2024. Accessed January 13, 2025, https://www.bls.gov/news.release/pdf/tenure.pdf.Google Scholar
• Bureau of Labor Statistics (2024b) Usual weekly earnings of wage and salary workers – Fourth quarter 2024. Accessed January 13, 2025, https://www.bls.gov/news.release/archives/wkyeng_01222025.htm.Google Scholar
• Campos-Mercade P, Mengel F (2024) Non-Bayesian statistical discrimination. Management Sci. 70(4):2549–2567.Link, Google Scholar
• Center for Data Science and Public Policy (2018) Aequitas: A bias and fairness audit toolkit, https://datasciencepublicpolicy.org/our-work/tools-guides/aequitas/.Google Scholar
• Charles KK, Guryan J (2008) Prejudice and wages: An empirical assessment of Becker’s the economics of discrimination. J. Political Econom. 116(5):773–809.Crossref, Google Scholar
• Chen I, Johansson FD, Sontag D (2018) Why is my classifier discriminatory? Adv. Neural Inform. Processing Systems 31 (NeurIPS, Montréal, Canada), 3539–3550.Google Scholar
• Chen R, Lu SF, Lu LX, Huang S (2024) Gender bias in job assignment: Evidence from retail frontline managers. Tuck School of Business Working Paper No. 3758149, Tuck School of Business at Dartmouth, Hanover, NH.Google Scholar
• Coate S, Loury GC (1993) Will affirmative-action policies eliminate negative stereotypes? Amer. Econom. Rev. 83(5):1220–1240.Google Scholar
• Cochran J, Mehri C (2002) Black Coaches in the National Football League: Superior Performance, Inferior Opportunities (Mehri & Skalet PLLC, Washington, DC).Google Scholar
• Cornell B, Welch I (1996) Culture, information, and screening discrimination. J. Political Econom. 104(3):542–571.Crossref, Google Scholar
• Courty P, Hao L (2000) Sequential screening. Rev. Econom. Stud. 67(4):697–717.Crossref, Google Scholar
• Cui R, Li J, Zhang DJ (2020) Reducing discrimination with reviews in the sharing economy: Evidence from field experiments on Airbnb. Management Sci. 66(3):1071–1094.Link, Google Scholar
• Dahan E, Mendelson H (2001) An extreme-value model of concept testing. Management Sci. 47(1):102–116.Link, Google Scholar
• De-Arteaga M, Romanov A, Wallach H, Chayes J, Borgs C, Chouldechova A, Geyik S, Kenthapadi K, Kalai AT (2019) Bias in bios: A case study of semantic representation bias in a high-stakes setting. Proc. Conf. Fairness, Accountability, Transparency (Association for Computing Machinery, New York), 120–128.Google Scholar
• Emelianov V, Gast N, Gummadi KP, Loiseau P (2022) On fair selection in the presence of implicit and differential variance. Artificial Intelligence 302:103609.Crossref, Google Scholar
• European Commission (2025) New EU rules to improve Gender Balance in corporate boards enter into application (January 3), https://ec.europa.eu/commission/presscorner/detail/en/ip_25_22.Google Scholar
• Farajollahzadeh S, Lee S, Manshadi V, Monachou F (2025) Why the Rooney rule fumbles: Limitations of interview-stage diversity interventions in labor markets. Proc. 26th ACM Conf. Econom. Comput. (EC ‘25) (ACM, New York).Google Scholar
• Fershtman D, Pavan A (2021) “Soft” affirmative action and minority recruitment. Amer. Econom. Rev. Insights 3(1):1–18.Crossref, Google Scholar
• Garg N, Li H, Monachou F (2025) Dropping standardized testing for admissions trades off information and access. Management Sci. Forthcoming.Google Scholar
• Glassdoor (2025) Intern salaries - January 2025. Accessed January 13, 2025, https://www.glassdoor.com/Salaries/intern-salary-SRCH_KO0,6.htm.Google Scholar
• Griffin D, Tversky A (1992) The weighing of evidence and the determinants of confidence. Cognitive Psych. 24(3):411–435.Crossref, Google Scholar
• Kannan S, Roth A, Ziani J (2019) Downstream effects of affirmative action. Proc. Conf. Fairness, Accountability, Transparency (Association for Computing Machinery, New York), 240–248.Google Scholar
• Kelley S, Ovchinnikov A, Hardoon DR, Heinrich A (2022) Antidiscrimination laws, artificial intelligence, and gender bias: A case study in nonmortgage fintech lending. Manufacturing Service Oper. Management 24(6):3039–3059.Link, Google Scholar
• Kleinberg J, Raghavan M (2018) Selection problems in the presence of implicit bias. 9th Innovations Theoret. Comput. Sci. Conf. (ITCS 2018), LIPIcs, vol. 94 (Schloss Dagstuhl–Leibniz-Zentrum für Informatik, Dagstuhl, Germany), 1–17.Google Scholar
• Komiyama J, Noda S (2024) On statistical discrimination as a failure of social learning: A multiarmed bandit approach. Management Sci. 72(1):442–455.Link, Google Scholar
• Martin D, Marx P (2022) A robust test of prejudice for discrimination experiments. Management Sci. 68(6):4527–4536.Link, Google Scholar
• Mejia J, Parker C (2021) When transparency fails: Bias and financial incentives in ridesharing platforms. Management Sci. 67(1):166–184.Link, Google Scholar
• MIT Technology Review (2021) Auditors are testing hiring algorithms for bias, but there’s no easy fix. Accessed February 11, 2021, https://www.technologyreview.com/2021/02/11/1017955/auditors-testing-ai-hiring-algorithms-bias-big-questions-remain/.Google Scholar
• Monachou FG, Ashlagi I (2019) Discrimination in online markets: Effects of social bias on learning from reviews and policy design. Adv. Neural Inform. Processing Systems 32 (NeurIPS, Vancouver, CA), 2142–2152.Google Scholar
• Moro A, Norman P (2003) Affirmative action in a competitive economy. J. Public Econom. 87(3–4):567–594.Crossref, Google Scholar
• Mullainathan S (2019) Biased algorithms are easier to fix than biased people. New York Times (December 6), https://www.nytimes.com/2019/12/06/business/algorithm-bias-fix.html.Google Scholar
• Neumark D (2018) Experimental research on labor market discrimination. J. Econom. Literature 56(3):799–866.Crossref, Google Scholar
• NFL Operations (2024) The Rooney Rule: Inclusion in NFL operations. Accessed December 23, 2024, https://operations.nfl.com/inside-football-ops/inclusion/the-rooney-rule/.Google Scholar
• NPR (2022) Why a 20-year effort by the NFL hasn't led to more minorities in top coaching jobs. Accessed February 3, 2022, https://www.npr.org/2022/02/03/1075520411/rooney-rule-nfl.Google Scholar
• Onuchic P (2022) Recent contributions to theories of discrimination. Preprint, submitted May 12, https://arxiv.org/abs/2205.05994.Google Scholar
• Ostrom TM, Sedikides C (1992) Out-group homogeneity effects in natural and minimal groups. Psych. Bull. 112(3):536–552.Crossref, Google Scholar
• Pagano TP, Loureiro RB, Lisboa FV, Peixoto RM, Guimarães GA, Cruz GO, Araujo MM, et al. (2023) Bias and unfairness in machine learning models: A systematic review on datasets, tools, fairness metrics, and identification and mitigation methods. Big Data Cognitive Comput. 7(1):15.Crossref, Google Scholar
• Phelps ES (1972) The statistical theory of racism and sexism. Amer. Econom. Rev. 62(4):659–661.Google Scholar
• Phillips LD, Edwards W (1966) Conservatism in a simple probability inference task. J. Experiment. Psych. 72(3):346–354.Crossref, Google Scholar
• Raghavan M, Kim PT (2024) Limitations of the “Four-Fifths Rule” and statistical parity tests for measuring fairness. Georgetown Law Tech. Rev. 8:93.Google Scholar
• Simon HA (1947) Administrative Behavior: A Study of Decision-Making Processes in Administrative Organizations (Macmillan, New York).Google Scholar
• Smith DF, Lasker C (2023) The Rooney suggestion: How the “rule” has failed to defeat institutional barriers to equitable hiring practices in the NFL and recommendations for meaningful reform. Fall 2023. https://yalelawandpolicy.org/rooney-suggestion-how-rule-has-failed-defeat-institutional-barriers-equitable-hiring-practices-nfl.Google Scholar
• Snyder B (2023) New EEOC guidelines to ensure AI maintains equality in the workplace. Accessed May 22, 2023. https://www.barley.com/new-eeoc-guidelines-to-ensure-ai-maintains-equality-in-the-workplace/.Google Scholar
• Tang K, Tang J (1994) Design of screening procedures: A review. J. Quality Tech. 26(3):209–226.Crossref, Google Scholar
• The Washington Post (2024) DEI’s ‘Rooney Rule’ placed under legal microscope, on and off the field. Accessed February 6, 2024, https://www.washingtonpost.com/business/2024/02/06/rooney-rule-legal-complaint-diversity-eeoc/.Google Scholar
• Visier (2023) The Rooney rule: Using it to kick off your diversity recruitment strategy. Accessed December 23, 2024, https://www.visier.com/blog/how-hr-can-tackle-diversity-using-the-rooney-rule/.Google Scholar
• Wall Street Journal (2025) Why Costco isn’t joining the backlash against DEI. Accessed January 15, 2025, https://www.wsj.com/business/costco-dei-policies-0e7a3f11.Google Scholar
• Watkins EA, Chen J (2024) The four-fifths rule is not disparate impact: A woeful tale of epistemic trespassing in algorithmic fairness. Proc. 2024 ACM Conf. Fairness, Accountability, Transparency (Association for Computing Machinery, New York), 764–775.Google Scholar
• Yang J, Soltan AA, Eyre DW, Yang Y, Clifton DA (2023) An adversarial training framework for mitigating algorithmic biases in clinical machine learning. NPJ Digital Medicine 6(1):55.Crossref, Google Scholar