Algorithmic Writing Assistance on Jobseekers’ Resumes Increases Hires

Published Online:https://doi.org/10.1287/mnsc.2024.04528

References

  • Abebe G, Caria AS, Ortiz-Ospina E (2021) The selection of talent: Experimental and structural evidence from Ethiopia. Amer. Econom. Rev. 111(6):1757–1806.CrossrefGoogle Scholar
  • Agrawal A, Gans J, Goldfarb A (2018a) Prediction, judgment, and complexity: A theory of decision-making and artificial intelligence. The Economics of Artificial Intelligence: An Agenda (University of Chicago Press), 89–110.Google Scholar
  • Agrawal A, Gans J, Goldfarb A (2018b) Prediction Machines: The Simple Economics of Artificial Intelligence (Harvard Business Press, Boston).Google Scholar
  • Agrawal A, Lacetera N, Lyons E (2016) Does standardized information in online markets disproportionately benefit job applicants from less developed countries? J. Internat. Econom. 103:1–12.CrossrefGoogle Scholar
  • Agrawal A, Horton J, Lacetera N, Lyons E (2015) Digitization and the contract labor market. Goldfarb A, Greenstein SM, Tucker CE, eds. Economic Analysis of the Digital Economy (University of Chicago Press, Chicago), 219.CrossrefGoogle Scholar
  • Alvero AJ, Giebel S, Gebre-Medhin B, Antonio AL, Stevens ML, Domingue BW (2021) Essay content and style are strongly related to household income and SAT scores: Evidence from 60,000 undergraduate applications. Sci. Adv. 7(42):eabi9031.CrossrefGoogle Scholar
  • Belot M, Kircher P, Muller P (2018) Providing advice to jobseekers at low cost: An experimental study on online advice. Rev. Econom. Stud. 86(4):1411–1447.CrossrefGoogle Scholar
  • Bertrand M, Mullainathan S (2004) Are Emily and Greg more employable than Lakisha and Jamal? A field experiment on labor market discrimination. Amer. Econom. Rev. 94(4):991–1013.CrossrefGoogle Scholar
  • Bolton G, Greiner B, Ockenfels A (2013) Engineering trust: Reciprocity in the production of reputation information. Management Sci. 59(2):265–285.LinkGoogle Scholar
  • Briscese G, Zanella G, Quinn V (2022) Providing government assistance online: A field experiment with the unemployed. J. Policy Anal. Management 41(2):579–602.CrossrefGoogle Scholar
  • Brown T, Mann B, Ryder N, Subbiah M, Kaplan JD, Dhariwal P, Neelakantan A, et al. (2020) Language models are few-shot learners. Larochelle H, Ranzato M, Hadsell R, Balcan MF, Lin H, eds. Advances in Neural Information Processing Systems, vol. 33 (Curran Associates, Inc., Red Hook, NY), 1877–1901.Google Scholar
  • Brynjolfsson E, Li D, Raymond LR (2023) Generative AI at work. Technical report, National Bureau of Economic Research, Cambridge, MA.Google Scholar
  • Cai H, Jin GZ, Liu C, An Zhou L (2014) Seller reputation: From word-of-mouth to centralized feedback. Internat. J. Indust. Organ. 34:51–65.CrossrefGoogle Scholar
  • Card D, Kluve J, Weber A (2010) Active labour market policy evaluations: A meta-analysis. Econom. J. 120(548):F452–F477.Google Scholar
  • Cavaleri M, Dianati S (2016) You want me to check your grammar again?: The usefulness of an online grammar checker as perceived by students. J. Academic Language Learn. 10(1):A223–A236.Google Scholar
  • Chan J, Wang J (2018) Hiring preferences in online labor markets: Evidence of a female hiring bias. Management Sci. 64(7):2973–2994.LinkGoogle Scholar
  • Cowgill B, Hernandez-Lagos P, Wright NL (2024) Does AI cheapen talk? Theory and evidence from global entrepreneurship and hiring. Preprint, submitted January 22, http://dx.doi.org/10.2139/ssrn.4702114.Google Scholar
  • Crépon B, Duflo E, Gurgand M, Rathelot R, Zamora P (2013) Do labor market policies have displacement effects? Evidence from a clustered randomized experiment. Quart. J. Econom. 128(2):531–580.CrossrefGoogle Scholar
  • Dell’Acqua F (2022) Falling asleep at the wheel: Human/AI collaboration in a field experiment on HR recruiters. Working paper, Harvard Business School, Cambridge, MA.Google Scholar
  • Deming DJ (2017) The growing importance of social skills in the labor market. Quart. J. Econom. 132(4):1593–1640.CrossrefGoogle Scholar
  • Eloundou T, Manning S, Mishkin P, Rock D (2024) GPTs are GPTs: Labor market impact potential of LLMs. Science 384(6702):1306–1308.Google Scholar
  • Farber HS, Silverman D, Von Wachter T (2016) Determinants of callbacks to job applications: An audit study. Amer. Econom. Rev. 106(5):314–318.CrossrefGoogle Scholar
  • Felten EW, Raj M, Seamans R (2023) Occupational heterogeneity in exposure to generative AI. Preprint, submitted April 19, http://dx.doi.org/10.2139/ssrn.4414065.Google Scholar
  • Figueredo L, Varnhagen CK (2005) Didn’t you run the spell checker? Effects of type of spelling error and use of a spell checker on perceptions of the author. Reading Psych. 26(4–5):441–458.CrossrefGoogle Scholar
  • Filippas A, Horton JJ, Golden J (2022) Reputation inflation. Marketing Sci. 41(4):663–869.LinkGoogle Scholar
  • Flesch R (1948) A new readability yardstick. J. Appl. Psych. 32(3):221.CrossrefGoogle Scholar
  • Fradkin A, Grewal E, Holtz D (2021) Reciprocity and unveiling in two-sided reputation systems: Evidence from an experiment on airbnb. Marketing Sci. 40(6):1013–1029.LinkGoogle Scholar
  • Galletta DF, Durcikova A, Everard A, Jones BM (2005) Does spell-checking software need a warning label? Commun. ACM 48(7):82–86.CrossrefGoogle Scholar
  • Ghose A, Ipeirotis PG (2010) Estimating the helpfulness and economic impact of product reviews: Mining text and reviewer characteristics. IEEE Trans. Knowledge Data Engrg. 23(10):1498–1512.CrossrefGoogle Scholar
  • Goldfarb A, Tucker C (2019) Digital economics. J. Econom. Literature 57(1):3–43.CrossrefGoogle Scholar
  • HF Canonical Model Maintainers (2022) DistilBERT-base-uncased-finetuned-sst-2-English (Revision bfdd146). Hugging Face. https://huggingface.co/distilbert-base-uncased-finetuned-sst-2-english.Google Scholar
  • Hong Y, Peng J, Burtch G, Huang N (2021) Just DM me (politely): Direct messaging, politeness, and hiring outcomes in online labor markets. Inform. Systems Res. 32(3):786–800.LinkGoogle Scholar
  • Horton JJ (2010) Online labor markets. Proc. 6th Internat. Workshop Internet Network Econom., vol. 6484 (Springer, Berlin, Heidelberg).Google Scholar
  • Horton JJ (2017) The effects of algorithmic labor market recommendations: Evidence from a field experiment. J. Labor Econom. 35(2):345–385.CrossrefGoogle Scholar
  • Kang SK, DeCelles KA, Tilcsik A, Jun S (2016) Whitened résumés: Race and self-presentation in the labor market. Admin. Sci. Quart. 61(3):469–502.CrossrefGoogle Scholar
  • Kincaid JP, Fishburn RP, Rogers RL, Chissom BS (1975) Derivation of new readability formulas for navy enlisted personnel. Technical Report Research Branch Report, Naval Technical Training, Millington, TN; US Naval Air Station, Memphis, TN.Google Scholar
  • Kokkodis M, Ransbotham S (2023) Learning to successfully hire in online labor markets. Management Sci. 69(3):1323–1934.LinkGoogle Scholar
  • Lee DS (2009) Training, wages, and sample selection: Estimating sharp bounds on treatment effects. Rev. Econom. Stud. 76(3):1071–1102.CrossrefGoogle Scholar
  • Luca M, Reshef O (2021) The effect of price on firm reputation. Management Sci. 67(7):4408–4419.LinkGoogle Scholar
  • Marinescu I (2017) The general equilibrium impacts of unemployment insurance: Evidence from a large online job board. J. Public Econom. 150:14–29.CrossrefGoogle Scholar
  • Marinescu I, Wolthoff R (2020) Opening the black box of the matching function: The power of words. J. Labor Econom. 38(2):535–568.CrossrefGoogle Scholar
  • Martin-Lacroux C, Lacroux A (2017) Do employers forgive applicants’ bad spelling in résumés? Bus. Professional Comm. Quart. 80(3):321–335.CrossrefGoogle Scholar
  • McGee T, Ericsson P (2002) The politics of the program: MS Word as the invisible grammarian. Comput. Composition 19(4):453–470.CrossrefGoogle Scholar
  • Moss-Racusin CA, Dovidio JF, Brescoll VL, Graham MJ, Handelsman J (2012) Science faculty’s subtle gender biases favor male students. Proc. Natl. Acad. Sci. USA 109(41):16474–16479.CrossrefGoogle Scholar
  • Noy S, Zhang W (2023) Experimental evidence on the productivity effects of generative artificial intelligence. Science 381(6654):187–192.Google Scholar
  • Oreopoulos P (2011) Why do skilled immigrants struggle in the labor market? A field experiment with thirteen thousand resumes. Amer. Econom. J. Econom. Policy 3(4):148–171.CrossrefGoogle Scholar
  • Pallais A (2014) Inefficient hiring in entry-level labor markets. Amer. Econom. Rev. 104(11):3565–3599.CrossrefGoogle Scholar
  • Sajjadiani S, Sojourner AJ, Kammeyer-Mueller JD, Mykerezi E (2019) Using machine learning to translate applicant work history into predictors of performance and turnover. J. Appl. Psych. 104(10):1207.CrossrefGoogle Scholar
  • Singh JP, Irani S, Rana NP, Dwivedi YK, Saumya S, Kumar Roy P (2017) Predicting the “helpfulness” of online consumer reviews. J. Bus. Res. 70:346–355.CrossrefGoogle Scholar
  • Snyder I (1993) Writing with word processors: A research overview. Ed. Res. 35(1):49–68.CrossrefGoogle Scholar
  • Stanton CT, Thomas C (2016) Landing the first job: The value of intermediaries in online hiring. Rev. Econom. Stud. 83(2):810–854.CrossrefGoogle Scholar
  • Sterkens P, Caers R, De Couck M, Geamanu M, Van Driessche V, Baert S (2023) Costly mistakes: Why and when spelling errors in resumes jeopardise interview chances. PLoS One 18(4):e0283280.Google Scholar
  • Tafti EA (2022) Technology, Skills, and Performance: The Case of Robots in Surgery (Institute for Fiscal Studies, London).Google Scholar
  • Vernon A (2000) Computerized grammar checkers 2000: Capabilities, limitations, and pedagogical possibilities. Comput. Composition 17(3):329–349.CrossrefGoogle Scholar
  • Weiss D, Liu SX, Mieczkowski H, Hancock JT (2022) Effects of using artificial intelligence on interpersonal perceptions of job applicants. Cyberpsych. Behav. Soc. Networks 25(3):163–168.CrossrefGoogle Scholar
  • Wiles, E Horton J (2025) Generative AI and labor market matching efficiency. Working paper, Boston University, Boston.Google Scholar
INFORMS site uses cookies to store information on your computer. Some are essential to make our site work; Others help us improve the user experience. By using this site, you consent to the placement of these cookies. Please read our Privacy Statement to learn more.