Can AI and AI-Hybrids Detect Persuasion Skills? Salesforce Hiring with Conversational Video Interviews

References

• Abdu SA, Yousef AH, Salem A (2021) Multimodal video sentiment analysis using deep learning approaches, a survey. Inform. Fusion 76:204–226.Crossref, Google Scholar
• Arora S, Narayan A, Chen MF, Orr L, Guha N, Bhatia K, Chami I, Sala F, Ré C (2022) Ask me anything: A simple strategy for prompting language models. Preprint, submitted October 5, https://arxiv.org/abs/2210.02441.Google Scholar
• Ashnai B, Mani S, Kothandaraman P, Shekari S (2020) Gender bias in the recruitment of entry-level B2B salespeople. J. Bus. Indust. Marketing 35(8):1335–1344.Crossref, Google Scholar
• Athey S, Tibshirani J, Wager S (2019) Generalized random forests. Ann. Statist. 47(2):1148–1178.Crossref, Google Scholar
• Autor DH, Scarborough D (2008) Does job testing harm minority workers? Evidence from retail establishments. Quart. J. Econom. 123(1):219–277.Crossref, Google Scholar
• Black JS, van Esch P (2020) AI-enabled recruiting: What is it and how should a manager use it? Bus. Horizons 63(2):215–226.Crossref, Google Scholar
• Brahma S (2018) Improved sentence modeling using suffix bidirectional LSTM. Preprint, submitted May 18, https://arxiv.org/abs/1805.07340.Google Scholar
• Brown T, Mann B, Ryder N, Subbiah M, Kaplan JD, Dhariwal P, Neelakantan A, et al. (2020) Language models are few-shot learners. Adv. Neural Inform. Processing Systems 33:1877–1901.Google Scholar
• Camp R, Schulz E, Vielhaber M, Wagner-Marsh F (2004) Human resource professionals’ perceptions of team interviews. J. Managerial Psych. 19(5):490–505.Crossref, Google Scholar
• Campion MA, Palmer DK, Campion JE (1997) A review of structure in the selection interview. Personnel Psych. 50(3):655–702.Crossref, Google Scholar
• Cao Z, Hidalgo Martinez G, Simon T, Wei S, Sheikh YA (2019) OpenPose: Realtime multi-person 2D pose estimation using part affinity fields. IEEE Trans. Pattern Anal. Machine Intelligence 43:172–186.Crossref, Google Scholar
• Chang HH, Mukherjee A, Chattopadhyay A (2023) More voices persuade: The attentional benefits of voice numerosity. J. Marketing Res. 60(4):687–706.Crossref, Google Scholar
• Chartrand TL, Bargh JA (1999) The chameleon effect: The perception–behavior link and social interaction. J. Personality Soc. Psych. 76(6):893–910.Crossref, Google Scholar
• Chen X-P, Yao X, Kotha S (2009) Entrepreneur passion and preparedness in business plan presentations: A persuasion analysis of venture capitalists’ funding decisions. Acad. Management J. 52(1):199–214.Crossref, Google Scholar
• Chen L, Zhao R, Leong CW, Lehman B, Feng G, Hoque ME (2017) Automated video interview judgment on a large-sized corpus collected online. 2017 Seventh Internat. Conf. Affective Computing Intelligent Interaction ACII (IEEE, Piscataway, NJ), 504–509.Google Scholar
• Chen L, Feng G, Leong CW, Lehman B, Martin-Raugh M, Kell H, Lee CM, Yoon S-Y (2016) Automated scoring of interview videos using doc2vec multimodal feature extraction paradigm. Proc. 18th ACM Internat. Conf. Multimodal Interaction ICMI ‘16 (Association for Computing Machinery, New York), 161–168.Google Scholar
• Chowdhury S, Dey P, Joel-Edgar S, Bhattacharya S, Rodriguez-Espindola O, Abadie A, Truong L (2023) Unlocking the value of artificial intelligence in human resource management through AI capability framework. Human Resource Management Rev. 33(1):100899.Crossref, Google Scholar
• Chudasama V, Kar P, Gudmalwar A, Shah N, Wasnik P, Onoe N (2022) M2FNet: Multi-modal fusion network for emotion recognition in conversation. Proc. IEEE/CVF Conf. Comput. Vision Pattern Recognition (IEEE, Piscataway, NJ), 4652–4661.Google Scholar
• Churchill GA, Collins RH, Strang WA (1975) Should retail salespersons be similar to their customers? J. Retailing 51(3):29–42.Google Scholar
• Cialdini RB (2009) Influence: Science and Practice, vol. 3 (Pearson Education, Boston), 51–96.Google Scholar
• Cialdini RB, Goldstein NJ (2004) Social influence: Compliance and conformity. Annu. Rev. Psychol. 55(1):591–621.Crossref, Google Scholar
• Conway JM, Jako RA, Goodman DF (1995) A meta-analysis of interrater and internal consistency reliability of selection interviews. J. Appl. Psych. 80(5):565–579.Crossref, Google Scholar
• Cowgill B (2018) Bias and productivity in humans and algorithms: Theory and evidence from resume screening. Columbia Business School, Columbia University, New York.Google Scholar
• Criteriacorp (2022) Video interviewing in 2022 and beyond. Accessed July 25, 2024, https://www.criteriacorp.com/blog/video-interviewing-in-2022-and-beyond.Google Scholar
• Danescu-Niculescu-Mizil C, Lee L (2011) Chameleons in imagined conversations: A new approach to understanding coordination of linguistic style in dialogs. Preprint, submitted June 15, https://arxiv.org/abs/1106.3077.Google Scholar
• Danescu-Niculescu-Mizil C, Lee L, Pang B, Kleinberg J (2012) Echoes of power: Language effects and power differences in social interaction. Proc. 21st Internat. Conf. World Wide Web (Association for Computing Machinery, New York), 699–708.Google Scholar
• Dubinsky AJ (1981) A factor analytic study of the personal selling process. J. Personal Selling Sales Management 1(1):26–33.Google Scholar
• Erickson B, Lind EA, Johnson BC, O’Barr WM (1978) Speech style and impression formation in a court setting: The effects of “powerful” and “powerless” speech. J. Experiment. Soc. Psych. 14(3):266–279.Crossref, Google Scholar
• Evans FB (1963) Selling as a dyadic relationship—A new approach. Amer. Behav. Sci. 6(9):76–79.Crossref, Google Scholar
• Fast J (1970) Body Language, vol. 82348 (Simon and Schuster, New York).Google Scholar
• Fong H, Kumar V, Sudhir K (2023) A theory-based interpretable deep learning architecture for music emotion. Preprint, submitted September 26, https://dx.doi.org/10.2139/ssrn.4025386.Google Scholar
• Forbes. Remote work statistics and trends in 2024. Accessed July 28, 2024, https://www.forbes.com/advisor/in/business/remote-work-statistics/.Google Scholar
• Frazier GL, Summers JO (1984) Interfirm influence strategies and their application within distribution channels. J. Marketing 48(3):43–55.Crossref, Google Scholar
• Gonzalez MF, Liu W, Shirase L, Tomczak DL, Lobbe CE, Justenhoven R, Martin NR (2022) Allying with AI? Reactions toward human-based, AI/ML-based, and augmented hiring processes. Comput. Human Behav. 130:107179.Crossref, Google Scholar
• Hammer F, Reichl P, Raake A (2004) Elements of interactivity in telephone conversations. Proc. Interspeech, 1741–1744.Google Scholar
• Hawes JM, Rich GA (1998) Selling and sales management in action: The constructs of sales coaching: Supervisory feedback, role modeling and trust. J. Personal Selling Sales Management 18(1):53–63.Google Scholar
• Holstein K, Aleven V, Rummel N (2020) A conceptual framework for human–AI hybrid adaptivity in education. Bittencourt I, Cukurova M, Muldner K, Luckin R, Millán E, eds. 21st Internat. Conf. Artificial Intelligence Ed. AIED 2020 (Springer, Cham, Switzerland), 240–254.Google Scholar
• Hoffman M, Kahn LB, Li D (2018) Discretion in hiring. Quart. J. Econom. 133(2):765–800.Crossref, Google Scholar
• Hunkenschroer AL, Luetge C (2022) Ethics of AI-enabled recruiting and selection: A review and research agenda. J. Bus. Ethics 178(4):977–1007.Crossref, Google Scholar
• Hwang S, Liu X, Srinivasan K (2021) Voice analytics of online influencers-soft selling in branded videos. Preprint, submitted January 26, https://dx.doi.org/10.2139/ssrn.3773825.Google Scholar
• Ireland ME, Pennebaker JW (2010) Language style matching in writing: Synchrony in essays, correspondence, and poetry. J. Personality Soc. Psychol. 99(3):549–571.Crossref, Google Scholar
• Kahneman D, Sibony O, Sunstein CR (2021) Noise: A Flaw in Human Judgment (Hachette, UK).Google Scholar
• Karpathy A, Toderici G, Shetty S, Leung T, Sukthankar R, Fei-Fei L (2014) Large-scale video classification with convolutional neural networks. Proc. IEEE Conf. Comput. Vision Pattern Recognition (IEEE, Piscataway, NJ), 1725–1732.Google Scholar
• Kendon A (1994) Do gestures communicate? A review. Res. Language Soc. Interaction 27(3):175–200.Crossref, Google Scholar
• Krauss RM, Morrel-Samuels P, Colasante C (1991) Do conversational hand gestures communicate? J. Personality Soc. Psych. 61(5):743–754.Crossref, Google Scholar
• Le Mens G, Kovács B, Hannan MT, Pros G (2023) Uncovering the semantics of concepts using GPT-4 and other recent large language models. Proc. Natl. Acad. Sci. 120(49):e2309350120.Google Scholar
• Levashina J, Hartwell CJ, Morgeson FP, Campion MA (2014) The structured employment interview: Narrative and quantitative review of the research literature. Personnel Psych. 67(1):241–293.Crossref, Google Scholar
• Lichtenthal JD, Tellefsen T (2001) Toward a theory of business buyer-seller similarity. J. Personal Selling Sales Management 21(1):1–14.Google Scholar
• Loe TW, Chonko LB (2000) Promoting sales programs: The National Collegiate Sales Competition. J. Personal Selling Sales Management 20(1):11–13.Google Scholar
• Longpre L, Durmus E, Cardie C (2019) Persuasion of the undecided: Language vs. the listener. Stein B, Wachsmuth H, eds. Proc. 6th Workshop Argument Mining (Association for Computational Linguistics, Kerrville, TX), 167–176.Google Scholar
• Lundberg SM, Lee S-I (2017) A unified approach to interpreting model predictions. Advances in Neural Information Processing Systems, vol. 30 (MIT Press, Cambridge, MA).Google Scholar
• Luo X, Qin MS, Fang Z, Qu Z (2021) Artificial intelligence coaches for sales agents: Caveats and solutions. J. Marketing 85(2):14–32.Crossref, Google Scholar
• Maree M, Kmail AB, Belkhatir M (2019) Analysis and shortcomings of e-recruitment systems: Toward a semantics-based approach addressing knowledge incompleteness and limited domain coverage. J. Inform. Sci. 45(6):713–735.Crossref, Google Scholar
• Markowitz DM (2020) Putting your best pet forward: Language patterns of persuasion in online pet advertisements. J. Appl. Soc. Psych. 50(3):160–173.Crossref, Google Scholar
• McDaniel MA, Whetzel DL, Schmidt FL, Maurer SD (1994) The validity of employment interviews: A comprehensive review and meta-analysis. J. Appl. Psych. 79(4):599–616.Crossref, Google Scholar
• Moncrief WC, Marshall GW (2005) The evolution of the seven steps of selling. Indust. Marketing Management 34(1):13–22.Crossref, Google Scholar
• Naim I, Tanveer MI, Gildea D, Hoque ME (2015) Automated prediction and analysis of job interview performance: The role of what you say and how you say it. 2015 11th IEEE Internat. Conf. Workshops Automatic Face Gesture Recognition FG, vol. 1 (IEEE, Piscataway, NJ), 1–6.Google Scholar
• National Association of Colleges and Employers. Job outlook 2018. Accessed July 28, 2024, https://apps.abac.edu/registrar/Catalogs/resources/NACE%20Job%20Outlook%202018.pdf.Google Scholar
• National Association of Colleges and Employers. Job outlook 2022. Accessed July 28, 2024, https://www.naceweb.org/uploadedFiles/files/2022/resources/nace-job-outlook-2022.pdf.Google Scholar
• Pease B, Pease A (2008) The Definitive Book of Body Language: The Hidden Meaning Behind People’s Gestures and Expressions (Bantam, New York).Google Scholar
• Pennebaker JW, Francis ME, Booth RJ (2001) Linguistic Inquiry and Word Count: LIWC 2001 (Lawrence Erlbaum Associates, Mahwah, NJ).Google Scholar
• Pogacar R, Shrum L, Lowrey TM (2018) The effects of linguistic devices on consumer information processing and persuasion: A language complexity × processing mode framework. J. Consumer Psych. 28(4):689–711.Crossref, Google Scholar
• Posthuma RA, Morgeson FP, Campion MA (2002) Beyond employment interview validity: A comprehensive narrative review of recent research and trends over time. Personnel Psych. 55(1):1–81.Crossref, Google Scholar
• Pulakos ED, Schmitt N (1995) Experience-based and situational interview questions: Studies of validity. Personnel Psych. 48(2):289–308.Crossref, Google Scholar
• Rackham N (2020) SPIN®-Selling (Routledge, Abingdon, UK).Crossref, Google Scholar
• Raghavan M, Barocas S, Kleinberg J, Levy K (2020) Mitigating bias in algorithmic hiring: Evaluating claims and practices. Proc. 2020 Conf. Fairness Accountability Transparency (Association for Computing Machinery, New York), 469–481.Google Scholar
• Rajaram P, Manchanda P (2020) Video influencers: Unboxing the mystique. Preprint, submitted December 22, https://arxiv.org/abs/2012.12311.Google Scholar
• Reimers N, Gurevych I (2019) Sentence-BERT: Sentence embeddings using Siamese BERT-networks. Preprint, submitted August 27, https://arxiv.org/abs/1908.10084.Google Scholar
• Rich GA (1999) Salesperson optimism: Can sales managers enhance it and so what if they do? J. Marketing Theory Pract. 7(1):53–63.Crossref, Google Scholar
• Rivera LA (2012) Hiring as cultural matching: The case of elite professional service firms. Amer. Sociol. Rev. 77(6):999–1022.Crossref, Google Scholar
• Rivera L (2015) Firms are wasting millions recruiting on only a few campuses. Harvard Business Review (October 23), https://hbr.org/2015/10/firms-are-wasting-millions-recruiting-on-only-a-few-campuses.Google Scholar
• Sacks H, Schegloff EA, Jefferson G (1978) A simplest systematics for the organization of turn taking for conversation. Schenkein J, ed. Studies in the Organization of Conversational Interaction (Elsevier, Amsterdam), 7–55.Crossref, Google Scholar
• Sheth J (1976) Buyer-seller interaction: A conceptual framework. Adv. Consumer Res. 3(3B):382–386.Google Scholar
• Shmueli-Scheuer M, Herzig J, Konopnicki D, Sandbank T (2019) Detecting persuasive arguments based on author-reader personality traits and their interaction. Proc. 27th ACM Conf. User Modeling Adaptation Personalization (Association for Computing Machinery, New York), 211–215.Google Scholar
• Shrestha YR, Ben-Menahem SM, Von Krogh G (2019) Organizational decision-making structures in the age of artificial intelligence. Calif. Management Rev. 61(4):66–83.Crossref, Google Scholar
• Smith C (2019) An employee’s best friend? How AI can boost employee engagement and performance. Strategic HR Rev. 18(1):17–20.Crossref, Google Scholar
• Soomro K, Zamir AR, Shah M (2012) UCF101: A dataset of 101 human actions classes from videos in the wild. Preprint, submitted December 3, https://arxiv.org/abs/1212.0402.Google Scholar
• Spiro RL, Weitz BA (1990) Adaptive selling: Conceptualization, measurement, and nomological validity. J. Marketing Res. 27(1):61–69.Crossref, Google Scholar
• Syam NB, Hess JD, Yang Y (2013) Sales contests vs. quotas with imbalanced territories. Marketing Lett. 24(3):229–244.Crossref, Google Scholar
• Tambe P, Cappelli P, Yakubovich V (2019) Artificial intelligence in human resources management: Challenges and a path forward. Calif. Management Rev. 61(4):15–42.Crossref, Google Scholar
• Taylor PJ, Thomas S (2008) Linguistic style matching and negotiation outcome. Negotiation Conflict Management Res. 1(3):263–281.Crossref, Google Scholar
• Tian Z, Dew R, Iyengar R (2024) Mega or micro? Influencer selection using follower elasticity. J. Marketing Res. 61(3):472–495.Crossref, Google Scholar
• Timoshenko A, Hauser JR (2019) Identifying customer needs from user-generated content. Marketing Sci. 38(1):1–20.Link, Google Scholar
• Tippins NT, Oswald FL, McPhail SM (2021) Scientific, legal, and ethical concerns about AI-based personnel selection tools: A call to action. Personnel Assessment Decisions 7(2):1.Crossref, Google Scholar
• Vamvourellis D, Toth M, Bhagat S, Desai D, Mehta D, Pasquali S (2023) Company similarity using large language models. Preprint, submitted August 15, https://arxiv.org/abs/2308.08031.Google Scholar
• van den Broek E, Sergeeva A, Huysman M (2021) When the machine meets the expert: An ethnography of developing AI for hiring. MIS Quart. 45(3):1557–1580.Crossref, Google Scholar
• Van Zant AB, Berger J (2020) How the voice persuades. J. Personality Soc. Psych. 118(4):661–682.Crossref, Google Scholar
• Wager S, Hastie T, Efron B (2014) Confidence intervals for random forests: The jackknife and the infinitesimal jackknife. J. Machine Learn. Res. 15(1):1625–1651.Google Scholar
• Wang X, Lu S, Li X, Khamitov M, Bendle N (2021) Audio mining: The role of vocal tone in persuasion. J. Consumer Res. 48(2):189–211.Crossref, Google Scholar
• Wang A, Singh A, Michael J, Hill F, Levy O, Bowman SR (2018) GLUE: A multi-task benchmark and analysis platform for natural language understanding. Preprint, submitted April 20, https://arxiv.org/abs/1804.07461.Google Scholar
• Widmier SM, Loe T, Selden G (2007) Using role-play competition to teach selling skills and teamwork. Marketing Ed. Rev. 17(1):69–78.Crossref, Google Scholar
• Wilson SR, Kim M-S, Meischke H (1991) Evaluating Brown and Levinson’s politeness theory: A revised analysis of directives and face. Res. Language Soc. Interaction 25(1–4):215–252.Crossref, Google Scholar
• Woodside AG, Davenport JW Jr (1974) The effect of salesman similarity and expertise on consumer purchasing behavior. J. Marketing Res. 11(2):198–202.Crossref, Google Scholar
• Wotruba TR, Simpson EK, Reed-Draznik JL (1989) The recruiting interview as perceived by college student applicants for sales positions. J. Personal Selling Sales Management 9(3):13–24.Google Scholar
• Xiao L, Khazaei T (2019) Changing others’ beliefs online: Online comments’ persuasiveness. Proc. 10th Internat. Conf. Soc. Media Soc. (Association for Computing Machinery, New York), 92–101.Google Scholar
• Yang J, Zhang J, Zhang Y (2021) First law of motion: Influencer video advertising on TikTok. Preprint, submitted March 30, https://dx.doi.org/10.2139/ssrn.3815124.Google Scholar
• Zhang S, Yang Y, Chen C, Zhang X, Leng Q, Zhao X (2024) Deep learning-based multimodal emotion recognition from audio, visual, and text modalities: A systematic review of recent advancements and future prospects. Expert Systems Appl. 237(C):121692.Crossref, Google Scholar
• Zoghaib A (2019) Persuasion of voices: The effects of a speaker’s voice characteristics and gender on consumers’ responses. Recherche Appl. Marketing English Ed. 34(3):83–110.Google Scholar
• Zou Z, Chen K, Shi Z, Guo Y, Ye J (2023) Object detection in 20 years: A survey. Proc. IEEE 111(3):257–276.Google Scholar