Regulating Explainable Artificial Intelligence (XAI) May Harm Consumers

Published Online:https://doi.org/10.1287/mksc.2022.0396

References

  • Abdollahi B, Nasraoui O (2016) Explainable restricted Boltzmann machines for collaborative filtering. Preprint, submitted June 22, https://arxiv.org/abs/1606.07129.Google Scholar
  • Adadi A, Berrada M (2018) Peeking inside the black-box: A survey on explainable artificial intelligence (XAI). IEEE Access 6:52138–52160.CrossrefGoogle Scholar
  • Ascarza E (2018) Retention futility: Targeting high-risk customers might be ineffective. J. Marketing Res. 55:80–98.CrossrefGoogle Scholar
  • Bertini M, Koenigsberg O (2021) The pitfalls of pricing algorithms. Harvard Bus. Rev. (September–October), https://hbr.org/2021/09/the-pitfalls-of-pricing-algorithms.Google Scholar
  • Brown TB, Mann B, Ryder N, Subbiah M, Kaplan J, Dhariwal P, Neelakantan A, et al. (2020) Language models are few-shot learners. Preprint, submitted May 28, https://doi.org/10.48550/arXiv.2005.14165.Google Scholar
  • Castelvecchi D (2016) Can we open the black box of AI? Nature 538:20–23.CrossrefGoogle Scholar
  • Csiszár O, Csiszár G, Dombi J (2020) Interpretable neural networks based on continuous-valued logic and multicriteria decision operators. Knowledge-Based Systems 199:105972.CrossrefGoogle Scholar
  • Cunha M, Osório CAM, Ribeiro RM (2016) Endogenous product design and quality when consumers have heterogeneous limited attention. Preprint, submitted October 28, https://doi.org/10.2139/ssrn.2860456.Google Scholar
  • Datta A, Tschantz MC, Datta A (2015) Automated experiments on ad privacy settings: A tale of opacity, choice, and discrimination. Preprint, submitted March 17, https://doi.org/10.48550/arXiv.1408.6491.Google Scholar
  • Dekimpe MG (2020) Retailing and retailing research in the age of big data analytics. Internat. J. Res. Marketing 37:3–14.CrossrefGoogle Scholar
  • DeMarzo PM, Fishman MJ, Hagerty KM (2005) Self-regulation and government oversight. Rev. Econom. Stud. 72(3):687–706.CrossrefGoogle Scholar
  • Doshi-Velez F, Kim B (2017) Toward a rigorous science of interpretable machine learning. Preprint, submitted February 28, https://arxiv.org/abs/1702.08608.Google Scholar
  • Galli A, Marrone S, Moscato V, Sansone C (2021) Reliability of eXplainable artificial intelligence in adversarial perturbation scenarios. Del Bimbo A, Cucchiara R, Sclaroff S, Farinella GM, Mei T, Bertini M, Escalante HJ, Vezzani R, eds. Pattern Recognition. ICPR International Workshops and Challenges, Lecture Notes in Computer Science (Springer International Publishing, Cham, Switzerland), 243–256.CrossrefGoogle Scholar
  • Ghassemi M, Oakden-Rayner L, Beam AL (2021) The false hope of current approaches to explainable artificial intelligence in health care. Lancet Digital Health 3:e745–e750.CrossrefGoogle Scholar
  • Goodfellow IJ, Shlens J, Szegedy C (2015) Explaining and harnessing adversarial examples. Preprint, submitted December 20, https://arxiv.org/abs/1412.6572.Google Scholar
  • Hardt M, Price E, Srebro N (2016) Equality of opportunity in supervised learning. Preprint, submitted October 7, https://doi.org/10.48550/arXiv.1610.02413.Google Scholar
  • Holzinger A, Plass M, Holzinger K, Crisan GC, Pintea C-M, Palade V (2017) A glass-box interactive machine learning approach for solving NP-hard problems with the human-in-the-loop. Preprint, submitted August 3, https://arxiv.org/abs/1708.01104.Google Scholar
  • Huang MH, Rust RT (2021) A strategic framework for artificial intelligence in marketing. J. Acad. Mark. Sci. 49:30–50.CrossrefGoogle Scholar
  • Kuppa A, Le-Khac N-A (2020) Black box attacks on explainable artificial intelligence (XAI) methods in cyber security. 2020 Internat. Joint Conf. Neural Networks (IJCNN) (IEEE, Piscataway, NJ), 1–8.Google Scholar
  • Lei J, G’Sell M, Rinaldo A, Tibshirani RJ, Wasserman L (2018) Distribution-free predictive inference for regression. J. Amer. Statist. Assoc. 113:1094–1111.Google Scholar
  • Lipton ZC (2016) The mythos of model interpretability. Preprint, submitted June 10, https://arxiv.org/abs/1606.03490.Google Scholar
  • Lundberg SM, Lee S-I (2017) A unified approach to interpreting model predictions. Adv. Neural Inform. Processing Systems (Curran Associates, Red Hook, NY).Google Scholar
  • Malik N (2020) Does machine learning amplify pricing errors in housing market?:  Economics of ML feedback loops. Preprint, submitted September 18, https://doi.org/10.2139/ssrn.3694922.Google Scholar
  • Martens D, Provost F (2014) Explaining data-driven document classifications. MIS Quart. 38(1):73–100.CrossrefGoogle Scholar
  • Martens D, Huysmans J, Setiono R, Vanthienen J, Baesens B (2008) Rule extraction from support vector machines: An overview of issues and application in credit scoring. Diederich J, ed. Rule Extraction from Support Vector Machines, Studies in Computational Intelligence, vol. 80 (Springer, Berlin, Heidelberg), 33–63.Google Scholar
  • Murdoch WJ, Singh C, Kumbier K, Abbasi-Asl R, Yu B (2019) Interpretable machine learning: Definitions, methods, and applications. Proc. Natl. Acad. Sci. USA 116:22071–22080.CrossrefGoogle Scholar
  • Neumann N, Tucker CE, Whitfield T (2019) Frontiers: How effective is third-party consumer profiling? Evidence from field studies. Marketing Sci. 38:918–926.AbstractGoogle Scholar
  • Pitt C, Bal A, Plangger K (2020) New approaches to psychographic consumer segmentation: Exploring fine art collectors using artificial intelligence, automated text analysis and correspondence analysis. Eur. J. Marketing 54:305–326.Google Scholar
  • Pradhan R, Lahiri A, Galhotra S, Salimi B (2022) Explainable AI: Foundations, applications, opportunities for data management research. 2022 IEEE 38th Internat. Conf. Data Engrg. (ICDE) (IEEE, Piscataway, NJ), 3209–3212.Google Scholar
  • Ramon Y, Vermeire T, Toubia O, Martens D, Evgeniou T (2021) Understanding consumer preferences for explanations generated by XAI algorithms. Preprint, submitted July 6, https://arxiv.org/abs/2107.02624.Google Scholar
  • Ribeiro MT, Singh S, Guestrin C (2016) “Why should I trust you?”: Explaining the predictions of any classifier. Proc. 22nd ACM SIGKDD (ACM, New York), 1135–1144.Google Scholar
  • Rudin C (2019) Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead. Nature Machine Intelligence 1:206–215.CrossrefGoogle Scholar
  • Tirole J (1988) The Theory of Industrial Organization (MIT Press, Cambridge, MA).Google Scholar
  • Troncoso I, Fu R, Malik N, Proserpio D (2023) Algorithm failures and consumers’ response: Evidence from Zillow. Preprint, submitted July 24, https://doi.org/10.2139/ssrn.4520172.Google Scholar
  • Trope Y, Liberman N (2010) Construal-level theory of psychological distance. Psychol. Rev. 117:440–463.CrossrefGoogle Scholar
  • Valls A, Gibert K, Orellana A, Antón-Clavé S (2018) Using ontology-based clustering to understand the push and pull factors for British tourists visiting a Mediterranean coastal destination. Inform. Management 55:145–159.CrossrefGoogle Scholar
  • Wang Q, Huang Y, Jasin S, Singh PV (2022) Algorithmic transparency with strategic users. Management Sci. 69(4):2297–2317.LinkGoogle Scholar
  • Zhu J, Liapis A, Risi S, Bidarra R, Youngblood GM (2018) Explainable AI for designers: A human-centered perspective on mixed-initiative co-creation. 2018 IEEE Conf. Comput. Intelligence Games (CIG). Presented at the 2018 IEEE Conf. Comput. Intelligence Games (CIG) (IEEE, Piscataway, NJ), 1–8.CrossrefGoogle Scholar
INFORMS site uses cookies to store information on your computer. Some are essential to make our site work; Others help us improve the user experience. By using this site, you consent to the placement of these cookies. Please read our Privacy Statement to learn more.