How Does Competition Affect Exploration vs. Exploitation? A Tale of Two Recommendation Algorithms

References

• Abdollahpouri H, Burke R, Mobasher B (2017) Controlling popularity bias in learning-to-rank recommendation. Proc. 11th ACM Conf. on Recommender Systems (Association for Computing Machinery, New York), 42–46.Google Scholar
• Abdollahpouri H, Burke R, Mobasher B (2019) Managing popularity bias in recommender systems with personalized re-ranking. Preprint, submitted January 22, https://arxiv.org/abs/1901.07555.Google Scholar
• Acquisti A, Varian HR (2005) Conditioning prices on purchase history. Marketing Sci. 24(3):367–381.Link, Google Scholar
• Acquisti A, Taylor C, Wagman L (2016) The economics of privacy. J. Econom. Literature 54(2):442–492.Crossref, Google Scholar
• Agarwal D, Chen BC, Elango P (2009) Explore/exploit schemes for web content optimization. 2009 9th IEEE Internat. Conf. on Data Mining (IEEE, Piscataway, NJ), 1–10.Google Scholar
• Aghion P, Bloom N, Blundell R, Griffith R, Howitt P (2005) Competition and innovation: An inverted U relationship. Quart. J. Econom. 120:701–728.Google Scholar
• Agrawal A, Gans J, Goldfarb A (2018a) Prediction Machines: The Simple Economics of Artificial Intelligence (Harvard Business Press, Cambridge, MA).Google Scholar
• Agrawal A, Gans J, Goldfarb A (2018b) Human judgment and AI pricing. AEA Paper Proc. 108:58–63.Crossref, Google Scholar
• Agrawal A, Gans J, Goldfarb A (2019) Exploring the impact of artificial intelligence: Prediction vs. judgment. Inform. Econom. Policy 47:1–6.Crossref, Google Scholar
• Akamai (2017) State of online retail performance: 2017 holiday retrospective. Accessed October 11, 2020, https://www.akamai.com/us/en/multimedia/documents/report/akamai-state-of-online-retail-performance-2017-holiday.pdf.Google Scholar
• Aridor G, Mansour Y, Slivkins A, Wu ZS (2020) Competing bandits: The perils of exploration under competition. Preprint, submitted July 20, 2020; last revised December 4 2022, https://arxiv.org/abs/2007.10144.Google Scholar
• Asker J, Fershtman C, Pakes A (2022) The impact of AI design on pricing. Working paper, University of California, Los Angeles, Los Angeles.Google Scholar
• Athey S, Imbens GW (2019) Machine learning methods that economists should know about. Annu. Rev. Econom. 11:685–725.Crossref, Google Scholar
• Athey S, Bryan K, Gans J (2020) The allocation of decision authority to human and artificial intelligence. AEA Paper Proc. 110:80–84.Crossref, Google Scholar
• Banchio M, Mantegazza G (2022) Adaptive algorithms and collusion via coupling. Working paper, Stanford University, Stanford, CA.Google Scholar
• Banchio M, Skrzypacz A (2022) Artificial intelligence and auction design. Proc. 23rd ACM Conf. Econom. Comput. (EC ’22) (Association for Computing Machinery, New York), 30–31.Google Scholar
• Bank P, Küchler C (2007) On Gittins index theorem in continuous time. Stochastic Processing Appl. 117(9):1357–1371.Crossref, Google Scholar
• Bergemann D, Välimäki J (1996) Learning and strategic pricing. Econometrica 64:1125–1149.Crossref, Google Scholar
• Berman R, Katona Z (2020) Curation algorithms and filter bubbles in social networks. Marketing Sci. 39(2):296–316.Link, Google Scholar
• Berryhill J, Heang KK, Clogher R, McBride K (2020) Hello, world: Artificial intelligence and its use in the public sector. Accessed May 3, 2022, oecd-opsi.org.Google Scholar
• Blake E (2020) Data shows 90 percent of streams go to the top 1 percent of artists. Accessed November 24, 2022, https://www.rollingstone.com/pro/news/top-1-percent-streaming-1055005/.Google Scholar
• Bolton P, Harris C (1999) Strategic experimentation. Econometrica 67:349–374.Crossref, Google Scholar
• Branco F, Sun M, Villas-Boas JM (2012) Optimal search for product information. Management Sci. 58(11):2037–2056.Link, Google Scholar
• Calvano E, Calzolari G, Denicolò V, Pastorello S (2020) Artificial intelligence, algorithmic pricing and collusion. Amer. Econom. Rev. 110(10):3267–3297.Crossref, Google Scholar
• Chen M, Beutel A, Covington P, Jain S, Belletti F, Chi EH (2019). Top-k off-policy correction for a REINFORCE recommender system. Proc. 12th ACM Internat. Conf. on Web Search and Data Mining (Association for Computing Machinery, New York), 456–464.Google Scholar
• Chen Y, Narasimhan C, Zhang ZJ (2001) Individual marketing with imperfect targetability. Marketing Sci. 20(1):23–41.Link, Google Scholar
• Ching A (2010) A dynamic oligopoly structural model for the prescription drug market after patent expiration. Internat. Econom. Rev. 51:1175–1207.Crossref, Google Scholar
• Chintagunta P, Hanssens DM, Hauser JR (2016) Editorial-marketing science and big data. Marketing Sci. 35(3):341–342.Link, Google Scholar
• Competition and Markets Authority (2020) Online platforms and digital advertising. Accessed May 3, 2022, https://www.gov.uk/cma-cases/online-platforms-and-digital-advertising-market-study.Google Scholar
• Dasgupta P, Stiglitz J (1980) Industrial structure and the nature of innovative activity. Econom. J. (London) 90:266–293.Google Scholar
• Deb J, Öry A, Williams K (2019) Aiming for the goal: Contribution dynamics of crowdfunding. Working Paper No. w25881, National Bureau of Economic Research, Cambridge, MA.Google Scholar
• Dixit A (1993) The Art of Smooth Pasting (Harwood Academic Publishers).Google Scholar
• Dogan M, Jacquillat A, Yildirim P (2021) Strategic automation and decision-making authority. Preprint, submitted July 22, https://ssrn.com/abstract=3226222.Google Scholar
• Facebook IQ (2016) Capturing attention in feed: The science behind effective video creative. Accessed October 11, 2020, https://www.facebook.com/business/news/insights/capturing-attention-feed-video-creative.Google Scholar
• Fader PS, Winer RS (2012) Introduction to the special issue on the emergence and impact of user-generated content. Marketing Sci. 31(3):369–371.Link, Google Scholar
• Felli L, Harris C (1996) Job matching, learning and firm-specific human capital. J. Political Econom. 104:838–868.Crossref, Google Scholar
• Fudenberg D, Tirole J (2000) Customer poaching and brand switching. RAND J. Econom. 31(4):634–657.Crossref, Google Scholar
• Fudenberg D, Strack P, Strzalecki T (2018) Speed, accuracy, and the optimal timing of choices. Amer. Econom. Rev. 108(12):3651–3684.Crossref, Google Scholar
• Godes D, Mayzlin D (2004) Using online conversations to study word-of-mouth communication. Marketing Sci. 23(4):545–560.Link, Google Scholar
• Gonul F, Shi MZ (1998) Optimal mailing of catalogs: A new methodology using estimable structural dynamic programming models. Management Sci. 44(9):1249–1262.Google Scholar
• Google Developers (2020) Recommendation systems. Accessed November 11, 2020, https://developers.google.com/machine-learning/recommendation.Google Scholar
• Hansen K, Misra K, Pai M (2020) Algorithmic collusion: Supra-competitive prices via independent algorithms. Marketing Sci. 40(1):1–12.Link, Google Scholar
• Hauser JR, Liberali G, Urban GL (2014) Website morphing 2.0: Technical and implementation advances and a field experiment. Management Sci. 60(6):1594–1616.Link, Google Scholar
• Huang MH, Rust RT (2018) Artificial intelligence in service. J. Service Res. 21(2):155–172.Crossref, Google Scholar
• Johnson J, Rhodes A, Wildenbeest MR (2020) Platform design when sellers use pricing algorithms. Working paper, Cornell University, Ithaca, NY.Google Scholar
• Kamakura WA, Russell GJ (1989) A probabilistic choice model for market segmentation and elasticity structure. J. Marketing Res. 26(4):379–390.Crossref, Google Scholar
• Kannan PK, Li H (2017) Digital marketing: A framework, review and research agenda. Internat. J. Res. Marketing 34(1):22–45.Crossref, Google Scholar
• Ke TT, Li C, Safronov M (2023) Learning by choosing: Career concerns with observable actions. Amer. Econom. J. Microeconom. Forthcoming.Google Scholar
• Ke TT, Sudhir K (2022) Privacy rights and data security: GDPR and personal data driven markets. Preprint, submitted September 15, https://ssrn.com/abstract=3643979.Google Scholar
• Ke TT, Villas-Boas JM (2019) Optimal learning before choice. J. Econom. Theory 180:383–437.Crossref, Google Scholar
• Ke TT, Shen ZJM, Villas-Boas JM (2016) Search for information on multiple products. Management Sci. 62(12):3576–3603.Link, Google Scholar
• Keller G, Rady S (1999) Optimal experimentation in a changing environment. Rev. Econom. Stud. 66:475–507.Crossref, Google Scholar
• Keller G, Rady S, Cripps M (2005) Strategic experimentation with exponential bandits. Econometrica 73:39–68.Crossref, Google Scholar
• Lewis M (2005) A dynamic programming approach to customer relationship pricing. Management Sci. 51(6):986–994.Link, Google Scholar
• Li L, Chu W, Langford J, Schapire RE (2010) A contextual-bandit approach to personalized news article recommendation. Proc. Internat. World Wide Web Conf. (Association for Computing Machinery, New York), 661–670.Google Scholar
• Li S, Montgomery A, Sun B (2011) Cross-selling the right product to the right customer at the right time. J. Marketing Res. 48(4):683–700.Crossref, Google Scholar
• Li X, Li L, Gao J, He X, Chen J, Deng L, He J (2015) Recurrent reinforcement learning: A hybrid approach. Preprint, submitted September 10, https://arxiv.org/abs/1509.03044.Google Scholar
• Lin S, Zhang J, Hauser JR (2015) Learning from experience, simply. Marketing Sci. 34(1):1–19.Link, Google Scholar
• Liptser RS, Shiriaev AN (1977) Statistics of Random Processes: General Theory, vol. 394 (Springer-Verlag, New York).Crossref, Google Scholar
• Liu Y, Ren D (2020) China drafts new antitrust guideline to rein in tech giants, wiping US$102 billion from Alibaba, Tencent and Meituan stocks. South China Morning Post, (November 10), https://www.scmp.com/business/china-business/article/3109188/china-drafts-new-antitrust-guideline-rein-tech-giants.Google Scholar
• Ma L, Sun B (2020) Machine learning and AI in marketing-Connecting computing power to human insights. Internat. J. Res. Marketing. 37(3):481–504.Crossref, Google Scholar
• Martinez S (2021) Streaming service algorithms are biased, directly affecting content development. Accessed November 24, 2022, https://amt-lab.org/blog/2021/11/streaming-service-algorithms-are-biased-and-directly-affect-content-development.Google Scholar
• Miklós-Thal J, Tucker C (2019) Collusion by algorithm: Does better demand prediction facilitate coordination between sellers? Management Sci. 65(4):1552–1561.Link, Google Scholar
• Misra K, Schwartz EM, Abernethy J (2019) Dynamic online pricing with incomplete information using multi-armed bandit experiments. Marketing Sci. 38(2):226–252.Link, Google Scholar
• Ning ZE (2021) List price and discount in a stochastic selling process. Marketing Sci. 40(2):366–387.Link, Google Scholar
• Pazgal A, Soberman D (2008) Behavior-based discrimination: Is it a winning play, and if so, when? Marketing Sci. 27(6):977–994.Link, Google Scholar
• Rossi PE, McCulloch RE, Allenby GM (1996) The value of purchase history data in target marketing. Marketing Sci. 15(4):321–340.Link, Google Scholar
• Rothschild M (1974) A two-armed bandit theory of market pricing. J. Econom. Theory 9:185–202.Crossref, Google Scholar
• Schafer JB, Frankowski D, Herlocker J, Sen S (2007) Collaborative filtering recommender systems. The Adaptive Web (Springer, Berlin), 291–324.Crossref, Google Scholar
• Schwartz EM, Bradlow ET, Fader PS (2017) Customer acquisition via display advertising using multi-armed bandit experiments. Marketing Sci. 36(4):500–522.Link, Google Scholar
• Silver D, Newnham L, Barker D, Weller S, McFall J (2013) Concurrent reinforcement learning from customer interactions. Proc. Internat. Conf. on Machine Learn. Res. (PMLR) 28(3):924–932.Google Scholar
• Spence M (1984) Cost reduction, competition, and industry performance. Econometrica 52:101–121.Crossref, Google Scholar
• Steckel JH, Winer RS, Bucklin RE, Dellaert BG, Drèze X, Häubl G, Jap SD, et al. (2005) Choice in interactive environments. Marketing Lett. 16(3–4):309–320.Crossref, Google Scholar
• Sun B, Li S (2011) Learning and acting upon customer information: A simulation-based demonstration on service allocations with offshore centers. J. Marketing Res. 48(1):72–86.Crossref, Google Scholar
• Sun B, Li S, Zhou C (2006) “Adaptive” learning and “proactive” customer relationship management. J. Interactive Marketing 20(3/4):82–96.Crossref, Google Scholar
• Sutton RS, Barto AG (2018) Reinforcement Learning: An Introduction (MIT Press, Cambridge, MA).Google Scholar
• Theocharous G, Thomas PS, Ghavamzadeh M (2015) Ad recommendation systems for life-time value optimization. Proc. 24th Internat. Conf. World Wide Web (Association for Computing Machinery, New York), 1305–1310.Google Scholar
• Urban GL, Liberali G, Bordley R, MacDonald E, Hauser JR (2014) Morphing banner advertising. Marketing Sci. 33(1):27–46.Link, Google Scholar
• U.S. House, Committee on the Judiciary, Subcommittee on Antitrust, Commercial and Administrative Law (2020) Investigation of Competition in Digital Markets (U.S. House, Washington, DC).Google Scholar
• Villas-Boas JM (1999) Dynamic competition with customer recognition. RAND J. Econom. 30(4):604–631.Crossref, Google Scholar
• Villas-Boas JM (2004) Price cycles in markets with customer recognition. RAND J. Econom. 35(3):486–501.Crossref, Google Scholar
• Villas-Boas JM, Yao Y (2023) A dynamic model of optimal retargeting. Marketing Sci. Forthcoming.Google Scholar
• Vives X (2008) Innovation and competitive pressure. J. Industrial Econom. 56:419–469.Crossref, Google Scholar
• Wedel M, Kannan PK (2016) Marketing analytics for data-rich environments. J. Marketing 80(6):97–121.Crossref, Google Scholar
• Weitzman M (1979) Optimal search for the best alternative. Econometrica 47:641–654.Crossref, Google Scholar
• Winer RS, Neslin SA, eds. (2014) The History of Marketing Science (World Scientific, New York).Crossref, Google Scholar
• Xu Z, Dukes A (2021) Personalization, customer data aggregation, and the role of list price. Management Sci. 68(2):960–980.Google Scholar
• Zhang J (2011) The perils of behavior-based personalization. Marketing Sci. 30(1):170–186.Link, Google Scholar
• Zhang J, Krishnamurthi L (2004) Customizing promotions in online stores. Marketing Sci. 23(4):561–578.Link, Google Scholar