Artificial Collusion: Examining Supracompetitive Pricing by Q-Learning Algorithms

References

• Abada I, Lambin X (2023) Artificial intelligence: Can seemingly collusive outcomes be avoided? Management Sci. 69(9):5042–5065.Link, Google Scholar
• Abada I, Lambin X, Tchakarov N (2024a) Collusion by mistake: Does algorithmic sophistication drive supra-competitive profits? Eur. J. Oper. Res. 318(3):927–953.Crossref, Google Scholar
• Abada I, Harrington JE Jr, Lambin X, Meylahn JM (2024b) Algorithmic collusion: Where are we and where should we be going? Preprint, submitted August 7, https://doi.org/10.2139/ssrn.4891033.Google Scholar
• Aksoy-Pierson M, Allon G, Federgruen A (2013) Price competition under mixed multinomial logit demand functions. Management Sci. 59(8):1817–1835.Link, Google Scholar
• Aouad A, den Boer AV (2021) Algorithmic collusion in assortment games. Preprint, submitted September 28, https://doi.org/10.2139/ssrn.3930364.Google Scholar
• Arslan G, Yüksel S (2017) Decentralized Q-learning for stochastic teams and games. IEEE Trans. Automatic Control 62(4):1545–1558.Crossref, Google Scholar
• Arunachaleswaran ER, Collina N, Kannan S, Roth A, Ziani J (2024) Algorithmic collusion without threats. Preprint, submitted December 13, https://arxiv.org/abs/2409.03956.Google Scholar
• Asker J, Fershtman C, Pakes A (2021) Artificial intelligence and pricing: The impact of algorithm design. NBER Working Paper No. 28535, National Bureau of Economic Research, Cambridge, MA.Google Scholar
• Asker J, Fershtman C, Pakes A (2022) Artificial intelligence, algorithm design and pricing. AER Papers Proc. 112(May):452–456.Crossref, Google Scholar
• Asker J, Fershtman C, Pakes A (2024) The impact of artificial intelligence design on pricing. J. Econom. Management Strategy 33(2):276–304.Crossref, Google Scholar
• Assad S, Clark R, Ershov D, Xu L (2024) Algorithmic pricing and competition: Empirical evidence from the German retail gasoline market. J. Political Econom. 132(3):723–771.Crossref, Google Scholar
• Assad S, Calvano E, Calzolari G, Clark R, Denicolò V, Ershov D, Johnson J, et al. (2021) Autonomous algorithmic collusion: Economic research and policy implications. Oxford Rev. Econom. Policy 37(3):459–478.Crossref, Google Scholar
• Barfuss W, Meylahn JM (2023) Intrinsic fluctuations of reinforcement learning promote cooperation. Sci. Rep. 13(1):1309.Crossref, Google Scholar
• Beneke F, Mackenrodt MO (2021) Remedies for algorithmic tacit collusion. J. Antitrust Enforcement 9(1):152–176.Crossref, Google Scholar
• Bernhardt L, Dewenter R (2020) Collusion by code or algorithmic collusion? When pricing algorithms take over. Eur. Competition J. 16(2–3):312–342.Crossref, Google Scholar
• Bertini M, Koenigsberg O (2021) The pitfalls of pricing algorithms: Be mindful of how they can hurt your brand. Harvard Bus. Rev. 99(5):74–83.Google Scholar
• Bichler M, Durmann J, Oberlechner M (2024) Online optimization algorithms in repeated price competition: Equilibrium learning and algorithmic collusion. Preprint, submitted December 20, https://arxiv.org/abs/2412.15707.Google Scholar
• Bichler M, Durmann J, Oberlechner M (2025) Algorithmic pricing and algorithmic collusion. Bus. Inform. Systems Engrg. 67:971–979.Google Scholar
• Bichler M, Gupta A, Mathews L, Oberlechner M (2023) Low revenue in display ad auctions: Algorithmic collusion vs. non-quasilinear preferences. Preprint, submitted November 30, https://arxiv.org/abs/2312.00243v2.Google Scholar
• Brown ZY, MacKay A (2023) Competition in pricing algorithms. Amer. Econom. J.: Microeconomics 15(2):109–156.Google Scholar
• Buchali K, Grüb J, Muijs M, Schwalbe U (2023) Strategic choice of price-setting algorithms. Hohenheim Discussion Paper in Business, Economics and Social Sciences, University of Hohenheim, Stuttgart, Germany.Google Scholar
• Byrne DP, De Roos N (2019) Learning to coordinate: A study in retail gasoline. Amer. Econom. Rev. 109(2):591–619.Crossref, Google Scholar
• Calvano E, Calzolari G, Denicoló V, Pastorello S (2020) Artificial intelligence, algorithmic pricing, and collusion. Amer. Econom. Rev. 110(10):3267–3297.Crossref, Google Scholar
• Cartea Á, Chang P, Penalva J (2022a) Algorithmic collusion in electronic markets: The impact of tick size. Preprint, submitted May 11, https://doi.org/10.2139/ssrn.4105954.Google Scholar
• Cartea Á, Chang P, Penalva J, Waldon H (2022b) The algorithmic learning equations: Evolving strategies in dynamic games. Preprint, submitted August 4, https://doi.org/10.2139/ssrn.4175239.Google Scholar
• Cartea Á, Chang P, Penalva J, Waldon H (2026) Algorithmic collusion and a folk theorem from learning with bounded rationality. Games Econom. Behav. 157:1–21.Google Scholar
• Coglianese C, Lai A (2022) Antitrust by algorithm. Stanford Comput. Antitrust 2:1–23.Google Scholar
• Competition and Markets Authority (2021) Algorithms: How they can reduce competition and harm consumers. Report, Competition and Markets Authority, London.Google Scholar
• Cooper WL, Homem-de Mello T, Kleywegt AJ (2015) Learning and pricing with models that do not explicitly incorporate competition. Oper. Res. 63(1):86–103.Link, Google Scholar
• den Boer AV (2015) Dynamic pricing and learning: Historical origins, current research, and new directions. Surveys Oper. Res. Management Sci. 20(1):1–18.Crossref, Google Scholar
• den Boer AV, Meylahn JM (2024) A (mathematical) definition of algorithmic collusion. Preprint, submitted November 25, https://doi.org/10.2139/ssrn.5012923.Google Scholar
• Deng A (2023) What do we know about algorithmic collusion now? New insights from the latest academic research. Preprint, submitted July 29, https://doi.org/10.2139/ssrn.4521959.Google Scholar
• Deng S, Schiffer M, Bichler M (2024) Algorithmic collusion in dynamic pricing with deep reinforcement learning. Preprint, submitted June 4, https://arxiv.org/abs/2406.02437.Google Scholar
• Dolgopolov A (2024) Reinforcement learning in a prisoner’s dilemma. Games Econom. Behav. 144:84–103.Crossref, Google Scholar
• Dorner FE (2021) Algorithmic collusion: A critical review. Preprint, submitted October 10, https://arxiv.org/abs/2110.04740.Google Scholar
• Epivent A, Lambin X (2024) On algorithmic collusion and reward–Punishment schemes. Econom. Lett. 237:111661.Crossref, Google Scholar
• Eschenbaum N, Mellgren F, Zahn P (2022) Robust algorithmic collusion. Preprint, submitted January 2, https://doi.org/10.48550/arxiv.2201.00345.Google Scholar
• Ezrachi A, Stucke ME (2016) Virtual Competition: The Promise and Perils of the Algorithm-Driven Economy (Harvard University Press, Cambridge, MA).Crossref, Google Scholar
• Ezrachi A, Stucke ME (2020) Sustainable and unchallenged algorithmic tacit collusion. Northwestern J. Tech. Intellectual Property 17(2):217–260.Google Scholar
• Federal Trade Commission, U.S. Department of Justice (2017) Algorithms and Collusion—Note by the United States. Accessed February 5, 2026, https://one.oecd.org/document/DAF/COMP/WD(2017)41/En/pdf.Google Scholar
• Fudenberg D, Levine D (1998) The Theory of Learning in Games (MIT Press, Cambridge, MA).Google Scholar
• Gal MS (2019) Algorithms as illegal agreements. Berkeley Tech. Law J. 34(1):67–118.Google Scholar
• Gal MS (2023) Limiting algorithmic coordination. Berkeley Tech. Law J. 38(1):173–230.Google Scholar
• Garcia D, Tolvanen J, Wagner AK (2026) Strategic responses to algorithmic recommendations: Evidence from hotel pricing. Management Sci. 72(1):609–626.Link, Google Scholar
• Han B (2022) Cooperation between independent market makers. Quant. Finance 22(11):2005–2019.Crossref, Google Scholar
• Hanspach P, Sapi G, Wieting M (2024) Algorithms in the marketplace: An empirical analysis of automated pricing in e-commerce. Inform. Econom. Policy 69:10111.Google Scholar
• Harrington JE Jr (2018) Developing competition law for collusion by autonomous price-setting agents. J. Competition Law Econom. 14(3):331–363.Crossref, Google Scholar
• Harrington JE Jr (2022) The effect of outsourcing pricing algorithms on market competition. Management Sci. 68(9):6889–6906.Link, Google Scholar
• Harrington JE Jr (2025) An economic test for an unlawful agreement to adopt a third-party’s pricing algorithm. Econom. Policy 40(121):261–295.Crossref, Google Scholar
• Harrington JE Jr (2026) A critique of recent remedies for third-party pricing algorithms and why the solution is not restrictions on data sharing. J. Competition Law Econom. 22(1):114–137.Google Scholar
• Harrington JE, Schinkel MP (2024) Cartels Diagnosed: New Insights on Collusion (Cambridge University Press, Cambridge, UK).Google Scholar
• Hettich M (2021) Algorithmic collusion: Insights from deep learning. Preprint, submitted February 18, https://doi.org/10.2139/ssrn.3785966.Google Scholar
• Kastius A, Schlosser R (2022) Dynamic pricing under competition using reinforcement learning. J. Revenue Pricing Management 21(1):50–63.Crossref, Google Scholar
• Kirman AP (1975) Learning by firms about demand conditions. Day RH, Graves T, eds. Adaptive Economic Models (Academic Press, New York), 137–156.Crossref, Google Scholar
• Klein T (2021) Autonomous algorithmic collusion: Q-learning under sequential pricing. RAND J. Econom. 52(3):538–558.Crossref, Google Scholar
• Kühn KU, Tadelis S (2018) The economics of algorithmic pricing: Is collusion really inevitable? Technical report, University of East Anglia, Norwich, United Kingdom.Google Scholar
• Lambin X (2023) Less than meets the eye: Simultaneous experiments as a source of algorithmic seeming collusion. Preprint, submitted July 5, https://doi.org/10.2139/ssrn.4498926.Google Scholar
• Lattimore T, Szepesvári C (2020) Bandit Algorithms (Cambridge University Press, Cambridge, UK).Crossref, Google Scholar
• Levin Y, McGill J, Nediak M (2009) Dynamic pricing in the presence of strategic consumers and oligopolistic competition. Management Sci. 55(1):32–46.Link, Google Scholar
• Li H, Huh WT (2011) Pricing multiple products with the multinomial logit and nested logit models: Concavity and implications. Manufacturing Service Oper. Management 13(4):549–563.Link, Google Scholar
• Liu Q, Zhang D (2013) Dynamic pricing competition with strategic customers under vertical product differentiation. Management Sci. 59(1):84–101.Link, Google Scholar
• Loots T, den Boer AV (2022) Data-driven collusion and competition in a pricing duopoly with multinomial logit demand. Production Oper. Management 32(4):1169–1186.Crossref, Google Scholar
• MacKay A, Svartbäck D, Ekholm AG (2022) Dynamic pricing, intertemporal spillovers, and efficiency. Preprint, submitted July 25, http://dx.doi.org/10.2139/ssrn.4164271.Google Scholar
• Mazundar A (2022) Algorithmic collusion: Reviving section 5 of the FTC act. Columbia Law Rev. 122:449–488.Google Scholar
• Mehra SK (2016) Antitrust and the Robo-Seller: Competition in the time of algorithms. Minnesota Law Rev. 100(4):1323–1375.Crossref, Google Scholar
• Mehra SK (2021) Price discrimination-driven algorithmic collusion: Platforms for durable cartels. Stanford J. Law, Bus. Finance 26(1):171–221.Google Scholar
• Meylahn JM (2023) Does an intermediate price facilitate algorithmic collusion? Preprint, submitted October 25, https://doi.org/10.2139/ssrn.4594415.Google Scholar
• Meylahn JM (2025) Quantifying the likelihood of learning collusive strategy equilibria. Chaos 35(8):083106.Crossref, Google Scholar
• Meylahn JM, den Boer AV (2022) Learning to collude in a pricing duopoly. Manufacturing Service Oper. Management 24(5):2577–2594.Link, Google Scholar
• Meylahn JM, Janssen L (2022) Limiting dynamics for Q-learning with memory one in symmetric two-player, two-action games. Complexity 2022:4830491.Crossref, Google Scholar
• Organisation for Economic Co-operation and Development (2017) Algorithms and collusion: Competition policy in the digital age. OECD Roundtables on Competition Policy Paper No. 206, Organisation for Economic Co-operation and Development, Paris.Google Scholar
• Organisation for Economic Co-operation and Development (2023) Algorithmic competition: OECD competition policy roundtable background note. http://www.oecd.org/daf/competition/algorithmic-competition-2023.pdf.Google Scholar
• RealPage (2025) RealPage reaches settlement with U.S. Department of Justice regarding revenue management software. https://www.realpage.com/news/realpage-reaches-settlement-with-us-department-of-justice/.Google Scholar
• Sánchez-Cartas JM, Katsamakas E (2022) Effects of algorithmic pricing on platform competition. Preprint, submitted March 19, https://doi.org/10.2139/ssrn.4027365.Google Scholar
• Schinkel MP, Tuinstra J, Vermeulen D (2002) Convergence of Bayesian learning to general equilibrium in mis-specified models. J. Math. Econom. 38(4):483–508.Crossref, Google Scholar
• Schwalbe U (2018) Algorithms, machine learning, and collusion. J. Competition Law Econom. 14(4):568–607.Crossref, Google Scholar
• Spann M, Bertini M, Koenigsberg O, Zeithammer R, Aparicio D, Chen Y, Fantini F, et al. (2025) Algorithmic pricing: Implications for marketing strategy and regulation. Internat. J. Res. Marketing Forthcoming.Google Scholar
• U.S. Department of Justice (2023) Statement of interest of the United States in re: RealPage, rental software antitrust litigation, Case No. 3:23-MD-3071. United States District Court for the Middle District of Tennessee, Nashville.Google Scholar
• U.S. Department of Justice (2024a) Brief for the United States as amicus curiae in support of plaintiffs-appellants No. 24-3576, re: Richard Gibson, et al. v. Cendyn Group, LLC, et al., No. 2:23-cv-00140. U.S. Department of Justice, Washington, DC.Google Scholar
• U.S. Department of Justice (2024b) Justice Department sues RealPage for algorithmic pricing scheme that harms millions of American renters. Report, U.S. Department of Justice, Washington, DC.Google Scholar
• U.S. Department of Justice (2025) Statement of interest of the United States in re multiplan health insurance provider litigation, Case No. 1:24-cv-06795. U.S. Department of Justice, Washington, DC.Google Scholar
• Veljanovski C (2022) Pricing algorithms as collusive devices. IIC—Internat. Rev. Intellectual Property Competition Law 53(4):604–622.Crossref, Google Scholar
• Waltman L, Kaymak U (2008) Q-learning agents in a Cournot oligopoly model. J. Econom. Dynam. Control 32:3275–3293.Crossref, Google Scholar
• Wang Y (2022) Will algorithms learn to collude? Insights from the natural policy gradient method. Working paper, Department of Economics, University of Virginia, Charlottesville.Google Scholar
• Wang Q, Huang Y, Singh PV (2022) Algorithms, artificial intelligence and simple rule-based pricing. Preprint, submitted June 29, https://doi.org/10.2139/ssrn.4144905.Google Scholar
• Xiong W, Cont R (2021) Interactions of market making algorithms: A study on perceived collusion. Proc. Second ACM Internat. Conf. AI Finance (Association for Computing Machinery, New York), 1–9.Google Scholar
• Young HP (2004) Strategic Learning and Its Limits, The Arne Ryde Memorial Lectures Series (Oxford University Press, Oxford, UK).Crossref, Google Scholar