Existence of Optimal Stationary Singular Controls and Mean Field Game Equilibria

References

• [1] Adlakha S, Johari R, Weintraub G (2015) Equilibria of dynamic games with many players: Existence, approximation, and market structure. J. Econom. Theory 156:269–316. Google Scholar
• [2] Aid R, Basei M, Ferrari G (2023) A stationary mean-field equilibrium model of irreversible investment in a two-regime economy. Oper. Res., ePub ahead of print May 6, https://doi.org/10.1287/opre.2023.0250.Google Scholar
• [3] Aliprantis CD, Border KC (2006) Infinite Dimensional Analysis, 3rd ed. (Springer, Berlin).Google Scholar
• [4] Alvarez E LH (2018) A class of solvable stationary singular stochastic control problems. Preprint, submitted March 9, https://arxiv.org/abs/1803.03464.Google Scholar
• [5] Alvarez E LH, Hening A (2019) Optimal sustainable harvesting of populations in random environments. Stochastic Processes Appl. 150:678–698.Crossref, Google Scholar
• [6] Anahtarci B, Kariksiz CD, Saldi N (2019) Value iteration algorithm for mean-field games. Systems Control. Lett. 143:104744.Crossref, Google Scholar
• [7] Arapostathis A, Pang G (2016) Ergodic diffusion control of multiclass multi-pool networks in the Halfin-Whitt regime. Ann. Appl. Probab. 26(5):3110–3153.Crossref, Google Scholar
• [8] Arapostathis A, Pang G (2018) Infinite-horizon average optimality of the N-network in the Halfin-Whitt regime. Math. Oper. Res. 43(3):838–866.Link, Google Scholar
• [9] Arapostathis A, Biswas A, Carroll J (2017) On solutions of mean field games with ergodic cost. J. Math. Pures Appl. 107(2):205–251.Crossref, Google Scholar
• [10] Arapostathis A, Biswas A, Pang G (2015) Ergodic control of multi-class M/M/N+M queues in the Halfin-Whitt regime. Ann. Appl. Probab. 25(6):3511–3570.Crossref, Google Scholar
• [11] Arapostathis A, Borkar VS, Ghosh MK (2011) Ergodic control of diffusion processes. Encyclopedia of Mathematics and Its Applications (Cambridge University Press, Cambridge, UK).Crossref, Google Scholar
• [12] Arapostathis A, Hmedi H, Pang G, Sandrić N (2019) Uniform polynomial rates of convergence for a class of Lévy-driven controlled SDEs arising in multiclass many-server queues. Modeling, Stochastic Control, Optimization, and Applications, IMA Volumes in Mathematics and its Applications, vol. 164 (Springer, Cham, Switzerland), 1–20.Crossref, Google Scholar
• [13] Ata B, Harrison JM, Si N (2024) Singular control of (reflected) Brownian motion: A computational method suitable for queueing applications. Queueing Systems: Theory Appl. 108(3):215–251.Google Scholar
• [14] Atar R, Budhiraja A, Williams RJ (2007) HJB equations for certain singularly controlled diffusions. Ann. Appl. Probab. 17(5–6):1745–1776.Crossref, Google Scholar
• [15] Aydın U, Saldi N (2023) Robustness and approximation of discrete-time mean-field games under discounted cost criterion. Math. Oper. Res., ePub ahead of print January 30, https://doi.org/10.1287/moor.2023.0316.Google Scholar
• [16] Bardi M, Priuli FS (2014) Linear-quadratic N-person and mean-field games with ergodic cost. SIAM J. Control Optim. 52(5):3022–3052.Crossref, Google Scholar
• [17] Biswas A (2017) An ergodic control problem for many-server multiclass queueing systems with cross-trained servers. Stochastic Systems 7(2):263–288.Link, Google Scholar
• [18] Borkar VS (1989) Optimal Control of Diffusion Processes, Pitman Research Notes in Mathematics Series, vol. 203 (John Wiley & Sons, Inc., New York).Google Scholar
• [19] Borodin AN, Salminen P (2002) Probability and its applications. Handbook of Brownian Motion—Facts and Formulae (Springer, New York).Crossref, Google Scholar
• [20] Bouveret G, Dumitrescu R, Tankov P (2020) Mean-field games of optimal stopping: A relaxed solution approach. SIAM J. Control Optim. 58(4):1795–1821.Crossref, Google Scholar
• [21] Budhiraja A (2003) An ergodic control problem for constrained diffusion processes: Existence of optimal Markov control. SIAM J. Control Optim. 42(2):532–558.Crossref, Google Scholar
• [22] Budhiraja A, Ross K (2006) Existence of optimal controls for singular control problems with state constraints. Ann. Appl. Probab. 16(4):2235–2255.Crossref, Google Scholar
• [23] Budhiraja A, Ghosh AP, Lee C (2011) Ergodic rate control problem for single class queueing networks. SIAM J. Control Optim. 49(4):1570–1606.Crossref, Google Scholar
• [24] Campi L, De Angelis T, Ghio M, Livieri G (2022) Mean-field games of finite-fuel capacity expansion with singular controls. Ann. Appl. Probab. 32(5):3674–3717.Crossref, Google Scholar
• [25] Cannerozzi F, Ferrari G (2024) Cooperation, correlation and competition in ergodic n-player games and mean-field games of singular controls: A case study. Preprint, submitted April 23, https://arxiv.org/abs/2404.15079.Google Scholar
• [26] Cao H, Guo X (2022) MFGs for partially reversible investment. Stochastic Processes Appl. 150:995–1014.Crossref, Google Scholar
• [27] Cao H, Dianetti J, Ferrari G (2023) Stationary discounted and ergodic mean field games with singular controls. Math. Oper. Res. 48(4):1871–1898.Abstract, Google Scholar
• [28] Cao H, Guo X, Lee JS (2023) Approximation of N-player stochastic games with singular controls by mean field games. NACO 13(3–4):604–629.Crossref, Google Scholar
• [29] Cardaliaguet P, Porretta A (2019) Long time behavior of the master equation in mean-field game theory. Anal. & PDE 12(6):1397–1453.Google Scholar
• [30] Carmona R (2021) Applications of mean field games in financial engineering and economic theory. Delarue F, ed. Proc. Sympos. Appl. Math., vol. 78 (Amer. Math. Soc., Providence, RI), 165–219.Crossref, Google Scholar
• [31] Carmona R, Delarue F (2018) Probabilistic Theory of Mean Field Games with Applications I: Mean Field FBSDEs, Control, and Games, Probability Theory and Stochastic Modelling, vol. 83 (Springer, Cham, Switzerland).Google Scholar
• [32] Carmona R, Delarue F (2018) Probabilistic Theory of Mean Field Games with Applications II: Mean Field Games with Common Noise and Master Equations, Probability Theory and Stochastic Modelling, vol. 84 (Springer, Cham, Switzerland).Google Scholar
• [33] Carmona R, Delarue F, Lacker D (2017) Mean field games of timing and models for bank runs. Appl. Math. Optim. 76(1):217–260.Crossref, Google Scholar
• [34] Cohen A (2019) Brownian control problems for a multiclass M/M/1 queueing problem with model uncertainty. Math. Oper. Res. 44(2):739–766.Link, Google Scholar
• [35] Cohen A (2021) On singular control problems, the time-stretching method, and the weak-M1 topology. SIAM J. Control Optim. 59(1):50–77.Crossref, Google Scholar
• [36] Cohen A, Zell E (2023) Analysis of the finite-state ergodic master equation. Appl. Math. Optim. 87(3):40–53.Crossref, Google Scholar
• [37] Cohen A, Hening A, Sun C (2022) Optimal ergodic harvesting under ambiguity. SIAM J. Control Optim. 60(2):1039–1063.Crossref, Google Scholar
• [38] Davis MH, Norman AR (1990) Portfolio selection with transaction costs. Math. Oper. Res. 15(4):676–713.Link, Google Scholar
• [39] Dianetti J, Ferrari G, Tzouanas I (2023) Ergodic mean-field games of singular control with regime-switching (extended version). Preprint, submitted July 22, https://arxiv.org/abs/2307.12012.Google Scholar
• [40] Dianetti J, Ferrari G, Fischer M, Nendel M (2023) A unifying framework for submodular mean field games. Math. Oper. Res. 48(3):1679–1710.Link, Google Scholar
• [41] Dumitrescu R, Leutscher M, Tankov P (2021) Control and optimal stopping mean field games: A linear programming approach. Electronic J. Probab. 26:1–49.Crossref, Google Scholar
• [42] Echeverría P (1982) A criterion for invariant measures of Markov processes. Z. Wahrsch. Verw. Gebiete. 61(1):1–16.Crossref, Google Scholar
• [43] Elie R, Hubert E, Turinici G (2020) Contact rate epidemic control of COVID-19: An equilibrium view. Math. Model. Natural Phenomena 15:35.Crossref, Google Scholar
• [44] Feleqi E (2013) The derivation of ergodic mean field game equations for several populations of players. Dynamic Games Appl. 3(4):523–536.Crossref, Google Scholar
• [45] Fu G (2023) Extended mean field games with singular controls. SIAM J. Control Optim. 61(1):283–312.Crossref, Google Scholar
• [46] Fu G, Horst U (2017) Mean field games with singular controls. SIAM J. Control Optim. 55(6):3833–3868.Crossref, Google Scholar
• [47] Gomes DA, Mitake H (2015) Existence for stationary mean-field games with congestion and quadratic Hamiltonians. Nonlinear Differential Equations Appl. 22(6):1897–1910.Crossref, Google Scholar
• [48] Graber PJ (2016) Linear quadratic mean field type control and mean field games with common noise, with application to production of an exhaustible resource. Appl. Math. Optim. 74(3):459–486.Crossref, Google Scholar
• [49] Granas A, Dugundji J (2003) Fixed Point Theory, Springer Monographs in Mathematics (Springer-Verlag, New York).Google Scholar
• [50] Guo X, Xu R (2019) Stochastic games for fuel follower problem: N versus mean field game. SIAM J. Control Optim. 57(1):659–692.Crossref, Google Scholar
• [51] Harrison JM, Taksar MI (1983) Instantaneous control of Brownian motion. Math. Oper. Res. 8(3):439–453.Link, Google Scholar
• [52] Harrison JM, Williams RJ (1987) Brownian models of open queueing networks with homogeneous customer populations. Stochastics 22(2):77–115.Crossref, Google Scholar
• [53] Harrison JM, Williams RJ (1987) Multidimensional reflected Brownian motions having exponential stationary distributions. Ann. Probab. 15(1):115–137. Crossref, Google Scholar
• [54] Haussmann UG (1971) Optimal stationary control with state control dependent noise. SIAM J. Control 9(2):184–198.Crossref, Google Scholar
• [55] Haussmann UG, Suo W (1994) Existence of singular optimal control laws for stochastic differential equations. Stochastics Stochastic Rep. 48(3–4):249–272.Crossref, Google Scholar
• [56] Haussmann UG, Suo W (1995) Singular optimal stochastic controls. I. Existence. SIAM J. Control Optim. 33(3):916–936.Crossref, Google Scholar
• [57] Haussmann UG, Suo W (1995) Singular optimal stochastic controls. II. Dynamic programming. SIAM J. Control Optim. 33(3):937–959.Crossref, Google Scholar
• [58] Hening A, Nguyen DH (2018) Coexistence and extinction for stochastic Kolmogorov systems. Ann. Appl. Probab. 28(3):1893–1942.Crossref, Google Scholar
• [59] Hening A, Tran KQ (2020) Harvesting and seeding of stochastic populations: Analysis and numerical approximation. J. Math. Biol. 81(1):65–112.Crossref, Google Scholar
• [60] Hening A, Nguyen DH, Ungureanu SC, Wong TK (2019) Asymptotic harvesting of populations in random environments. J. Math. Biol. 78(1–2):293–329.Crossref, Google Scholar
• [61] Huang M, Caines PE, Malhamé RP (2007) The Nash certainty equivalence principle and Mckean-Vlasov systems: An invariance principle and entry adaptation. 46th IEEE Conf. Decision Control (IEEE, Piscataway, NJ), 121–126.Google Scholar
• [62] Huang M, Malhamé RP, Caines PE (2006) Large population stochastic dynamic games: Closed-loop McKean-Vlasov systems and the Nash certainty equivalence principle. Comm. Inform. Systems 6(3):221–251.Crossref, Google Scholar
• [63] Kang W, Ramanan K (2014) Characterization of stationary distributions of reflected diffusions. Ann. Appl. Probab. 24(4):1329–1374.Crossref, Google Scholar
• [64] Karatzas I, Shreve SE (1991) Brownian Motion and Stochastic Calculus, Graduate Texts in Mathematics, 2nd ed., vol. 113 (Springer-Verlag, New York).Google Scholar
• [65] Khasminskii R (2012) Stochastic Stability of Differential Equations, Stochastic Modelling and Applied Probability, 2nd ed., vol. 66 (Springer, Heidelberg).Crossref, Google Scholar
• [66] Kleinman D (1969) Optimal stationary control of linear systems with control-dependent noise. IEEE Trans. Automatic Control 14(6):673–677.Crossref, Google Scholar
• [67] Kruk L (2000) Optimal policies for n-dimensional singular stochastic control problems part I: The Skorokhod problem. SIAM J. Control Optim. 38(5):1603–1622.Crossref, Google Scholar
• [68] Kruk L (2000) Optimal policies for n-dimensional singular stochastic control problems. Part II: The radially symmetric case. Ergodic control. SIAM J. Control Optim. 39(2):635–659.Crossref, Google Scholar
• [69] Kurtz TG, Stockbridge RH (1998) Existence of Markov controls and characterization of optimal Markov controls. SIAM J. Control Optim. 36(2):609–653.Crossref, Google Scholar
• [70] Kurtz TG, Stockbridge RH (2001) Stationary solutions and forward equations for controlled and singular martingale problems. Electronic J. Probab. 6:1–52.Crossref, Google Scholar
• [71] Kurtz TG, Stockbridge RH (2017) Linear programming formulations of singular stochastic control problems: Time-homogeneous problems. Preprint, submitted July 28, https://arxiv.org/abs/1707.09209.Google Scholar
• [72] Lasry JM, Lions PL (2007) Mean field games. Japanese J. Math. 2(1):229–260.Crossref, Google Scholar
• [73] Li Z, Reppen AM, Sircar R (2023) A mean field games model for cryptocurrency mining. Management Sci. 70(4):2188–2208.Google Scholar
• [74] Li J, Xia B, Geng X, Ming H, Shakkottai S, Subramanian V, Xie L (2018) Mean field games in nudge systems for societal networks. ACM Trans. Model. Performance Evaluation Comput. Systems 3(4):2376–3639.Google Scholar
• [75] Liang G, Zervos M (2020) Ergodic singular stochastic control motivated by the optimal sustainable exploitation of an ecosystem. Preprint, submitted August 12, https://arxiv.org/abs/2008.05576.Google Scholar
• [76] Lions PL, Lasry JM (2004) Large investor trading impacts on volatility. Paris-Princeton Lectures on Mathematical Finance, Lecture Notes in Mathematics (Springer, Berlin), 173–190.Google Scholar
• [77] Menaldi JL, Robin M (2013) Singular ergodic control for multidimensional Gaussian-Poisson processes. Stochastics 85(4):682–691.Crossref, Google Scholar
• [78] Neumann BA (2020) Stationary equilibria of mean field games with finite state and action space. Dynamic Games Appl. 10(4):845–871.Crossref, Google Scholar
• [79] Pang B, Jiang ZP (2023) Reinforcement learning for adaptive optimal stationary control of linear stochastic systems. IEEE Trans. Automatic Control 68(4):2383–2390.Crossref, Google Scholar
• [80] Reppen M (2018) Singular control in financial economics. Unpublished PhD thesis, ETH Zurich, Switzerland.Google Scholar
• [81] Varadarajan VS (1958) Weak convergence of measures on separable metric spaces. Sankhyā 19:15–22.Google Scholar
• [82] Ward A, Glynn P (2003) Properties of the reflected Ornstein-Uhlenbeck process. Queueing Systems 44:109–123.Crossref, Google Scholar
• [83] Ying L (2017) Stein’s method for mean field approximations in light and heavy traffic regimes. Proc. ACM Measurement Anal. Comput. Systems 1(1):1–27.Crossref, Google Scholar