Gradient-Based Simulation Optimization Algorithms via Multi-Resolution System Approximations

References

• Ajalloeian A, Stich SU (2020) On the convergence of SGD with biased gradients. Preprint, submitted July 31, last revised May 9, 2021, https://arxiv.org/abs/2008.00051.Google Scholar
• Asmussen S, Glynn PW (2007) Stochastic Simulation: Algorithms and Analysis, vol. 57 (Springer Science & Business Media, Boston).Crossref, Google Scholar
• Balabanov V, Venter G (2004) Multi-fidelity optimization with high-fidelity analysis and low-fidelity gradients. Proc. 10th AIAA/ISSMO Multidisciplinary Anal. Optim. Conf. (American Institute of Aeronautics and Astronautics, Reston, VA), 4459.Google Scholar
• Blanchet JH, Glynn PW, Pei Y (2019) Unbiased multilevel monte carlo: Stochastic optimization, steady-state simulation, quantiles, and other applications. Preprint, submitted April 22, https://arxiv.org/abs/1904.09929.Google Scholar
• Chen Ch, Lee LH (2011) Stochastic Simulation Optimization: An Optimal Computing Budget Allocation, vol. 1 (World Scientific).Google Scholar
• Cooper K, Hunter SR, Nagaraj K (2020) Bi-objective simulation optimization on integer lattices using the epsilon-constraint method in a retrospective approximation framework. INFORMS J. Comput. 32(4):1080–1100.Abstract, Google Scholar
• Dereich S (2021) General multilevel adaptations for stochastic approximation algorithms II: CLTs. Stochastic Processing Appl. 132:226–260.Google Scholar
• Dereich S, Müller-Gronbach T (2019) General multilevel adaptations for stochastic approximation algorithms of Robbins–Monro and Polyak–Ruppert type. Numerical Math. 142(2):279–328.Crossref, Google Scholar
• Duchi JC, Jordan MI, Wainwright MJ, Wibisono A (2015) Optimal rates for zero-order convex optimization: The power of two function evaluations. IEEE Trans. Inform. Theory 61(5):2788–2806.Crossref, Google Scholar
• Eckman DJ, Henderson SG (2020) Biased gradient estimators in simulation optimization. Bae KH, Feng B, Kim S, Lazarova-Molnar S, Zheng Z, Roeder T, Thiesing R, eds. Proc. Winter Simulation Conf. (IEEE Press, Piscataway NJ), 2935–2946.Google Scholar
• Frikha N (2016) Multi-level stochastic approximation algorithms. Ann. Appl. Probab. 26(2):933–985.Crossref, Google Scholar
• Fu MC (2015) Handbook of Simulation Optimization, vol. 216 (Springer, Berlin).Crossref, Google Scholar
• Ghadimi S, Lan G (2013) Stochastic first-and zeroth-order methods for nonconvex stochastic programming. SIAM J. Optim. 23(4):2341–2368.Crossref, Google Scholar
• Giles MB (2008) Multilevel monte carlo path simulation. Oper. Res. 56(3):607–617.Link, Google Scholar
• Glynn PW (1990) Likelihood ratio gradient estimation for stochastic systems. Comm. ACM 33(10):75–84.Crossref, Google Scholar
• Gong WB, Ho YC (1987) Smoothed (conditional) perturbation analysis of discrete event dynamical systems. IEEE Trans. Automated Control 32(10):858–866.Crossref, Google Scholar
• Haurie A, L’Ecuyer P, Van Delft C (1994) Monte-Carlo optimization of parametrized policies in a class of piecewise deterministic control systems arising in manufacturing flow control. Discrete Event Dynamic Systems 4(1):87–111.Crossref, Google Scholar
• Heidergott B, Vázquez-Abad F (2008) Measure-valued differentiation for markov chains. J. Optim. Theory Appl. 136(2):187–209.Crossref, Google Scholar
• Heidergott B, Vázquez-Abad FJ, Pflug G, Farenhorst-Yuan T (2010) Gradient estimation for discrete-event systems by measure-valued differentiation. ACM Trans. Modeling Comput. Simulation 20(1):1–28.Crossref, Google Scholar
• Heinrich S (2001) Multilevel monte carlo methods. Margenov S, Waśniewski J, Yalamov P, eds. Proc. Internat. Conf. on Large-Scale Scientific Comput. (Springer, Berlin), 58–67.Google Scholar
• Hill SD, Fu MC (1994) Simulation optimization via simultaneous perturbation stochastic approximation. Manivannan MS, Tew JD, eds. Proc. Winter Simulation Conf. (Society for Computer Simulation International, San Diego), 1461–1464.Google Scholar
• Hong LJ, Zhang X (2021) Surrogate-based simulation optimization. Carlsson JG, ed. Tutorials in Operations Research: Emerging Optimization Methods and Modeling Techniques with Applications (INFORMS, Catonsville, MD), 287–311.Google Scholar
• Hu Y, Zhang S, Chen X, He N (2020) Biased stochastic gradient descent for conditional stochastic optimization. Preprint, submitted February 25, https://arxiv.org/abs/2002.10790.Google Scholar
• Huang D, Allen TT, Notz WI, Miller RA (2006) Sequential kriging optimization using multiple-fidelity evaluations. Structure Multidisciplinary Optim. 32(5):369–382.Crossref, Google Scholar
• Hunter SR, Applegate EA, Arora V, Chong B, Cooper K, Rincón-Guevara O, Vivas-Valencia C (2019) An introduction to multiobjective simulation optimization. ACM Trans. Modeling Comput. Simulation 29(1):1–36.Crossref, Google Scholar
• Jacod J, Protter P, (1998) Asymptotic error distributions for the Euler method for stochastic differential equations. Ann. Probability 26(1):267–307.Crossref, Google Scholar
• Jian N, Henderson SG (2015) An introduction to simulation optimization. Yilmaz L, Moon I-C, Chan WK, Roeder T, eds. Proc Winter Simulation Conf. (IEEE Press, Piscataway, NJ), 1780–1794.Google Scholar
• Kiatsupaibul S, Smith RL, Zabinsky ZB (2018) Single observation adaptive search for continuous simulation optimization. Oper. Res. 66(6):1713–1727.Link, Google Scholar
• Kleinman NL, Spall JC, Naiman DQ (1999) Simulation-based optimization with stochastic approximation using common random numbers. Management Sci. 45(11):1570–1578.Link, Google Scholar
• L’ecuyer P (1990) A unified view of the ipa, sf, and lr gradient estimation techniques. Management Sci. 36(11):1364–1383.Link, Google Scholar
• L’Ecuyer P, Yin G (1998) Budget-dependent convergence rate of stochastic approximation. SIAM J. Optim. 8(1):217–247.Crossref, Google Scholar
• Nesterov Y, Spokoiny V (2017) Random gradient-free minimization of convex functions. Foundations Comput. Math. 17(2):527–566.Crossref, Google Scholar
• Pasupathy R, Ghosh S (2013) Simulation optimization: A concise overview and implementation guide. Topaloglu H, Cole Smith J, eds. Theory Driven by Influential Applications (INFORMS, Catonsville, MD), 122–150.Google Scholar
• Peng Y, Fu MC, Hu JQ, Heidergott B (2018) A new unbiased stochastic derivative estimator for discontinuous sample performances with structural parameters. Oper. Res. 66(2):487–499.Link, Google Scholar
• Reiman MI, Weiss A (1989) Sensitivity analysis for simulations via likelihood ratios. Oper. Res. 37(5):830–844.Link, Google Scholar
• Rubinstein RY (1986) The score function approach for sensitivity analysis of computer simulation models. Math. Comput. Simulation 28(5):351–379.Crossref, Google Scholar
• Song J, Qiu Y, Xu J, Yang F (2019) Multi-fidelity sampling for efficient simulation-based decision making in manufacturing management. IISE Trans. 51(7):792–805.Crossref, Google Scholar
• Spall JC (2000) Adaptive stochastic approximation by the simultaneous perturbation method. IEEE Trans. Automated Control 45(10):1839–1853.Crossref, Google Scholar
• Vasquez D, Shashaani S, Pasupathy R (2019) Astro for derivative-based stochastic optimization: Algorithm description & numerical experiments. Mustafee N, Rabe M, K-HG Bae, Szabo C, Lazarova-Molnar S, eds. Proc. Winter Simulation Conf. (IEEE Press, Piscataway, NJ), 3563–3574.Google Scholar
• Wang S, Ng SH, Haskell WB (2022) A multilevel simulation optimization approach for quantile functions. INFORMS J. Comput. 34(1):569–585.Link, Google Scholar
• Xu J, Huang E, Hsieh L, Lee LH, Jia QS, Chen CH (2016) Simulation optimization in the era of industrial 4.0 and the industrial Internet. J. Simulation 10(4):310–320.Crossref, Google Scholar
• Xu J, Zhang S, Huang E, Chen CH, Lee LH, Celik N (2014) Efficient multi-fidelity simulation optimization. Tolk A, Yilmaz L, Diallo SY, Ryzhov IO, eds. Proc. Winter Simulation Conf. (IEEE Press, Piscataway, NJ), 3940–3951.Google Scholar
• Yin G, Yan H, Lou S (1993) On a class of stochastic optimization algorithms with applications to manufacturing models. Muller WG, Wynn HP, Zhigljavsky AA, eds. Model-Oriented Data Analysis (Physica-Verlag, Heidelberg, Germany), 213–226.Google Scholar
• Zhang H, Zheng Z, Lavaei J (2021) Stochastic l-convex function minimization. Adv. Neural Inform. Processing Systems 34:13004–13018.Google Scholar
• Zhang H, Zheng Z, Lavaei J (2022) Gradient-based algorithms for convex discrete optimization via simulation. Oper. Res., ePub ahead of print April 28, https://doi.org/10.1287/opre.2022.2295.Link, Google Scholar
• Zhou E, Bhatnagar S (2017) Gradient-based adaptive stochastic search for simulation optimization over continuous space. INFORMS J. Comput. 30(1):154–167.Link, Google Scholar