Quantile Optimization via Multiple-Timescale Local Search for Black-Box Functions

References

• Audet C, Hare W (2017) Derivative-Free and Blackbox Optimization, 1st ed. (Springer, Berlin).Crossref, Google Scholar
• Bhatnagar S (2005) Adaptive multivariate three-timescale stochastic approximation algorithms for simulation based optimization. ACM Trans. Model. Comput. Simul. 15(1):74–107.Crossref, Google Scholar
• Borkar VS (2008) Stochastic Approximation: A Dynamical Systems Viewpoint (Cambridge University Press, Cambridge, UK).Crossref, Google Scholar
• Bottou L, Curtis FE, Nocedal J (2018) Optimization methods for large-scale machine learning. SIAM Rev. 60(2):223–311.Crossref, Google Scholar
• Cao P, Miwa T, Morikawa T (2014) Modeling distribution of travel time in signalized road section using truncated distribution. Procedia Soc. Behav. Sci. 138:137–147.Crossref, Google Scholar
• Fabian V (1968) On asymptotic normality in stochastic approximation. Ann. Math. Statist. 39(4):1327–1332.Crossref, Google Scholar
• Fu MC (2015) Handbook of Simulation Optimization (Springer Science + Business Media, New York).Crossref, Google Scholar
• Fu MC, Hill SD (1997) Optimization of discrete event systems via simultaneous perturbation stochastic approximation. IIE Trans. 29(3):233–243.Crossref, Google Scholar
• Fu MC, Hong LJ, Hu JQ (2009) Conditional Monte Carlo estimation of quantile sensitivities. Management Sci. 55(12):2019–2027.Link, Google Scholar
• Ghadimi S, Lan G (2012) Optimal stochastic approximation algorithms for strongly convex stochastic composite optimization. I: A generic algorithmic framework. SIAM J. Optim. 22(4):1469–1492.Crossref, Google Scholar
• Givens GH, Hoeting JA (2013) Computational Statistics, 2nd ed. (John Wiley & Sons, Inc., Hoboken, NJ).Google Scholar
• Hong YY, Chang HL, Chiu CS (2010) Hour-ahead wind power and speed forecasting using simultaneous perturbation stochastic approximation (SPSA) algorithm and neural network with fuzzy inputs. Energy 35(9):3870–3876.Crossref, Google Scholar
• Hu J, Fu MC (2024) Technical note—On the convergence rate of stochastic approximation for gradient-based stochastic optimization. Oper. Res., ePub ahead of print March 8, https://doi.org/10.1287/opre.2023.0055.Link, Google Scholar
• Hu J, Peng Y, Zhang G, Zhang Q (2022) A stochastic approximation method for simulation-based quantile optimization. INFORMS J. Comput. 34(6):2889–2907.Link, Google Scholar
• Kibzun AI, Kurbakovskiy V (1991) Guaranteeing approach to solving quantile optimization problems. Ann. Oper. Res. 30(1):81–93.Crossref, Google Scholar
• Kibzun AI, Matveev E (2012) Optimization of the quantile criterion for the convex loss function by a stochastic quasi-gradient algorithm. Ann. Oper. Res. 200(1):183–198.Crossref, Google Scholar
• Kibzun AI, Naumov AV, Norkin VI (2013) On reducing a quantile optimization problem with discrete distribution to a mixed integer programming problem. Autom. Remote Control 74(6):951–967.Crossref, Google Scholar
• Kiefer J, Wolfowitz J (1952) Stochastic estimation of the maximum of a regression function. Ann. Math. Statist. 23(3):462–466.Crossref, Google Scholar
• Kim JH, Powell WB (2011) Quantile optimization for heavy-tailed distributions using asymmetric signum functions. Working paper, Princeton University, Princeton, NJ.Google Scholar
• Kleinman NL, Spall JC, Naiman DQ (1999) Simulation-based optimization with stochastic approximation using common random numbers. Management Sci. 45(11):1570–1578.Link, Google Scholar
• Konda VR, Tsitsiklis JN (2004) Convergence rate of linear two-time-scale stochastic approximation. Ann. Appl. Probab. 14(2):796–819.Crossref, Google Scholar
• Kushner HJ, Clark DS (1978) Stochastic Approximation Methods for Constrained and Unconstrained Systems (Springer-Verlag, New York).Crossref, Google Scholar
• Kushner HJ, Yin GG (1997) Stochastic Approximation and Recursive Algorithms and Applications (Springer, New York).Google Scholar
• Law AM (2013) Simulation Modeling and Analysis, 5th ed. (McGraw-Hill, New York).Google Scholar
• Li MS, Xue HL, Shi F (2017) Optimization of traffic signal parameters based on distribution of link travel time. J. Central South Univ. 24(2):432–441.Crossref, Google Scholar
• Mokkadem A, Pelletier M (2006) Convergence rate and averaging of nonlinear two-time-scale stochastic approximation algorithms. Ann. Appl. Probab. 16(3):1671–1702.Crossref, Google Scholar
• Rugh WJ (1996) Linear System Theory, 2nd ed. (Prentice Hall, Upper Saddle River, NJ).Google Scholar
• Sabater C, Le Maître O, Congedo PM, Görtz S (2021) A Bayesian approach for quantile optimization problems with high-dimensional uncertainty sources. Comput. Methods Appl. Mech. Engrg. 376:113632.Crossref, Google Scholar
• Song M, Hu J, Fu MC (2023) Simultaneous perturbation-based stochastic approximation for quantile optimization. Corlu CG, Hunter SR, Lam H, Onggo BS, Shortle J, Biller B, eds. Proc. 2023 Winter Simulation Conf. (IEEE Press, Piscataway, NJ), 3565–3576.Google Scholar
• Spall JC (1992) Multivariate stochastic approximation using a simultaneous perturbation gradient approximation. IEEE Trans. Automat. Control 37(3):332–341.Crossref, Google Scholar
• Spall JC (2003) Introduction to Stochastic Search and Optimization (John Wiley & Sons, Hoboken, NJ).Crossref, Google Scholar
• Spall JC, Chin DC (1997) Traffic-responsive signal timing for system-wide traffic control. Transportation Res. Part C Emerging Tech. 5(3–4):153–163.Crossref, Google Scholar
• Spall JC, Cristion JA (1997) A neural network controller for systems with unmodeled dynamics with applications to wastewater treatment. IEEE Trans. Systems Man Cybernetics Part B Cybernetics 27(3):369–375.Crossref, Google Scholar
• Vasiléva SN, Kan YS (2015) A method for solving quantile optimization problems with a bilinear loss function. Autom. Remote Control 76(9):1582–1597.Crossref, Google Scholar
• Wang S, Ng SH, Haskell WB (2021) A multilevel simulation optimization approach for quantile functions. INFORMS J. Comput. 34(1):569–585.Link, Google Scholar
• Zamar DS, Bhushan Gopaluni R, Sokhansanj S, Newlands NK (2017) A quantile-based scenario analysis approach to biomass supply chain optimization under uncertainty. Comput. Chem. Engrg. 97(2):114–123.Crossref, Google Scholar
• Zhang Q, Hu J (2019) Simulation optimization using multi-time-scale adaptive random search. Asia-Pac. J. Oper. Res. 36(6):1940014.Crossref, Google Scholar