Combined Global and Local Search for Optimization with Gaussian Process Models

Published Online:https://doi.org/10.1287/ijoc.2021.1078

References

  • Ankenman B, Nelson BL, Staum J (2010) Stochastic kriging for simulation metamodeling. Oper. Res. 58(2):371–382.LinkGoogle Scholar
  • Ba S, Joseph VR (2012) Composite gaussian process models for emulating expensive functions. Ann. Appl. Statist. 6(4):1838–1860. CrossrefGoogle Scholar
  • Bull AD (2011) Convergence rates of efficient global optimization algorithms. J. Machine Learning Res. 12(Oct):2879–2904.Google Scholar
  • Chen CH, He D, Fu M (2006) Efficient dynamic simulation allocation in ordinal optimization. IEEE Trans. Automatic Control 51(12):2005–2009.CrossrefGoogle Scholar
  • Chen CH, Lin J, Yücesan E, Chick SE (2000) Simulation budget allocation for further enhancing the efficiency of ordinal optimization. Discrete Event Dynamic Systems 10(3):251–270.CrossrefGoogle Scholar
  • Fraley C, Raftery AE (2002) Model-based clustering, discriminant analysis, and density estimation. J. Amer. Statist. Assoc. 97(458):611–631.CrossrefGoogle Scholar
  • Frazier PI (2018) A tutorial on bayesian optimization. Preprint, submitted July 8, https://arxiv.org/abs/1807.02811. Google Scholar
  • Frazier P, Powell W, Dayanik S (2009) The knowledge-gradient policy for correlated normal beliefs. INFORMS J. Comput. 21(4):599–613.LinkGoogle Scholar
  • Hennig P, Schuler CJ (2012) Entropy search for information-efficient global optimization. J. Machine Learning Res. 13(Jun):1809–1837.Google Scholar
  • Huang D, Allen TT, Notz WI, Zeng N (2006) Global optimization of stochastic black-box systems via sequential kriging meta-models. J. Global Optim. 34(3):441–466.CrossrefGoogle Scholar
  • Jalali H, Van Nieuwenhuyse I, Picheny V (2017) Comparison of kriging-based algorithms for simulation optimization with heterogeneous noise. Eur. J. Oper. Res. 261(1):279–301.CrossrefGoogle Scholar
  • Jones DR, Perttunen CD, Stuckman BE (1993) Lipschitzian optimization without the lipschitz constant. J. Optim. Theory Appl. 79(1):157–181.CrossrefGoogle Scholar
  • Jones DR, Schonlau M, Welch WJ (1998) Efficient global optimization of expensive black-box functions. J. Global Optim. 13(4):455–492.CrossrefGoogle Scholar
  • Kleijnen JP, Van Beers W, Van Nieuwenhuyse I (2012) Expected improvement in efficient global optimization through bootstrapped kriging. J. Global Optim. 54(1):59–73.CrossrefGoogle Scholar
  • Meng Q, Ng SH (2015) An additive global and local gaussian process model for large data sets. Winter Simulation Conf. (IEEE, New York), 505–516.Google Scholar
  • Pedrielli G, Wang S, Ng SH (2020) An extended two-stage sequential optimization approach: Properties and performance. Eur. J. Oper. Res. 287(3):929–945.CrossrefGoogle Scholar
  • Pedrielli G, Xing Y, Peh JH, Koh KW, Ng SH (2019) A real time simulation optimization framework for vessel collision avoidance and the case of singapore strait. IEEE Trans. Intelligent Transportation Systems 21(3):1204–1215.Google Scholar
  • Peng Y, Chong EK, Chen CH, Fu MC (2018a) Ranking and selection as stochastic control. IEEE Trans. Automatic Control 63(8):2359–2373.CrossrefGoogle Scholar
  • Peng Y, Xu J, Lee LH, Hu JQ, Chen CH (2018b) Efficient simulation sampling allocation using multi-fidelity models. IEEE Trans. Automat. Control. 64(8):3156–3169.Google Scholar
  • Picheny V (2015) Multiobjective optimization using Gaussian process emulators via stepwise uncertainty reduction. Statist. Comput. 25(6):1265–1280.CrossrefGoogle Scholar
  • Picheny V, Ginsbourger D, Richet Y, Caplin G (2013) Quantile-based optimization of noisy computer experiments with tunable precision. Technometrics 55(1):2–13.CrossrefGoogle Scholar
  • Quan N, Yin J, Ng SH, Lee LH (2013) Simulation optimization via kriging: A sequential search using expected improvement with computing budget constraints. IIE Trans. 45(7):763–780.CrossrefGoogle Scholar
  • Quiñonero-Candela J, Rasmussen CE (2005) A unifying view of sparse approximate Gaussian process regression. J. Machine Learn. Res. 6(Dec):1939–1959.Google Scholar
  • Ranjan P, Haynes R, Karsten R (2011) A computationally stable approach to Gaussian process interpolation of deterministic computer simulation data. Technometrics 53(4):366–378.CrossrefGoogle Scholar
  • Regis RG, Shoemaker CA (2007) A stochastic radial basis function method for the global optimization of expensive functions. INFORMS J. Comput. 19(4):497–509.LinkGoogle Scholar
  • Roy DM, Teh YW (2009) The mondrian process. Koller D, Schuurmans D, Bengio Y, Bottou L, eds. Advances in Neural Information Processing Systems (NIPS) (Curran Associates, Inc.), 21:1377–1384. Google Scholar
  • Shahriari B, Swersky K, Wang Z, Adams RP, De Freitas N (2016) Taking the human out of the loop: A review of Bayesian optimization. Proc. IEEE 104(1):148–175.CrossrefGoogle Scholar
  • Snelson E, Ghahramani Z (2007) Local and global sparse gaussian process approximations. Artificial Intelligence Statist. 2: 524–531. Google Scholar
  • Snoek J, Larochelle H, Adams RP (2012) Practical Bayesian optimization of machine learning algorithms. Adv. Neural Inform. Processing Systems 25:2960–2968. Google Scholar
  • Srinivas N, Krause A, Kakade SM, Seeger M (2010) Gaussian process optimization in the bandit setting: No regret and experimental design. Proc. 27th Internat. Conf. Machine Learn. (Omnipress), 1015–1022. Google Scholar
  • Sun L, Hong LJ, Hu Z (2014) Balancing exploitation and exploration in discrete optimization via simulation through a Gaussian process-based search. Oper. Res. 62(6):1416–1438.LinkGoogle Scholar
  • Xu J, Nelson BL, Hong J (2010) Industrial strength compass: A comprehensive algorithm and software for optimization via simulation. ACM Trans. Modeling Comput. Simulation 20(1):3.CrossrefGoogle Scholar
  • Zabinsky ZB, Bulger D, Khompatraporn C (2010) Stopping and restarting strategy for stochastic sequential search in global optimization. J. Global Optim. 46(2):273–286.CrossrefGoogle Scholar
INFORMS site uses cookies to store information on your computer. Some are essential to make our site work; Others help us improve the user experience. By using this site, you consent to the placement of these cookies. Please read our Privacy Statement to learn more.