On the Convergence Rates of Expected Improvement Methods

Ilya O. Ryzhov
Corresponding Author
Ilya O. Ryzhov
[email protected]
Robert H. Smith School of Business, University of Maryland, College Park, Maryland 20742
Search for more papers by this author

Ilya O. Ryzhov

Corresponding Author

Ilya O. Ryzhov

[email protected]

Robert H. Smith School of Business, University of Maryland, College Park, Maryland 20742

Search for more papers by this author

Published Online:18 May 2016https://doi.org/10.1287/opre.2016.1494

Supplemental Material

opre.2016.1494-sm.pdf (230 KB)

Cited by
- Optimal computing budget allocation to select Pareto set under stochastic constraints
  23 May 2026 | Discrete Event Dynamic Systems, Vol. 36, No. 1
- Cross-Validation Based Adaptive Sampling for Multilevel Gaussian Process Models
  27 April 2026 | SIAM/ASA Journal on Uncertainty Quantification, Vol. 14, No. 2
- Fifty years of stochastic simulation: Where we are and where we need to go
  European Journal of Operational Research, Vol. 330, No. 3
- A Bayesian formulation for optimizing resource allocation via simulation
- Adaptive Intelligence: Combining Digital Twin Precision with AI Foresight for Real-Time Decision Making
- Revisiting an Open Question in Ranking and Selection under Unknown Variances
- Simulation Optimization and Artificial Intelligence
  4 December 2025 | Foundations and Trends® in Optimization, Vol. 9, No. 4
- Knowledge Gradient Procedure to Select the Best System Under Pairwise Comparisons
  19 May 2025 | Naval Research Logistics (NRL), Vol. 72, No. 8
- Data‐Driven Ranking and Selection With Simultaneous Input Data Collection and Simulation
  21 June 2025 | Naval Research Logistics (NRL), Vol. 72, No. 8
- Selection of the Most Probable Best
  Taeho Kim,
  Kyoung-Kuk Kim,
  Eunhye Song
  31 December 2024 | Operations Research, Vol. 73, No. 6
- Ranking and Contextual Selection
  Gregory Keslin,
  Barry L. Nelson,
  Bernardo Pagnoncelli,
  Matthew Plumlee,
  Hamed Rahimian
  3 October 2024 | Operations Research, Vol. 73, No. 5
- Simulation Budget Allocation for Improving Scheduling and Routing of Automated Guided Vehicles in Warehouse Management
  29 July 2024 | Journal of the Operations Research Society of China, Vol. 13, No. 3
- A budget-adaptive allocation rule for optimal computing budget allocation
  European Journal of Operational Research, Vol. 325, No. 2
- A review of simulation optimization with connection to artificial intelligence
  Fundamental Research, Vol. 14
- Ranking and selection with two-stage decision
  European Journal of Operational Research, Vol. 322, No. 1
- Fixed Budget Bayesian Best Arm Identification in Unimodal Bandits
- Fixed-Precision Ranking and Selection as Markov Decision Process
- Sequential Learning with a Similarity Selection Index
  Yi Zhou,
  Michael C. Fu,
  Ilya O. Ryzhov
  17 May 2023 | Operations Research, Vol. 72, No. 6
- Time-reassigned adaptive fourier synchrosqueezing transform with globally optimal window length
  Biomedical Signal Processing and Control, Vol. 97
- Sequential Selection for Minimizing the Variance with Application to Crystallization Experiments
  7 March 2024 | The American Statistician, Vol. 78, No. 4
- Taking another step: A simple approach to high-dimensional Bayesian optimization
  Information Sciences, Vol. 679
- Rate-Optimal Bayesian Simple Regret in Best Arm Identification
  Junpei Komiyama,
  Kaito Ariu,
  Masahiro Kato,
  Chao Qin
  25 August 2023 | Mathematics of Operations Research, Vol. 49, No. 3
- Efficient Simulation-Assisted Service System Design
- Dynamic computing budget allocation for design ranking in stochastic complex systems
  6 February 2024 | SCIENTIA SINICA Informationis, Vol. 54, No. 2
- A Contextual Ranking and Selection Method for Personalized Medicine
  Jianzhong Du,
  Siyang Gao,
  Chun-Hung Chen
  22 August 2023 | Manufacturing & Service Operations Management, Vol. 26, No. 1
- POMDP-Based Ranking and Selection
- A Simulation Optimization Method for Scheduling Automated Guided Vehicles in a Stochastic Warehouse Management System
- Asymptotically Optimal Sampling Policy for Selecting Top-m Alternatives
  Gongbo Zhang,
  Yijie Peng,
  Jianghua Zhang,
  Enlu Zhou
  21 August 2023 | INFORMS Journal on Computing, Vol. 35, No. 6
- Simulation Optimization in the New Era of AI
  Yijie Peng,
  Chun-Hung Chen,
  Michael C. Fu
  13 October 2023
- Efficient Sampling Policy for Selecting a Subset With the Best
  IEEE Transactions on Automatic Control, Vol. 68, No. 8
- Convergence rate analysis for optimal computing budget allocation algorithms
  Automatica, Vol. 153
- Adaptive fully sequential selection procedures with linear and nonlinear control variates
  16 June 2022 | IISE Transactions, Vol. 55, No. 6
- Balancing Optimal Large Deviations in Sequential Selection
  Ye Chen,
  Ilya O. Ryzhov
  14 September 2022 | Management Science, Vol. 69, No. 6
- Mixed-Input Bayesian Optimization Method for Structural Damage Diagnosis
  IEEE Transactions on Reliability, Vol. 72, No. 2
- Asymptotic optimality of myopic ranking and selection procedures
  Automatica, Vol. 151
- Ranking and selection for pairwise comparison
  10 January 2023 | Naval Research Logistics (NRL), Vol. 70, No. 3
- Convergence Analysis of Stochastic Kriging-Assisted Simulation with Random Covariates
  Cheng Li,
  Siyang Gao,
  Jianzhong Du
  10 January 2023 | INFORMS Journal on Computing, Vol. 35, No. 2
- Data-driven stochastic optimization for power grids scheduling under high wind penetration
  3 October 2021 | Energy Systems, Vol. 14, No. 1
- Optimal budget allocation policy for tabu search in stochastic simulation optimization
  Computers & Operations Research, Vol. 150
- Ranking and Selection
  21 September 2023
- Thompson Sampling Meets Ranking and Selection
- Adaptive Design of Personalized Dose-Finding Clinical Trials
  Saeid Delshad,
  Amin Khademi
  21 July 2022 | Service Science, Vol. 14, No. 4
- Solving Large-Scale Fixed-Budget Ranking and Selection Problems
  L. Jeff Hong,
  Guangxin Jiang,
  Ying Zhong
  28 July 2022 | INFORMS Journal on Computing, Vol. 34, No. 6
- An Optimal Computing Budget Allocation Tree Policy for Monte Carlo Tree Search
  IEEE Transactions on Automatic Control, Vol. 67, No. 6
- Canonical Problems and Applications
  8 April 2022
- Technical note—Knowledge gradient for selection with covariates: Consistency and computation
  7 October 2021 | Naval Research Logistics (NRL), Vol. 69, No. 3
- Sequential selection for accelerated life testing via approximate Bayesian inference
  18 June 2021 | Naval Research Logistics (NRL), Vol. 69, No. 2
- Cross-Validation--based Adaptive Sampling for Gaussian Process Models
  28 February 2022 | SIAM/ASA Journal on Uncertainty Quantification, Vol. 10, No. 1
- Dynamic Sampling Allocation Under Finite Simulation Budget for Feasibility Determination
  Zhongshun Shi,
  Yijie Peng,
  Leyuan Shi,
  Chun-Hung Chen,
  Michael C. Fu
  23 March 2021 | INFORMS Journal on Computing, Vol. 34, No. 1
- Optimal Learning and Optimal Design
  12 April 2022
- Selection of the Most Probable Best Under Input Uncertainty
- Calibrated and recalibrated expected improvements for Bayesian optimization
  19 August 2021 | Structural and Multidisciplinary Optimization, Vol. 64, No. 6
- Optimal Computing Budget Allocation for regression with gradient information
  Automatica, Vol. 134
- Benchmarking the performance of Bayesian optimization across multiple experimental materials science domains
  18 November 2021 | npj Computational Materials, Vol. 7, No. 1
- Automatic calibration of dynamic and heterogeneous parameters in agent-based models
  24 August 2021 | Autonomous Agents and Multi-Agent Systems, Vol. 35, No. 2
- Multi-Objective Surrogate-Assisted Stochastic Optimization for Engine Calibration
  20 May 2021 | Journal of Dynamic Systems, Measurement, and Control, Vol. 143, No. 10
- Review on ranking and selection: A new perspective
  29 March 2021 | Frontiers of Engineering Management, Vol. 8, No. 3
- Problem-fluent models for complex decision-making in autonomous materials research
  Computational Materials Science, Vol. 193
- Novel Approaches to Feasibility Determination
  8 January 2021 | ACM Transactions on Modeling and Computer Simulation, Vol. 31, No. 1
- Efficient Sampling Allocation Procedures for Optimal Quantile Selection
  Yijie Peng,
  Chun-Hung Chen,
  Michael C. Fu,
  Jian-Qiang Hu,
  Ilya O. Ryzhov
  25 June 2020 | INFORMS Journal on Computing, Vol. 33, No. 1
- Joint Resource Allocation for Input Data Collection and Simulation
- Simple Bayesian Algorithms for Best-Arm Identification
  Daniel Russo
  16 April 2020 | Operations Research, Vol. 68, No. 6
- Expected improvement for expensive optimization: a review
  10 July 2020 | Journal of Global Optimization, Vol. 78, No. 3
- A Bayesian experimental autonomous researcher for mechanical design
  Science Advances, Vol. 6, No. 15
- Multi-objective ranking and selection: Optimal sampling laws and tractable approximations via SCORE
  20 August 2019 | Journal of Simulation, Vol. 14, No. 1
- Technical Note—Consistency Analysis of Sequential Learning Under Approximate Bayesian Inference
  Ye Chen,
  Ilya O. Ryzhov
  2 January 2020 | Operations Research, Vol. 68, No. 1
- Bayesian Optimization-Based Global Optimal Rank Selection for Compression of Convolutional Neural Networks
  IEEE Access, Vol. 8
- Utility-Based Statistical Selection Procedures
- Balancing Optimal Large Deviations in Ranking and Selection
- Rate Analysis For Offline Simulation Online Application
- Bayesian Sequential Experimental Design for Stochastic Kriging with Jackknife Error Estimates
- Bayesian sequential data collection for stochastic simulation calibration
  European Journal of Operational Research, Vol. 277, No. 1
- Selecting the Optimal System Design under Covariates
- Efficient Simulation Sampling Allocation Using Multifidelity Models
  IEEE Transactions on Automatic Control, Vol. 64, No. 8
- A unified framework for stochastic optimization
  European Journal of Operational Research, Vol. 275, No. 3
- Complete expected improvement converges to an optimal budget allocation
  23 July 2019 | Advances in Applied Probability, Vol. 51, No. 01
- Exploration Enhanced Expected Improvement for Bayesian Optimization
  23 January 2019
- A REVIEW OF STATIC AND DYNAMIC OPTIMIZATION FOR RANKING AND SELECTION
- Sequential Design of Computer Experiments
  13 November 2018
- The Local Time Method for Targeting and Selection
  Ilya O. Ryzhov
  30 August 2018 | Operations Research, Vol. 66, No. 5
- Ranking and Selection as Stochastic Control
  IEEE Transactions on Automatic Control, Vol. 63, No. 8
- Rate-optimality of the complete expected improvement criterion
- Myopic Allocation Policy With Asymptotically Optimal Sampling Rate
  IEEE Transactions on Automatic Control, Vol. 62, No. 4
- Bayesian Belief Models in Simulation-Based Decision-Making
  29 August 2017
- Parallel Ranking and Selection
  29 August 2017

Volume 64, Issue 6

November-December 2016

Pages ii-iii, 1177-1565

Article Information

Supplemental Material

Metrics

Information

Received:November 01, 2014
Accepted:March 01, 2016
Published Online:May 18, 2016

Cite as

Ilya O. Ryzhov (2016) On the Convergence Rates of Expected Improvement Methods. Operations Research 64(6):1515-1528.

https://doi.org/10.1287/opre.2016.1494

Keywords

PDF download

Available Issues

Available Issues

Available Issues

Available Issues

Available Issues

Available Issues

Available Issues

Available Issues

Available Issues

On the Convergence Rates of Expected Improvement Methods

Supplemental Material

Volume 64, Issue 6

Article Information

Supplemental Material

Metrics

Information

Cite as

Keywords

Sign Up for INFORMS Publications Updates and News