Selecting a Selection Procedure

Jürgen Branke
Jürgen Branke
[email protected]
Institute AIFB, University of Karlsruhe, D-76128 Karlsruhe, Germany
Search for more papers by this author
,
Stephen E. Chick
Stephen E. Chick
[email protected]
Technology and Operations Management, INSEAD, 77305 Fontainebleau Cedex, France
Search for more papers by this author
,
Christian Schmidt
Christian Schmidt
[email protected]
Institute AIFB, University of Karlsruhe, D-76128 Karlsruhe, Germany
Search for more papers by this author

Jürgen Branke

[email protected]

Institute AIFB, University of Karlsruhe, D-76128 Karlsruhe, Germany

Search for more papers by this author

Stephen E. Chick

[email protected]

Technology and Operations Management, INSEAD, 77305 Fontainebleau Cedex, France

Search for more papers by this author

Christian Schmidt

[email protected]

Institute AIFB, University of Karlsruhe, D-76128 Karlsruhe, Germany

Search for more papers by this author

Published Online:1 Dec 2007https://doi.org/10.1287/mnsc.1070.0721

Supplemental Material

mnsc.1070.0721-sm-ec.pdf (392 KB)

Cited by
- A hybrid ranking and selection procedure to solve simulation-based discrete network design problems
  Transportation Research Part C: Emerging Technologies, Vol. 183
- A Bayesian formulation for optimizing resource allocation via simulation
- Response Adaptivity Across Clinical Trials in Portfolios of Biomedical Innovations
  1 January 2026 | SSRN Electronic Journal, Vol. 18
- Stopping Rules for Sampling in Precision Medicine
- Explore Then Confirm: Investment Portfolios for New Drug Therapies
- Revisiting an Open Question in Ranking and Selection under Unknown Variances
- Simulation Optimization and Artificial Intelligence
  4 December 2025 | Foundations and Trends in Optimization, Vol. 9, No. 4
- Learning Personalized Treatment Strategies with Predictive and Prognostic Covariates in Adaptive Clinical Trials
  Andres Alban,
  Stephen E. Chick,
  Spyros I. Zoumpoulis
  29 October 2025 | Management Science, Vol. 0, No. 0
- Simulation Budget Allocation Across Iterations in Iterative Local Search: A Stopping Rule-Based Approach
- A review of simulation optimization with connection to artificial intelligence
  Fundamental Research, Vol. 14
- Feature Misspecification in Sequential Learning Problems
  Dohyun Ahn; ,
  Dongwook Shin; ,
  Assaf Zeevi
  29 August 2024 | Management Science, Vol. 71, No. 5
- Efficient Rollout Algorithms for Resource-Constrained Project Scheduling with a Flexible Project Structure and Uncertain Activity Durations
  24 April 2025 | Mathematics, Vol. 13, No. 9
- Ranking and selection with two-stage decision
  European Journal of Operational Research, Vol. 322, No. 1
- The (Surprising) Sample Optimality of Greedy Procedures for Large-Scale Ranking and Selection
  Zaile Li; ,
  Weiwei Fan; ,
  L. Jeff Hong
  7 May 2024 | Management Science, Vol. 71, No. 2
- Adaptive robust online portfolio selection
  European Journal of Operational Research, Vol. 321, No. 1
- Best-Arm Identification with High-Dimensional Features
- Estimating Value of Information Arm Allocation Indices in Contextual Ranking and Selection Problems
- Fixed-Precision Ranking and Selection as Markov Decision Process
- Finite Budget Allocation Improvement in Ranking and Selection
- Optimal computing budget allocation for selecting the optimal subset of multi-objective simulation optimization problems
  Automatica, Vol. 169
- Bonferroni-Free and Indifference-Zone-Flexible Sequential Elimination Procedures for Ranking and Selection
  Wenyu Wang,
  Hong Wan,
  Xi Chen
  11 April 2023 | Operations Research, Vol. 72, No. 5
- A comparison between the OCBA and the KN selection procedures for maximizing the probability of correct selection
  25 March 2023 | International Journal of Modeling, Simulation, and Scientific Computing, Vol. 15, No. 01
- Real-time digital twin-based optimization with predictive simulation learning
  7 March 2022 | Journal of Simulation, Vol. 18, No. 1
- A Contextual Ranking and Selection Method for Personalized Medicine
  Jianzhong Du,
  Siyang Gao,
  Chun-Hung Chen
  22 August 2023 | Manufacturing & Service Operations Management, Vol. 26, No. 1
- Virtual Material Quality Investigation System
  IEEE Transactions on Engineering Management, Vol. 71
- Ranking and Selection with Two-Stage Decision
  1 January 2024 | SSRN Electronic Journal, Vol. 240
- An efficient simulation procedure for the expected opportunity cost using metamodels
  Automatica, Vol. 157
- Using Cache or Credit for Parallel Ranking and Selection
  26 October 2023 | ACM Transactions on Modeling and Computer Simulation, Vol. 33, No. 4
- Simulation Optimization in the New Era of AI
  Yijie Peng,
  Chun-Hung Chen,
  Michael C. Fu
  13 October 2023
- Convergence rate analysis for optimal computing budget allocation algorithms
  Automatica, Vol. 153
- Value-Based Clinical Trials: Selecting Recruitment Rates and Trial Lengths in Different Regulatory Contexts
  Andres Alban,
  Stephen E. Chick,
  Martin Forster,
  20 September 2022 | Management Science, Vol. 69, No. 6
- Efficient estimation of a risk measure requiring two-stage simulation optimization
  European Journal of Operational Research, Vol. 305, No. 3
- Optimal budget allocation policy for tabu search in stochastic simulation optimization
  Computers & Operations Research, Vol. 150
- Endocrine Tumor Classification via Machine-Learning-Based Elastography: A Systematic Scoping Review
  29 January 2023 | Cancers, Vol. 15, No. 3
- Practical Simulation Budget Allocation for Ranked Subset Partitioning
  IEEE Access, Vol. 11
- Thompson Sampling Meets Ranking and Selection
- Posterior-Based Stopping Rules for Bayesian Ranking-and-Selection Procedures
  David J. Eckman,
  Shane G. Henderson
  19 January 2022 | INFORMS Journal on Computing, Vol. 34, No. 3
- Bayesian-based indifference-zone multi-objective ranking and selection procedures
  Computers & Industrial Engineering, Vol. 167
- Dynamic Sampling Allocation Under Finite Simulation Budget for Feasibility Determination
  Zhongshun Shi,
  Yijie Peng,
  Leyuan Shi,
  Chun-Hung Chen,
  Michael C. Fu
  23 March 2021 | INFORMS Journal on Computing, Vol. 34, No. 1
- Optimal Learning and Optimal Design
  12 April 2022
- Learning Personalized Treatment Strategies with Predictive and Prognostic Covariates in Adaptive Clinical Trials
  1 January 2022 | SSRN Electronic Journal, Vol. 68
- Expected Value of Information Methods for Contextual Ranking and Selection: Clinical Trials and Simulation Optimization
- On the Convergence of Optimal Computing Budget Allocation Algorithms
- Optimal Computing Budget Allocation for regression with gradient information
  Automatica, Vol. 134
- A Practical Approach to Subset Selection for Multi-objective Optimization via Simulation
  16 August 2021 | ACM Transactions on Modeling and Computer Simulation, Vol. 31, No. 4
- Review on ranking and selection: A new perspective
  29 March 2021 | Frontiers of Engineering Management, Vol. 8, No. 3
- Optimal computing budget allocation for the vector evaluated genetic algorithm in multi-objective simulation optimization
  Automatica, Vol. 129
- Stochastic optimization using grey wolf optimization with optimal computing budget allocation
  Applied Soft Computing, Vol. 103
- Efficient Sampling Allocation Procedures for Optimal Quantile Selection
  Yijie Peng,
  Chun-Hung Chen,
  Michael C. Fu,
  Jian-Qiang Hu,
  Ilya O. Ryzhov
  25 June 2020 | INFORMS Journal on Computing, Vol. 33, No. 1
- Online Ordinal Optimization under Model Misspecification
  SSRN Electronic Journal, Vol. 23
- Value-based Clinical Trials: Selecting Recruitment Rates and Trial Lengths in Different Regulatory Contexts
  SSRN Electronic Journal, Vol. 53
- Pareto Set Selection for Multiobjective Stochastic Simulation Model
  IEEE Transactions on Systems, Man, and Cybernetics: Systems, Vol. 50, No. 11
- A Heuristic Approach for Selecting Best-Subset Including Ranking Within the Subset
  IEEE Transactions on Systems, Man, and Cybernetics: Systems, Vol. 50, No. 10
- Discriminating the Nature of Thyroid Nodules Using the Hybrid Method
  Mathematical Problems in Engineering, Vol. 2020
- Information theory for ranking and selection
  14 April 2020 | Naval Research Logistics (NRL), Vol. 67, No. 4
- Stochastic Control Framework for Determining Feasible Alternatives in Sampling Allocation
  IEEE Transactions on Automatic Control, Vol. 65, No. 6
- Optimal computing budget allocation for complete ranking with input uncertainty
  14 October 2019 | IISE Transactions, Vol. 52, No. 5
- Heuristic Search Strategies for Noisy Optimization
  18 July 2020
- Enhancing the Noise Robustness of the Optimal Computing Budget Allocation Approach
  IEEE Access, Vol. 8
- A Simulation Budget Allocation Procedure for Finding Both Extreme Designs Simultaneously in Discrete-Event Simulation
  IEEE Access, Vol. 8
- A worst‐case formulation for constrained ranking and selection with input uncertainty
  24 October 2019 | Naval Research Logistics (NRL), Vol. 66, No. 8
- Bayesian Simulation Optimization with Common Random Numbers
- A Spectral Index for Selecting the Best Alternative
- Identifying efficient solutions via simulation: myopic multi-objective budget allocation for the bi-objective case
  23 August 2019 | OR Spectrum, Vol. 41, No. 3
- Efficient solution selection for two-stage stochastic programs
  European Journal of Operational Research, Vol. 277, No. 3
- Selecting an Optimal Subset with Regression Metamodels
- Efficient Simulation Sampling Allocation Using Multifidelity Models
  IEEE Transactions on Automatic Control, Vol. 64, No. 8
- Predicting the Simulation Budget in Ranking and Selection Procedures
  18 June 2019 | ACM Transactions on Modeling and Computer Simulation, Vol. 29, No. 3
- Simulation optimisation
  13 July 2019
- Multi-fidelity sampling for efficient simulation-based decision making in manufacturing management
  28 May 2019 | IISE Transactions, Vol. 51, No. 7
- An efficient simulation procedure for ranking the top simulated designs in the presence of stochastic constraints
  Automatica, Vol. 103
- Top-κ selection with pairwise comparisons
  European Journal of Operational Research, Vol. 274, No. 2
- Complete expected improvement converges to an optimal budget allocation
  23 July 2019 | Advances in Applied Probability, Vol. 51, No. 01
- Considering sample means in Rinott’s procedure with a Bayesian approach
  European Journal of Operational Research, Vol. 273, No. 1
- Ranking and Selection
  24 January 2019 | ACM Transactions on Modeling and Computer Simulation, Vol. 29, No. 1
- An Improved Budget Allocation Procedure for Selecting the Best-Simulated Design in the Presence of Large Stochastic Noise
  IEEE Access, Vol. 7
- A novel optimal replication allocation strategy for particle swarm optimization algorithms applied to simulation optimization problem
  Applied Soft Computing, Vol. 71
- Gradient-Based Myopic Allocation Policy: An Efficient Sampling Procedure in a Low-Confidence Scenario
  IEEE Transactions on Automatic Control, Vol. 63, No. 9
- Optimal Computing Budget Allocation to Select the Nondominated Systems—A Large Deviations Perspective
  IEEE Transactions on Automatic Control, Vol. 63, No. 9
- Solving Markov decision processes for network-level post-hazard recovery via simulation optimization and rollout
- Dynamic Sampling for Feasibility Determination
- Simulation optimisation
  6 July 2018
- A new strategy for selecting good enough designs using optimal computing budget allocation
  4 January 2018 | Journal of Simulation, Vol. 12, No. 3
- Distributed simulation optimization and parameter exploration framework for the cloud
  Simulation Modelling Practice and Theory, Vol. 83
- Optimal inventory control with sequential online auction in agriculture supply chain: an agent-based simulation optimisation approach
  7 September 2017 | International Journal of Production Research, Vol. 56, No. 6
- Finite-Time Analysis for the Knowledge-Gradient Policy
  SIAM Journal on Control and Optimization, Vol. 56, No. 2
- Efficient simulation budget allocation for stochastically constrained simulation optimization with regression in partitioned domains
- A multi-objective perspective on robust ranking and selection
- Ranking and selection with covariates
- Efficient expected improvement estimation for continuous multiple ranking and selection
- Rate-optimality of the complete expected improvement criterion
- An efficient fully sequential selection procedure guaranteeing probably approximately correct selection
- Bayesian simulation optimization with input uncertainty
- Simulation budget allocation for simultaneously selecting the best and worst subsets
  Automatica, Vol. 84
- Novel hybrid approach with elite group optimal computing budget allocation for the stochastic multimodal problem
  Neurocomputing, Vol. 260
- Selecting good enough simulated designs
- Adaptive sampling rule for ranking-and-selection problem
- Rapid screening algorithms for stochastically constrained problems
  8 March 2017 | Annals of Operations Research, Vol. 254, No. 1-2
- Robust ranking and selection with optimal computing budget allocation
  Automatica, Vol. 81
- Efficient Ranking and Selection in Parallel Computing Environments
  Eric C. Ni,
  Dragos F. Ciocan,
  Shane G. Henderson,
  Susan R. Hunter
  7 March 2017 | Operations Research, Vol. 65, No. 3
- A New Budget Allocation Framework for the Expected Opportunity Cost
  Siyang Gao,
  Weiwei Chen,
  Leyuan Shi
  20 March 2017 | Operations Research, Vol. 65, No. 3
- Myopic Allocation Policy With Asymptotically Optimal Sampling Rate
  IEEE Transactions on Automatic Control, Vol. 62, No. 4
- A Partition-Based Random Search for Stochastic Constrained Optimization via Simulation
  IEEE Transactions on Automatic Control, Vol. 62, No. 2
- Bayesian Belief Models in Simulation-Based Decision-Making
  29 August 2017
- Parallel Ranking and Selection
  29 August 2017
- Efficient Feasibility Determination With Multiple Performance Measure Constraints
  IEEE Transactions on Automatic Control, Vol. 62, No. 1
- On the Convergence Rates of Expected Improvement Methods
  Ilya O. Ryzhov
  18 May 2016 | Operations Research, Vol. 64, No. 6
- Indifference-Zone-Free Selection of the Best
  Weiwei Fan,
  L. Jeff Hong,
  Barry L. Nelson
  13 October 2016 | Operations Research, Vol. 64, No. 6
- Optimal computing budget allocation with exponential underlying distribution
- Optimal computing budget allocation with input uncertainty
- Auction policy analysis: An agent-based simulation optimization model of grain market
- A new budget allocation framework for selecting top simulated designs
  22 June 2016 | IIE Transactions, Vol. 48, No. 9
- Simulation Optimisation
  20 July 2016
- Intelligent computing budget allocation for on-road trajectory planning based on candidate curves
  11 June 2016 | Frontiers of Information Technology & Electronic Engineering, Vol. 17, No. 6
- Dynamic Sampling Allocation and Design Selection
  Yijie Peng,
  Chun-Hung Chen,
  Michael C. Fu,
  Jian-Qiang Hu
  16 February 2016 | INFORMS Journal on Computing, Vol. 28, No. 2
- Bayesian Optimization via Simulation with Pairwise Sampling and Correlated Prior Beliefs
  Jing Xie,
  Peter I. Frazier,
  Stephen E. Chick
  25 March 2016 | Operations Research, Vol. 64, No. 2
- Feasibility determination in presence of multiple performance measure constraints
- A Simulation Budget Allocation Procedure for Enhancing the Efficiency of Optimal Subset Selection
  IEEE Transactions on Automatic Control, Vol. 61, No. 1
- An introduction to simulation optimization
- A new myopic sequential sampling algorithm for multi-objective problems
- Non-monotonicity of probability of correct selection
- A note on the subset selection for simulation optimization
- Fully Sequential Procedures for Large-Scale Ranking-and-Selection Problems in Parallel Computing Environments
  Jun Luo,
  L. Jeff Hong,
  Barry L. Nelson,
  Yang Wu
  18 September 2015 | Operations Research, Vol. 63, No. 5
- Selecting the Best Simulated Design With the Expected Opportunity Cost Bound
  IEEE Transactions on Automatic Control, Vol. 60, No. 10
- An accelerated stopping rule for the Nested Partition Hybrid Algorithm for discrete stochastic optimization
  10 April 2014 | Discrete Event Dynamic Systems, Vol. 25, No. 3
- Optimal Budget Allocation Rule for Simulation Optimization Using Quadratic Regression in Partitioned Domains
  IEEE Transactions on Systems, Man, and Cybernetics: Systems, Vol. 45, No. 7
- Simulation Optimization: A Review and Exploration in the New Era of Cloud Computing and Big Data
  10 June 2015 | Asia-Pacific Journal of Operational Research, Vol. 32, No. 03
- Simulation optimization approach for hybrid flow shop scheduling problem in semiconductor back-end manufacturing
  Simulation Modelling Practice and Theory, Vol. 51
- Stochastically Constrained Ranking and Selection via SCORE
  13 August 2014 | ACM Transactions on Modeling and Computer Simulation, Vol. 25, No. 1
- Discrete Optimization via Simulation
  18 September 2014
- Ranking and Selection: Efficient Simulation Budget Allocation
  18 September 2014
- Simulation optimization: A tutorial overview and recent developments in gradient-based methods
- Sample allocation for multiple attribute selection problems
- An optimal opportunity cost selection procedure for a fixed number of designs
- A Fully Sequential Elimination Procedure for Indifference-Zone Ranking and Selection with Tight Bounds on Probability of Correct Selection
  Peter I. Frazier
  17 June 2014 | Operations Research, Vol. 62, No. 4
- Genetic-algorithm-based simulation optimization considering a single stochastic constraint
  European Journal of Operational Research, Vol. 236, No. 1
- An efficient simulation budget allocation method incorporating regression for partitioned domains
  Automatica, Vol. 50, No. 5
- Optimal Computing Budget Allocation for Complete Ranking
  IEEE Transactions on Automation Science and Engineering, Vol. 11, No. 2
- Monte Carlo sampling-based methods for stochastic optimization
  Surveys in Operations Research and Management Science, Vol. 19, No. 1
- Efficient Simulation Budget Allocation for Ranking the Top m Designs
  Discrete Dynamics in Nature and Society, Vol. 2014
- Allocating attribute-specific information-gathering resources to improve selection decisions
- A procedure to select the best subset among simulated systems using economic opportunity cost
- Robust selection of the best
- Minimizing opportunity cost in selecting the best feasible design
- A dynamic framework for statistical selection problems
- Simulation Optimization: A Review on Theory and Applications
  Acta Automatica Sinica, Vol. 39, No. 11
- Memetic Algorithm for Real-Time Combinatorial Stochastic Simulation Optimization Problems With Performance Analysis
  IEEE Transactions on Cybernetics, Vol. 43, No. 5
- Optimal Sampling Laws for Stochastically Constrained Simulation Optimization on Finite Sets
  Susan R. Hunter,
  Raghu Pasupathy,
  14 September 2012 | INFORMS Journal on Computing, Vol. 25, No. 3
- Rapid Screening Procedures for Zero-One Optimization via Simulation
  Shing Chih Tsai,
  4 May 2012 | INFORMS Journal on Computing, Vol. 25, No. 2
- Efficient simulation budget allocation with regression
  IIE Transactions, Vol. 45, No. 3
- Discrete Parameter Optimization
- Optimal computing budget allocation for small computing budgets
- Ranking and selection meets robust optimization
- Approximate Simulation Budget Allocation for Selecting the Best Design in the Presence of Stochastic Constraints
  IEEE Transactions on Automatic Control, Vol. 57, No. 11
- An improved simulation budget allocation procedure to efficiently select the optimal subset of many alternatives
- A Framework for Selecting a Selection Procedure
  1 August 2012 | ACM Transactions on Modeling and Computer Simulation, Vol. 22, No. 3
- Efficient Selection of a Set of Good Enough Designs With Complexity Preference
  IEEE Transactions on Automation Science and Engineering, Vol. 9, No. 3
- Optimal splitting for rare-event simulation
  IIE Transactions, Vol. 44, No. 5
- Bibliography
  25 April 2012
- Sequential Sampling with Economics of Selection Procedures
  Stephen E. Chick,
  Peter Frazier,
  7 October 2011 | Management Science, Vol. 58, No. 3
- Ordinal optimization: A nonparametric framework
- Stochastic Algorithms for Discrete Parameter Simulation Optimization
  IEEE Transactions on Automation Science and Engineering, Vol. 8, No. 4
- Stochastic systems simulation optimization
  2 September 2011 | Frontiers of Electrical and Electronic Engineering in China, Vol. 6, No. 3
- A marginal analysis guided technology evaluation and selection
  International Journal of Production Economics, Vol. 131, No. 1
- Information Collection on a Graph
  Ilya O. Ryzhov,
  Warren B. Powell,
  1 February 2011 | Operations Research, Vol. 59, No. 1
- Decision‐Theoretic Foundations of Simulation Optimization
  15 February 2011
- Statistical Methods for Optimization
  15 February 2011
- Using simulation-optimization to construct screening strategies for cervical cancer
  5 June 2010 | Health Care Management Science, Vol. 13, No. 4
- Computing budget allocation rules for multi-objective simulation models based on different measures of selection quality
  Automatica, Vol. 46, No. 12
- Performance measures for Ranking and Selection procedures
- A quantile-based approach to system selection
  European Journal of Operational Research, Vol. 202, No. 3
- Constrained optimization in expensive simulation: Novel approach
  European Journal of Operational Research, Vol. 202, No. 1
- A Hybrid Differential Evolution Algorithm for Stochastic Flow Shop Scheduling with Limited Buffers
  Acta Automatica Sinica, Vol. 35, No. 12
- Sequential Sampling to Myopically Maximize the Expected Value of Information
  Stephen E. Chick,
  Jürgen Branke,
  Christian Schmidt,
  29 June 2009 | INFORMS Journal on Computing, Vol. 22, No. 1
- Simulation optimization using the cross-entropy method with optimal computing budget allocation
  8 February 2010 | ACM Transactions on Modeling and Computer Simulation, Vol. 20, No. 1
- Bayesian Simulation and Decision Analysis: An Expository Survey
  Jason R. W. Merrick,
  11 September 2009 | Decision Analysis, Vol. 6, No. 4
- A brief introduction to optimization via simulation
- Do mean-based ranking and selection procedures consider systems' risk?
- The conjunction of the knowledge gradient and the economic approach to simulation selection
- The Knowledge-Gradient Policy for Correlated Normal Beliefs
  Peter Frazier,
  Warren Powell,
  Savas Dayanik,
  19 May 2009 | INFORMS Journal on Computing, Vol. 21, No. 4
- Economic Analysis of Simulation Selection Problems
  Stephen E. Chick,
  Noah Gans,
  26 November 2008 | Management Science, Vol. 55, No. 3
- An Analysis of Dynamic Mutation Operators for Conformational Sampling
- Some topics for simulation optimization
- A preliminary study of optimal splitting for rare-event simulation
- The knowledge-gradient stopping rule for ranking and selection
- Efficient Simulation Budget Allocation for Selecting an Optimal Subset
  Chun-Hung Chen,
  Donghai He,
  Michael Fu,
  Loo Hay Lee,
  30 May 2008 | INFORMS Journal on Computing, Vol. 20, No. 4
- On selecting the best individual in noisy environments
  12 July 2008
- Constrained Optimization in Simulation: A Novel Approach
  SSRN Electronic Journal, Vol. 68
- New greedy myopic and existing asymptotic sequential selection procedures: preliminary empirical results
- Efficient Dynamic Simulation Allocation in Ordinal Optimization
  IEEE Transactions on Automatic Control, Vol. 51, No. 12

Volume 53, Issue 12

December 2007

Pages iv-1989

Article Information

Supplemental Material

Metrics

Information

Received:September 20, 2005
Published Online:December 01, 2007

Cite as

Jürgen Branke, Stephen E. Chick, Christian Schmidt, (2007) Selecting a Selection Procedure. Management Science 53(12):1916-1932.

https://doi.org/10.1287/mnsc.1070.0721

Keywords

PDF download

Available Issues

Available Issues

Available Issues

Available Issues

Available Issues

Available Issues

Available Issues

Available Issues

Available Issues

Selecting a Selection Procedure

Supplemental Material

Volume 53, Issue 12

Article Information

Supplemental Material

Metrics

Information

Cite as

Keywords

Sign Up for INFORMS Publications Updates and News