Simple Procedures for Selecting the Best Simulated System When the Number of Alternatives is Large

Barry L. Nelson
Barry L. Nelson
[email protected]
Department of Industrial Engineering and Management Sciences, Northwestern University, Evanston, Illinois 60208-3119
Search for more papers by this author
,
Julie Swann
Julie Swann
[email protected]
School of Industrial and Systems Engineering, Georgia Institute of Technology, Atlanta, Georgia 30332
Search for more papers by this author
,
David Goldsman
David Goldsman
[email protected]
School of Industrial and Systems Engineering, Georgia Institute of Technology, Atlanta, Georgia 30332
Search for more papers by this author
,
Wheyming Song
Wheyming Song
[email protected]
Department of Industrial Engineering, National Tsing Hua University, Hsinchu R.O.C., Taiwan
Search for more papers by this author

Barry L. Nelson

[email protected]

Department of Industrial Engineering and Management Sciences, Northwestern University, Evanston, Illinois 60208-3119

Search for more papers by this author

Julie Swann

[email protected]

School of Industrial and Systems Engineering, Georgia Institute of Technology, Atlanta, Georgia 30332

Search for more papers by this author

David Goldsman

[email protected]

School of Industrial and Systems Engineering, Georgia Institute of Technology, Atlanta, Georgia 30332

Search for more papers by this author

Wheyming Song

[email protected]

Department of Industrial Engineering, National Tsing Hua University, Hsinchu R.O.C., Taiwan

Search for more papers by this author

Published Online:1 Dec 2001https://doi.org/10.1287/opre.49.6.950.10019

Supplemental Material

opre.49.6.950-sm.pdf (80 KB)

Cited by
- Efficient selection of the best system: Indifference-zone-free procedures with multi-dimensional Brownian motion
  7 May 2026 | IISE Transactions
- Efficient Fully Sequential Indifference-Zone Procedures Using Properties of Multi-dimensional Brownian Motion Exiting a Sphere
  16 April 2025 | IISE Transactions, Vol. 58, No. 2
- A Bayesian formulation for optimizing resource allocation via simulation
- Evaluation of a two-stage healthcare facility location approach using simulation optimisation and mathematical optimisation
  13 December 2025 | Journal of Simulation, Vol. 48
- Review of Large-Scale Simulation Optimization
  18 June 2025 | Journal of the Operations Research Society of China, Vol. 13, No. 3
- Ranking and selection with two-stage decision
  European Journal of Operational Research, Vol. 322, No. 1
- Adaptive sequential procedures for quantile selection with importance sampling
  8 April 2024 | IISE Transactions, Vol. 57, No. 3
- Finding Feasible Systems in the Presence of a Probability Constraint
- A comparison between the OCBA and the KN selection procedures for maximizing the probability of correct selection
  25 March 2023 | International Journal of Modeling, Simulation, and Scientific Computing, Vol. 15, No. 01
- A Contextual Ranking and Selection Method for Personalized Medicine
  Jianzhong Du,
  Siyang Gao,
  Chun-Hung Chen
  22 August 2023 | Manufacturing & Service Operations Management, Vol. 26, No. 1
- Parallel Adaptive Survivor Selection
  Linda Pei,
  Barry L. Nelson,
  Susan R. Hunter
  24 August 2022 | Operations Research, Vol. 72, No. 1
- Ranking and Selection with Two-Stage Decision
  1 January 2024 | SSRN Electronic Journal, Vol. 240
- Screening Simulated Systems for Optimization
- Epsilon Optimal Sampling
- Mixed-integer simulation optimization for multi-echelon inventory problems with lost sales
  3 November 2022 | Journal of the Operational Research Society, Vol. 74, No. 11
- Convergence rate analysis for optimal computing budget allocation algorithms
  Automatica, Vol. 153
- Adaptive fully sequential selection procedures with linear and nonlinear control variates
  16 June 2022 | IISE Transactions, Vol. 55, No. 6
- Asymptotic optimality of myopic ranking and selection procedures
  Automatica, Vol. 151
- On the finite-sample statistical validity of adaptive fully sequential procedures
  European Journal of Operational Research, Vol. 307, No. 1
- Augmented probability simulation methods for sequential games
  European Journal of Operational Research, Vol. 306, No. 1
- Efficient estimation of a risk measure requiring two-stage simulation optimization
  European Journal of Operational Research, Vol. 305, No. 3
- Optimal budget allocation policy for tabu search in stochastic simulation optimization
  Computers & Operations Research, Vol. 150
- Simulation-Optimization to Distinguish Optimal Symptom Free Waiting Period for Return-to-Play Decisions in Sport-Related Concussion
- Fixed Budget Ranking and Selection with Streaming Input Data
- Let's Do Ranking & Selection
- Discrete Stochastic Optimization for Public Health Interventions with Constraints
  9 December 2022 | Operations Research Forum, Vol. 3, No. 4
- Plausible Screening Using Functional Properties for Simulations with Large Solution Spaces
  David J. Eckman,
  Matthew Plumlee,
  Barry L. Nelson
  1 February 2022 | Operations Research, Vol. 70, No. 6
- Decision support algorithms for optimizing surgery start times considering the performance variation
  11 October 2021 | Health Care Management Science, Vol. 25, No. 2
- Bayesian-based indifference-zone multi-objective ranking and selection procedures
  Computers & Industrial Engineering, Vol. 167
- Derivative‐Free Stochastic Search
  8 April 2022
- A discrete-event simulation model of the kidney transplantation system in Rajasthan, India
  28 November 2020 | Health Systems, Vol. 11, No. 1
- Speeding Up Paulson’s Procedure for Large-Scale Problems Using Parallel Computing
  Ying Zhong,
  Shaoxuan Liu,
  Jun Luo,
  L. Jeff Hong
  4 June 2021 | INFORMS Journal on Computing, Vol. 34, No. 1
- Foundations of Ranking & Selection for Simulation Optimization
  1 December 2022
- An Empirical Evaluation of a Two-stage Healthcare Facility Location Approach using Simulation Optimization and Mathematical Optimization
  SSRN Electronic Journal, Vol. 59
- On the Convergence of Optimal Computing Budget Allocation Algorithms
- Review on ranking and selection: A new perspective
  29 March 2021 | Frontiers of Engineering Management, Vol. 8, No. 3
- Pareto set estimation with guaranteed probability of correct selection
  European Journal of Operational Research, Vol. 292, No. 1
- A Study on Efficient Computing Budget Allocation for a Two-Stage Problem
  5 January 2021 | Asia-Pacific Journal of Operational Research, Vol. 38, No. 02
- Stochastic Multi-criteria Decision Analysis of Combat Simulation Data for Selecting the Best Land Combat Vehicle Option
  27 February 2021
- Simulation for Research
  27 August 2021
- Simulation Optimization and Sensitivity
  27 August 2021
- Online Ordinal Optimization under Model Misspecification
  SSRN Electronic Journal, Vol. 23
- Robustness Revisited: Simulation Optimization Viewed Through A Different Lens
- Revisiting Subset Selection
- Evaluation of bi-Pass for Parallel Simulation Optimization
- Pareto Set Selection for Multiobjective Stochastic Simulation Model
  IEEE Transactions on Systems, Man, and Cybernetics: Systems, Vol. 50, No. 11
- Supply chain cost analysis for additively manufactured biomedical implants
  4 February 2019 | International Journal of Systems Science: Operations & Logistics, Vol. 7, No. 3
- Group decision making in manufacturing systems: An approach using spatial preference information and indifference zone
  Journal of Manufacturing Systems, Vol. 55
- A Partition-Based Optimization Approach for Level Set Approximation: Probabilistic Branch and Bound
  14 September 2019
- An Improved Switch Migration Decision Algorithm for SDN Load Balancing
  IEEE Open Journal of the Communications Society, Vol. 1
- Efficient Simulation Budget Allocation With Bound Information
  IEEE Transactions on Automatic Control, Vol. 65, No. 1
- A worst‐case formulation for constrained ranking and selection with input uncertainty
  24 October 2019 | Naval Research Logistics (NRL), Vol. 66, No. 8
- Decision making under uncertainty for design of resilient engineered systems
  Reliability Engineering & System Safety, Vol. 192
- Rate Analysis For Offline Simulation Online Application
- DA-OCBA: Distributed Asynchronous Optimal Computing Budget Allocation Algorithm of Simulation Optimization Using Cloud Computing
  15 October 2019 | Symmetry, Vol. 11, No. 10
- Efficient solution selection for two-stage stochastic programs
  European Journal of Operational Research, Vol. 277, No. 3
- US Army performance appraisal policy analysis: a simulation optimization approach
  13 August 2018 | The Journal of Defense Modeling and Simulation: Applications, Methodology, Technology, Vol. 16, No. 2
- Dual-mode inventory management under a chance credit constraint
  5 October 2018 | OR Spectrum, Vol. 41, No. 1
- Considering sample means in Rinott’s procedure with a Bayesian approach
  European Journal of Operational Research, Vol. 273, No. 1
- Baskınlık ve Sosyal Seçim Kurallarına Bağlı Çok Kriterli Modelleme: Hisse Senedi Seçimi Problemi için bir Karar Destek Sistemi Önerisi
  29 December 2018 | Cankiri Karatekin Universitesi Iktisadi ve Idari Bilimler Fakultesi Dergisi, Vol. 8, No. 2
- Selective sensing of a heterogeneous population of units with dynamic health conditions
  17 December 2018 | IISE Transactions, Vol. 50, No. 12
- Tractable Sampling Strategies for Ordinal Optimization
  Dongwook Shin,
  Mark Broadie,
  Assaf Zeevi
  23 November 2018 | Operations Research, Vol. 66, No. 6
- Planning labor evacuation for construction sites using BIM and agent-based simulation
  Safety Science, Vol. 109
- Efficient Ranking and Selection for Stochastic Simulation Model Based on Hypothesis Test
  IEEE Transactions on Systems, Man, and Cybernetics: Systems, Vol. 48, No. 9
- A Combined Statistical Selection Procedure Measured by the Expected Opportunity Cost
  3 November 2017 | Arabian Journal for Science and Engineering, Vol. 43, No. 6
- Distributed simulation optimization and parameter exploration framework for the cloud
  Simulation Modelling Practice and Theory, Vol. 83
- A Simulation-Based Dynamic Scheduling Method in Project Cost Estimation Process
  28 October 2017
- Efficient simulation budget allocation for stochastically constrained simulation optimization with regression in partitioned domains
- History of seeking better solutions, AKA simulation optimization
- A multi-objective perspective on robust ranking and selection
- Optimal design of master-worker architecture for parallelized simulation optimization
- Optimal computing budget allocation to the differential evolution algorithm for large-scale portfolio optimization
  19 December 2017 | Journal of Simulation, Vol. 11, No. 4
- An Efficient Budget Allocation Approach for Quantifying the Impact of Input Uncertainty in Stochastic Simulation
  27 October 2017 | ACM Transactions on Modeling and Computer Simulation, Vol. 27, No. 4
- Simulation budget allocation for simultaneously selecting the best and worst subsets
  Automatica, Vol. 84
- Optimal reefer slot conversion for container freight transportation
  2 June 2017 | Maritime Policy & Management, Vol. 44, No. 6
- Rapid screening algorithms for stochastically constrained problems
  8 March 2017 | Annals of Operations Research, Vol. 254, No. 1-2
- Efficient Ranking and Selection in Parallel Computing Environments
  Eric C. Ni,
  Dragos F. Ciocan,
  Shane G. Henderson,
  Susan R. Hunter
  7 March 2017 | Operations Research, Vol. 65, No. 3
- A New Budget Allocation Framework for the Expected Opportunity Cost
  Siyang Gao,
  Weiwei Chen,
  Leyuan Shi
  20 March 2017 | Operations Research, Vol. 65, No. 3
- A simulation-based optimization approach for mitigation of pandemic influenza
  8 May 2017 | IISE Transactions on Healthcare Systems Engineering, Vol. 7, No. 2
- A Sequential Budget Allocation Framework for Simulation Optimization
  IEEE Transactions on Automation Science and Engineering, Vol. 14, No. 2
- Workflow optimisation for multimodal imaging procedures: a case of combined X-ray and MRI-guided TACE
  26 August 2016 | Minimally Invasive Therapy & Allied Technologies, Vol. 26, No. 1
- Parallel Ranking and Selection
  29 August 2017
- Better Big Data via Data Farming Experiments
  29 August 2017
- Efficient Feasibility Determination With Multiple Performance Measure Constraints
  IEEE Transactions on Automatic Control, Vol. 62, No. 1
- Analysis of depression trajectory patterns using collaborative learning
  Mathematical Biosciences, Vol. 282
- Technology transfer of simulation analysis methodology: One man's opinion
- Optimal computing budget allocation with exponential underlying distribution
- Optimal computing budget allocation with input uncertainty
- Auction policy analysis: An agent-based simulation optimization model of grain market
- Challenges in applying ranking and selection after search
- Simulation optimization in the era of Industrial 4.0 and the Industrial Internet
  19 December 2017 | Journal of Simulation, Vol. 10, No. 4
- Balancing Search and Estimation in Random Search Based Stochastic Simulation Optimization
  IEEE Transactions on Automatic Control, Vol. 61, No. 11
- Applying ranking and selection procedures to long-term mitigation for improved network restoration
  EURO Journal on Computational Optimization, Vol. 4, No. 3-4
- A new budget allocation framework for selecting top simulated designs
  22 June 2016 | IIE Transactions, Vol. 48, No. 9
- Feasibility determination in presence of multiple performance measure constraints
- A comparison of HK-CONWIP and BK-CONWIP control strategies in a multi-product manufacturing system
  Operations Research Perspectives, Vol. 2
- Subset selection for simulations accounting for input uncertainty
- A note on the subset selection for simulation optimization
- Comparing Message Passing Interface and MapReduce for large-scale parallel ranking and selection
- Fully Sequential Procedures for Large-Scale Ranking-and-Selection Problems in Parallel Computing Environments
  Jun Luo,
  L. Jeff Hong,
  Barry L. Nelson,
  Yang Wu
  18 September 2015 | Operations Research, Vol. 63, No. 5
- Optimal learning with a local parametric belief model
  3 April 2015 | Journal of Global Optimization, Vol. 63, No. 2
- Selecting the Best Simulated Design With the Expected Opportunity Cost Bound
  IEEE Transactions on Automatic Control, Vol. 60, No. 10
- A Practical Guide to Ranking and Selection Methods
  David Goldsman
  26 October 2015
- Efficient subset selection for the expected opportunity cost
  Automatica, Vol. 59
- Evaluation of multi-product lean manufacturing systems with setup and erratic demand
  Computers & Industrial Engineering, Vol. 87
- Effect of product mix on multi-product pull control
  Simulation Modelling Practice and Theory, Vol. 56
- Optimal Budget Allocation Rule for Simulation Optimization Using Quadratic Regression in Partitioned Domains
  IEEE Transactions on Systems, Man, and Cybernetics: Systems, Vol. 45, No. 7
- Simultaneous determination of warehouse layout and control policies
  18 November 2014 | International Journal of Production Research, Vol. 53, No. 11
- Simulation Optimization: A Review and Exploration in the New Era of Cloud Computing and Big Data
  10 June 2015 | Asia-Pacific Journal of Operational Research, Vol. 32, No. 03
- Extending design space optimization heuristics for use with stochastic colored Petri nets
- Discrete Optimization via Simulation
  18 September 2014
- Ranking and Selection: Efficient Simulation Budget Allocation
  18 September 2014
- Simulating F-22 Heavy Maintenance and Modifications workforce multi-skilling
- A comparison of two parallel ranking and selection procedures
- An optimal opportunity cost selection procedure for a fixed number of designs
- A Fully Sequential Elimination Procedure for Indifference-Zone Ranking and Selection with Tight Bounds on Probability of Correct Selection
  Peter I. Frazier
  17 June 2014 | Operations Research, Vol. 62, No. 4
- Using discrete event computer simulation to improve patient flow in a Ghanaian acute care hospital
  The American Journal of Emergency Medicine, Vol. 32, No. 8
- Genetic-algorithm-based simulation optimization considering a single stochastic constraint
  European Journal of Operational Research, Vol. 236, No. 1
- Improving Voting Systems through Service‐Operations Management
  1 July 2014 | Production and Operations Management, Vol. 23, No. 7
- Optimal learning for sequential sampling with non-parametric beliefs
  3 March 2013 | Journal of Global Optimization, Vol. 58, No. 3
- Experimentation: Searching the Solution Space
- Simulation Optimization for Finite Parameter Space
- A subset selection procedure under input parameter uncertainty
- The knowledge gradient algorithm using locally parametric approximations
- Adaptive simulation budget allocation for determining the best design
- Determining the optimal sampling set size for random search
- A comparison of Kanban-Like control strategies in a multi-product manufacturing system under erratic demand
- Simulation Optimization: A Review on Theory and Applications
  Acta Automatica Sinica, Vol. 39, No. 11
- The call for equity: simulation optimization models to minimize the range of waiting times
  IIE Transactions, Vol. 45, No. 7
- Rapid Screening Procedures for Zero-One Optimization via Simulation
  Shing Chih Tsai,
  4 May 2012 | INFORMS Journal on Computing, Vol. 25, No. 2
- An Adaptive Hyperbox Algorithm for High-Dimensional Discrete Optimization via Simulation Problems
  Jie Xu,
  Barry L. Nelson,
  L. Jeff Hong,
  17 October 2011 | INFORMS Journal on Computing, Vol. 25, No. 1
- Statistical Ranking and Selection
  23 January 2016
- Why Do We Simulate?
  1 December 2012
- Simulation Programming: Quick Start
  1 December 2012
- Examples
  1 December 2012
- Simulation Programming with VBASim
  1 December 2012
- Two Views of Simulation
  1 December 2012
- Simulation Input
  1 December 2012
- Simulation Output
  1 December 2012
- Experiment Design and Analysis
  1 December 2012
- Simulation for Research
  1 December 2012
- Calibration of Stochastic Computer Models Using Stochastic Approximation Methods
  IEEE Transactions on Automation Science and Engineering, Vol. 10, No. 1
- Controlled multistage selection procedures for comparison with a standard
  European Journal of Operational Research, Vol. 223, No. 3
- Efficient discrete optimization via simulation using stochastic kriging
- A discrete-event simulation approach with multiple-comparison procedure for stochastic resource-constrained project scheduling
  17 January 2012 | The International Journal of Advanced Manufacturing Technology, Vol. 63, No. 1-4
- Screening and selection procedures with control variates and correlation induction techniques
  18 June 2012 | Naval Research Logistics (NRL), Vol. 59, No. 5
- Cross-training policies in field services
  International Journal of Production Economics, Vol. 138, No. 1
- A Simulation-Based Optimization Approach to a Lost Sale Stochastic Inventory Model
  International Journal of Operations Research and Information Systems, Vol. 3, No. 2
- Using genetic algorithms and an indifference-zone ranking and selection procedure under common random numbers for simulation optimisation
  19 December 2017 | Journal of Simulation, Vol. 6, No. 1
- Selecting a Good Stochastic System for the Large Number of Alternatives
  7 October 2011 | Communications in Statistics - Simulation and Computation, Vol. 41, No. 2
- Generalized selective assembly
  IIE Transactions, Vol. 44, No. 1
- Selecting the best simulated system with weighted control-variate estimators
  Mathematics and Computers in Simulation, Vol. 82, No. 4
- Large-scale ranking and selection using cloud computing
- Ordinal optimization: A nonparametric framework
- Best-subset selection procedure
- Bibliography
  26 September 2011
- Optimization for simulation: LAD accelerator
  4 February 2009 | Annals of Operations Research, Vol. 188, No. 1
- Sequential selection approach for selecting the best system
- N-Skart: A Nonsequential Skewness- and Autoregression-Adjusted Batch-Means Procedure for Simulation Analysis
  IEEE Transactions on Automatic Control, Vol. 56, No. 2
- Approximate Dynamic Programming I: Modeling
  14 January 2011
- Decision‐Theoretic Foundations of Simulation Optimization
  15 February 2011
- Statistical Methods for Optimization
  15 February 2011
- Continuous optimization via simulation using Golden Region search
  European Journal of Operational Research, Vol. 208, No. 1
- Computing budget allocation rules for multi-objective simulation models based on different measures of selection quality
  Automatica, Vol. 46, No. 12
- Finding feasible systems in the presence of constraints on multiple performance measures
  7 October 2010 | ACM Transactions on Modeling and Computer Simulation, Vol. 20, No. 3
- Fully sequential procedures for comparing constrained systems via simulation
  9 April 2010 | Naval Research Logistics (NRL), Vol. 57, No. 5
- Finding the non-dominated Pareto set for multi-objective simulation models
  IIE Transactions, Vol. 42, No. 9
- Integration of indifference-zone with multi-objective computing budget allocation
  European Journal of Operational Research, Vol. 203, No. 2
- Implicit dual control based on particle filtering and forward dynamic programming
  19 November 2008 | International Journal of Adaptive Control and Signal Processing, Vol. 24, No. 3
- Merging the Ranking and Selection into ITO Algorithm for Simulation Optimization
- Industrial strength COMPASS
  8 February 2010 | ACM Transactions on Modeling and Computer Simulation, Vol. 20, No. 1
- Simulation optimization using the cross-entropy method with optimal computing budget allocation
  8 February 2010 | ACM Transactions on Modeling and Computer Simulation, Vol. 20, No. 1
- A brief introduction to optimization via simulation
- Simulation optimization with Hybrid Golden Region search
- Statistical analysis and comparison of simulation models of highly dependable systems — An experimental study
- Pattern search ranking and selection algorithms for mixed variable simulation-based optimization
  European Journal of Operational Research, Vol. 198, No. 3
- Fully sequential selection procedures with control variates
  IIE Transactions, Vol. 42, No. 1
- Finding probably best systems quickly via simulations
  11 August 2009 | ACM Transactions on Modeling and Computer Simulation, Vol. 19, No. 3
- Differentiated service inventory optimization using nested partitions and MOCBA
  Computers & Operations Research, Vol. 36, No. 5
- Application of Evolutionary Algorithms for Solving Multi-Objective Simulation Optimization Problems
- Combined Screening and Selection of the Best with Control Variates
  17 July 2009
- Cross-trained versus specialized agents in an inbound call centre: a simulation-based methodology for trade-off analysis
  19 December 2017 | Journal of Simulation, Vol. 2, No. 3
- Multi-objective simulation-based evolutionary algorithm for an aircraft spare parts allocation problem
  European Journal of Operational Research, Vol. 189, No. 2
- A Knowledge-Gradient Policy for Sequential Information Collection
  SIAM Journal on Control and Optimization, Vol. 47, No. 5
- Using quantiles in ranking and selection procedures
- A framework for locally convergent random-search algorithms for discrete optimization via simulation
  1 September 2007 | ACM Transactions on Modeling and Computer Simulation, Vol. 17, No. 4
- Subset selection of best simulated systems
  Journal of the Franklin Institute, Vol. 344, No. 5
- Optimizing system configurations quickly by guessing at the performance
  12 June 2007
- Optimizing system configurations quickly by guessing at the performance
  12 June 2007 | ACM SIGMETRICS Performance Evaluation Review, Vol. 35, No. 1
- Optimizing the quality control station configuration
  22 December 2006 | Naval Research Logistics (NRL), Vol. 54, No. 3
- Recent advances in ranking and selection
- Finding the pareto set for multi-objective simulation models by minimization of expected opportunity cost
- Integration of Statistical Selection with Search Mechanism for Solving Multi-Objective Simulation-Optimization Problems
- Combined Ranking and Selection with Control Variates
- The "Best" Algorithm for solving Stochastic Mixed Integer Programs
- Finding probably best system configurations quickly
  1 December 2006 | ACM SIGMETRICS Performance Evaluation Review, Vol. 34, No. 3
- A general framework on the simulation-based optimization under fixed computing budget
  European Journal of Operational Research, Vol. 174, No. 3
- Simulation optimization with countably infinite feasible regions
  1 October 2006 | ACM Transactions on Modeling and Computer Simulation, Vol. 16, No. 4
- Fully sequential selection procedures with a parabolic boundary
  23 February 2007 | IIE Transactions, Vol. 38, No. 9
- Finding probably better system configurations quickly
  26 June 2006 | ACM SIGMETRICS Performance Evaluation Review, Vol. 34, No. 1
- Finding probably better system configurations quickly
  26 June 2006
- Maintenance logistics in the Dutch Dredging Industry
- Towards a theory of practice in metaheuristics design: A machine learning perspective
  20 July 2006 | RAIRO - Theoretical Informatics and Applications, Vol. 40, No. 2
- Chapter 9 Subjective Probability and Bayesian Methodology
- Chapter 17 Selecting the Best System
- Control variates for screening, selection, and estimation of the best
  1 January 2006 | ACM Transactions on Modeling and Computer Simulation, Vol. 16, No. 1
- Simulation of Coherent Risk Measures Based on Generalized Scenarios
  SSRN Electronic Journal, Vol. 9
- Selection Procedures with Frequentist Expected Opportunity Cost Bounds
  Stephen E. Chick,
  Yaozhong Wu,
  1 October 2005 | Operations Research, Vol. 53, No. 5
- Sequential selection procedures: Using sample means to improve efficiency
  European Journal of Operational Research, Vol. 166, No. 1
- Design sampling and replication assignment under fixed computing budget
  Journal of Systems Science and Systems Engineering, Vol. 14, No. 3
- The tradeoff between sampling and switching: New sequential procedures for indifference-zone selection
  23 February 2007 | IIE Transactions, Vol. 37, No. 7
- Stochastic iterative dynamic programming: a Monte Carlo approach to dual control
  Automatica, Vol. 41, No. 5
- Solution quality of random search methods for discrete stochastic optimization
  Mathematics and Computers in Simulation, Vol. 68, No. 2
- Comparison with a standard via fully sequential procedures
  1 April 2005 | ACM Transactions on Modeling and Computer Simulation, Vol. 15, No. 2
- Review of Advanced Methods for Simulation Output Analysis
- Statistical Selection of the Best System
- Using Parallel and Distributed Computing to Increase the Capability of Selection Procedures
- Finding the Best in the Presence of a Stochastic Constraint
- Performance of Variance Updating Ranking and Selection Procedures
- Application of Multi-objective Simulation-optimization Techniques to Inventory Management Problems
- Simulation optimization: A comprehensive review on theory and applications
  17 August 2010 | IIE Transactions, Vol. 36, No. 11
- A survey of recent advances in discrete input parameter discrete-event simulation optimization
  17 August 2010 | IIE Transactions, Vol. 36, No. 6
- Selecting the best stochastic system for large scale problems in DEDS
  Mathematics and Computers in Simulation, Vol. 64, No. 2
- Stochastic Approximation with Simulated Annealing as an Approach to Global Discrete-Event Simulation Optimization
- Combined Pattern Search and Ranking and Selection for Simulation Optimization
- A Framework for Simulating Human Cognitive Behavior and Movement When Predicting Impacts of Catastrophic Events
- Simulation of Coherent Risk Measures
- Using Ranking and Selection to “Clean Up” after Simulation Optimization
  Justin Boesel,
  Barry L. Nelson,
  Seong-Hee Kim,
  1 October 2003 | Operations Research, Vol. 51, No. 5
- Discrete-event simulation optimization using ranking, selection, and multiple comparison procedures
  1 April 2003 | ACM Transactions on Modeling and Computer Simulation, Vol. 13, No. 2
- Distribution of Rankings for Groups Exhibiting Heteroscedasticity and Correlation
  Journal of the American Statistical Association, Vol. 98, No. 461
- Selecting the best system: theory and methods
- Expected opportunity cost guarantees and indifference zone selection procedures
- An indifference-zone selection procedure with minimum switching and sequential sampling
- Comparison with a standard via fully sequential procedures
- A simulation study on sampling and selecting under fixed computing budget
- Feature Article: Optimization for simulation: Theory vs. Practice
  Michael C. Fu,
  1 August 2002 | INFORMS Journal on Computing, Vol. 14, No. 3
- Simulation Optimization: Integrating Research and Practice
  Sigrún Andradóttir,
  1 August 2002 | INFORMS Journal on Computing, Vol. 14, No. 3
- Simulation Optimization in the Future: Evolution or Revolution?
  Michael C. Fu,
  1 August 2002 | INFORMS Journal on Computing, Vol. 14, No. 3
- Output data analysis for simulations
- A Multiplicative Decomposition Property of the Screening-and-Selection Procedures of Nelson et al.
  James R. Wilson,
  1 December 2001 | Operations Research, Vol. 49, No. 6
- A fully sequential procedure for indifference-zone selection in simulation
  1 July 2001 | ACM Transactions on Modeling and Computer Simulation, Vol. 11, No. 3
- Statistical selection of the best system
- Accelerating the convergence of random search methods for discrete stochastic optimization
  1 October 1999 | ACM Transactions on Modeling and Computer Simulation, Vol. 9, No. 4

Volume 49, Issue 6

November-December 2001

Pages 807-969

Article Information

Supplemental Material

Metrics

Information

Received:January 01, 1998
Accepted:July 01, 2000
Published Online:December 01, 2001

Cite as

Barry L. Nelson, Julie Swann, David Goldsman, Wheyming Song, (2001) Simple Procedures for Selecting the Best Simulated System When the Number of Alternatives is Large. Operations Research 49(6):950-963.

https://doi.org/10.1287/opre.49.6.950.10019

Keywords

PDF download

Available Issues

Available Issues

Available Issues

Available Issues

Available Issues

Available Issues

Available Issues

Available Issues

Available Issues

Simple Procedures for Selecting the Best Simulated System When the Number of Alternatives is Large

Supplemental Material

Volume 49, Issue 6

Article Information

Supplemental Material

Metrics

Information

Cite as

Keywords

Sign Up for INFORMS Publications Updates and News