State-of-the-Art Review: A User’s Guide to the Brave New World of Designing Simulation Experiments

Published Online:https://doi.org/10.1287/ijoc.1050.0136

References

  • Alam F. M., McNaught K. R., Ringrose T. J. A comparison of experimental designs in the development of a neural network simulation metamodel. Simulation Modelling: Practice Theory (2004) 12:559–578CrossrefGoogle Scholar
  • Alexopoulos C., Goldsman D. To batch or not to batch? ACM Trans. Model. Comput. Simulation (2004) 14:76–114CrossrefGoogle Scholar
  • Angün E., den Hertog D., Gürkan G., Kleijnen J. P. C., Yücesan E., Chen C. H., Snowdon J. L., Charnes J. M. Response surface methodology revisited. Proc. 2002 Winter Simulation Conf. (2002) (Institute of Electrical and Electronics Engineers, Piscataway, NJ) 377–383CrossrefGoogle Scholar
  • Antioniadis A., Pham D. T. Wavelet regression for random or irregular design. Computat. Statist. Data Anal. (1998) 28:353–369CrossrefGoogle Scholar
  • Banks J., Carson J. S., Nelson B. L., Nicol D. M.Discrete-event Simulation (2005) 4th ed.(Prentice-Hall, Upper Saddle River, NJ) Google Scholar
  • Batmaz I., Tunali S. Small response surface designs for metamodel estimation. Eur. J. Oper. Res. (2003) 145:455–470CrossrefGoogle Scholar
  • Bettonvil B., Kleijnen J. P. C. Measurement scales and resolution IV designs. Amer. J. Math. Management Sci. (1990) 10:309–322Google Scholar
  • Bettonvil B., Kleijnen J. P. C. Searching for important factors in simulation models with many factors: Sequential bifurcation. Eur. J. Oper. Res. (1997) 96:180–194CrossrefGoogle Scholar
  • Box G. E. P., Draper R.Empirical Model-Building with Response Surfaces (1987) (Wiley, New York) Google Scholar
  • Box G. E. P., Hunter W. G., Hunter J. S.Statistics for Experimenters: An Introduction to Design, Data Analysis and Model Building (1978) (Wiley, New York) Google Scholar
  • Brandstein A. Operational synthesis: Supporting the maneuver warrior. Phalanx (1999) 32:30–31Google Scholar
  • Cabrera-Rios M., Mount-Campbell C. A., Irani S. A. An approach to the design of a manufacturing cell under economic considerations. Internat. J. Production Econom. (2002) 78:223–237CrossrefGoogle Scholar
  • Campolongo F., Kleijnen J. P. C., Andres T., Saltelli A., Chan K., Scott E. M. Screening methods. Sensitivity Analysis (2000) (Wiley, New York) 65–89Google Scholar
  • Cheng R. C. H., Andradottir S., Healy K. J., Withers D. H., Nelson B. L. Searching for important factors: Sequential bifurcation under uncertainty. Proc. 1997 Winter Simulation Conf. (1997) (Institute of Electrical and Electronics Engineers, Piscataway, NJ) 275–280CrossrefGoogle Scholar
  • Cheng R. C. H., Kleijnen J. P. C. Improved design of simulation experiments with highly heteroskedastic responses. Oper. Res. (1999) 47:762–777LinkGoogle Scholar
  • Chick S. E., Inoue K. New procedures to select the best simulated system usin g common random numbers. Management Sci. (2001) 47:1133–1149LinkGoogle Scholar
  • Cioppa T. M. Efficient nearly orthogonal and space-filling experimental designs for high-dimensional complex models. (2002) . Doctoral dissertation, Operations Research Department, Naval Postgraduate School, Monterey, CA, http://handle.dtic.mil/100.2/ADA406967Google Scholar
  • Cioppa T. M., Lucas T. W., Sanchez S. M., Ingalls R. G., Rossetti M. D., Smith J. S., Peters B. A. Military applications of agent-based models. Proc. 2004 Winter Simulation Conf. (2004) (Institute of Electrical and Electronics Engineers, Piscataway, NJ) 171–180CrossrefGoogle Scholar
  • Cioppa T. M., Lucas T. W. Efficient nearly orthogonal and space-filling Latin hypercubes. (2005) . Working paper, Department of Operations Research, Naval Postgraduate School, Monterey, CAGoogle Scholar
  • Clarke S. M., Griebsch J. H., Simpson T. W. Analysis of support vector regression for approximation of complex engineering analyses. ASME J. Mech. Design (2005) 127CrossrefGoogle Scholar
  • Crary Group (2004) . WebDOE. http://www.webdoe.cc/Google Scholar
  • Cressie N. A. C.Statistics for Spatial Data (1993) Revised ed.(Wiley, New York) CrossrefGoogle Scholar
  • Dean A. M., Lewis S. M.Screening (2004) (Springer-Verlag, New York) Google Scholar
  • Dewar J. A., Bankes S. C., Hodges J. S., Lucas T. W., Saunders-Newton D. K., Vye P. Credible uses of the distributed interactive simulation (DIS) system. (1996) . MR-607-A, RAND Corporation, Santa Monica, CA, http://www.rand.org/publications/MR/MR607.pdfGoogle Scholar
  • Donohue J. M., Houck E. C., Myers R. H. Simulation designs and correlation induction for reducing second-order bias in first-order response surfaces. Oper. Res. (1993) 41:880–902LinkGoogle Scholar
  • Fedorov V. V.Theory of Optimal Experiments (1972) (Academic Press, New York) Google Scholar
  • Fu M. C. Optimization for simulation: Theory vs. practice. INFORMS J. Comput. (2002) 14:192–215LinkGoogle Scholar
  • Gentle J. E.Computational Statistics (2002) (Springer, New York) Google Scholar
  • Gill A., Grieger D. Comparison of agent based distillation movement algorithms. Military Oper. Res. (2003) 8:5–16CrossrefGoogle Scholar
  • Giunta A. A., Watson L. T. A comparison of approximating modeling techniques: Polynomial versus interpolating models. 7th AIAA/USAF/NASA/ISSMO Sympos. Multidisciplinary Anal. Optim. (1998) St. Louis, MO:381–391AIAA 98–4758CrossrefGoogle Scholar
  • Goldsman D., Kim S.-H., Marshall W. S., Nelson B. L. Ranking and selection for steady-state simulation: Procedures and perspectives. INFORMS J. Comput. (2002) 14:2–19LinkGoogle Scholar
  • Hayter A. J. A proof of the conjecture that the Tukey-Kramer multiple comparisons procedure is conservative. Ann. Math. Statist. (1984) 12:61–75CrossrefGoogle Scholar
  • Helton J. C., Marietta M. G. Special issue: 1996 performance assessment for the waste isolation pilot plant. Reliability Engrg. Systems Safety (2000) 69:1–454CrossrefGoogle Scholar
  • Hodges J. S. Six (or so) things you can do with a bad model. Oper. Res. (1991) 39:355–365LinkGoogle Scholar
  • Hodges J. S., Dewar J. A. Is it you or your model talking? A framework for model validation. (1992) . Report R-4114-AF/A/OSD, RAND Corporation, Santa Monica, CAGoogle Scholar
  • Holcomb D., Montgomery D. C., Carlyle W. M. Analysis of supersaturated designs. J. Quality Tech. (2000a) 35:13–27CrossrefGoogle Scholar
  • Holcomb D., Montgomery D. C., Carlyle W. M. Some combinatorial aspects, construction methods, and evaluation criteria for supersaturated designs. Quality Reliability Engrg. Internat. (2000b) 18:299–304CrossrefGoogle Scholar
  • Horne G., Johnson S.Maneuver Warfare Science 2002 (2002) (USMC Project Albert, Quantico, VA) Google Scholar
  • Horne G., Johnson S.Maneuver Warfare Science 2003 (2003) (USMC Project Albert, Quantico, VA) Google Scholar
  • Horne G., Leonardi M.Maneuver Warfare Science 2001 (2001) (Marine Corps Combat Development Command, Defense Automated Printing Service, Quantico, VA) Google Scholar
  • Hsu J. C.Multiple Comparisons; Theory and Methods (1996) (Chapman & Hall, London) CrossrefGoogle Scholar
  • Irizarry M. de los A., Kuhl M. E., Lada E. K., Subramanian S., Wilson J. R. Analyzing transformation-based simulation metamodels. IIE Trans. (2003) 35:271–283CrossrefGoogle Scholar
  • Jacobson S., Buss A., Schruben L. Driving frequency selection for frequency domain simulation experiments. Oper. Res. (1991) 39:917–924LinkGoogle Scholar
  • Jin R., Chen W., Simpson T. Comparative studies of metamodeling techniques under multiple modeling criteria. J. Structural Optim. (2001) 23:1–13CrossrefGoogle Scholar
  • Jin R., Chen W., Sudjianto A. On sequential sampling for global metamodeling in engineering design. Proc. DETC ’02, ASME 2002 Design Engrg. Tech. Conf. Comput. Inform. Engrg. Conf. (2002) Montreal, Canada:1–10DETC2002/DAC-34092CrossrefGoogle Scholar
  • Kelton W. D., Barton R. M., Chick S., Sánchez P. J., Ferrin D., Morrice D. J. Experimental design for simulation. Proc. 2003 Winter Simulation Conf. (2003) (Institute of Electrical and Electronics Engineers, Piscataway, NJ) 59–65CrossrefGoogle Scholar
  • Khuri A. I., Ghosh S., Rao C. R. Multiresponse surface methodology. Handbook of Statistics (1996) 13(Elsevier, Amsterdam, The Netherlands) CrossrefGoogle Scholar
  • Kiefer J. Optimal experimental designs (with comments). J. Roy. Statist. Soc. Ser. B (1959) 21:272–319Google Scholar
  • Kleijnen J. P. C.Statistical Techniques in Simulation (1974–1975) I, II(Marcel Dekker, Inc., New York) Google Scholar
  • Kleijnen J. P. C.Statistical Tools for Simulation Practitioners (1987) (Marcel Dekker, Inc., New York) Google Scholar
  • Kleijnen J. P. C. Case study: Statistical validation of simulation models. Eur. J. Oper. Res. (1995) 87:21–34CrossrefGoogle Scholar
  • Kleijnen J. P. C., Banks J. Design for sensitivity analysis, optimization, and validation of simulation models. Handbook of Simulation: Principles, Methodology, Advances, Applications, and Practice (1998) (Wiley, New York) 173–223CrossrefGoogle Scholar
  • Kleijnen J. P. C. An overview of the design and analysis of simulation experiments for sensitivity analysis. Eur. J. Oper. Res. (2005) 164:287–300CrossrefGoogle Scholar
  • Kleijnen J. P. C., Gaury E. Short-term robustness of production management systems: A case study. Eur. J. Oper. Res. (2003) 148:452–465CrossrefGoogle Scholar
  • Kleijnen J. P. C., Pala O. Maximizing the simulation output: A competition. Simulation (1999) 73:168–173CrossrefGoogle Scholar
  • Kleijnen J. P. C., Sargent R. G. A methodology for the fitting and validation of metamodels in simulation. Eur. J. Oper. Res. (2000) 120:14–29CrossrefGoogle Scholar
  • Kleijnen J. P. C., Smits M. T. Performance metrics in supply chain management. J. Oper. Res. Soc. (2003) 54:507–514CrossrefGoogle Scholar
  • Kleijnen J. P. C., van Groenendaal W.Simulation: A Statistical Perspective (1992) (Wiley, Chichester, UK) Google Scholar
  • Kleijnen J. P. C., van Beers W. C. M. Application-driven sequential designs for simulation experiments: Kriging metamodeling. J. Oper. Res. Soc. (2004) 55:876–883CrossrefGoogle Scholar
  • Kleijnen J. P. C., van Beers W. C. M. Robustness of Kriging when interpolating in random simulation with heterogeneous variances: Some experiments. Eur. J. Oper. Res. (2005) 165:826–834CrossrefGoogle Scholar
  • Kleijnen J. P. C., Bettonvil B., Persson F. Robust solutions for supply chain management: Simulation and risk analysis of the Ericsson case study. (2003) . Working paper, Tilburg University, Tilburg, The NetherlandsGoogle Scholar
  • Kleijnen J. P. C., Bettonvil B., Persson F., Dean A. M., Lewis S. M. Finding the important factors in large discrete-event simulation: Sequential bifurcation and its applications. Screening (2005) (Springer-Verlag, New York) Google Scholar
  • Kleijnen J. P. C., Cheng R. C. H., Melas V. B. Optimal design of experiments with simulation models of nearly saturated queues. J. Statist. Planning Inference (2000) 85:19–26CrossrefGoogle Scholar
  • Kleijnen J. P. C., Feelders A. J., Cheng R. C. H., Medeiros D. J., Watson E. F., Carson J. S., Manivannan M. S. Bootstrapping and validation of metamodels in simulation. Proc. 1998 Winter Simulation Conf. (1998) (Institute of Electrical and Electronics Engineers, Piscataway, NJ) 701–706CrossrefGoogle Scholar
  • Kleijnen J. P. C., van den Burg A. J., van der Ham R. T. H. Generalization of simulation results: Practicality of statistic al methods. Eur. J. Oper. Res. (1979) 3:50–64CrossrefGoogle Scholar
  • Kleijnen J. P. C., Vonk Noordegraaf A., Nielen M., Peters B. A., Smith J. S., Medeiros D. J., Rohrer M. W. Sensitivity analysis of censored output through polynomial, logistic and tobit models: Theory and case study. Proc. 2001 Winter Simulation Conf. (2001) (Institute of Electrical and Electronics Engineers, Piscataway, NJ) 486–491CrossrefGoogle Scholar
  • Koehler J. R., Owen A. B., Ghosh S., Rao C. R.Handbook of Statistics (1996) 13(Computer experiments, Amsterdam, The Netherlands) 261–308Google Scholar
  • Kutner M. H., Nachtsheim C. J., Neter J., Li W.Applied Linear Statistical Models (2004) 5th ed.(McGraw-Hill/Irwin, Boston, MA) Google Scholar
  • Lauren M. K., Stephen R. T. Map-aware non-uniform automata—A New Zealand approach to scenario modelling. J. Battlefield Tech. (2002) 5:27–31Google Scholar
  • Law A. M., Kelton W. D.Simulation Modeling and Analysis (2000) 3rd ed.(McGraw-Hill, New York) Google Scholar
  • Lin D. K. J. Generating systematic supersaturated designs. Technometrics (1995) 37:213–225CrossrefGoogle Scholar
  • Lophaven S. N., Nielsen H. B., Sondergaard J. (2002) . DACE: A Matlab Kriging toolbox, version 2.0.IMM Technical University of Denmark, Lyngby, Denmark, http://www.imm.dtu.dk/~hbn/dace/Google Scholar
  • Lucas T. W., Bankes S. C., Vye P. Improving the analytic contribution of advanced warfighting experiments (AWEs). (1997) . Documented Briefing DB-207-A. RAND Corporation, Santa Monica, CAGoogle Scholar
  • Lucas T. W., Sanchez S. M., Brown L., Vinyard W., Horne G., Johnson S. Better designs for high-dimensional explorations of distillations. Maneuver Warfare Science 2002 (2002) (USMC Project Albert, Quantico, VA) 17–46Google Scholar
  • Lucas T. W., Sanchez S. M., Cioppa T. M., Ipekci A. I., Horne G., Johnson S. Generating hypotheses on fighting the global war on terrorism. Maneuver Warfare Science 2003 (2003) (USMC Project Albert, Quantico, VA) 117–137Google Scholar
  • Martinez W. L., Martinez A. R.Computational Statistics Handbook with MATLAB (2002) (Chapman & Hall/CRC, Boca Raton, FL) Google Scholar
  • McKay M. D., Beckman R. J., Conover W. J. A comparison of three methods for selecting values of input variables in the analysis of output from a computer code. Technometrics (1979) 21:239–245Google Scholar
  • Moeeni F., Sanchez S. M., Vakharia A. J. A robust design methodology for Kanban system design. Internat. J. Production Res. (1997) 35:2821–2838CrossrefGoogle Scholar
  • Montgomery D. C.Design and Analysis of Experiments (2000) 5th ed.(Wiley, New York) Google Scholar
  • Morrice D. J., Bardhan I. R. A weighted least squares approach to computer simulation factor screening. Oper. Res. (1995) 43:792–806LinkGoogle Scholar
  • Morris M. D., Mitchell T. J. Exploratory designs for computational experiments. J. Statist. Planning Inference (1995) 43:381–402CrossrefGoogle Scholar
  • Meyer T., Johnson S., Horne G., Leonardi M. Visualization for data farming: A survey of methods. Maneuver Warfare Science 2001 (2001) (Marine Corps Combat Development Command, Quantico, VA) 15–30Google Scholar
  • Myers R. H., Montgomery D. C.Response Surface Methodology: Process and Product Optimization using Designed Experiments (2002) 2nd ed.(Wiley, New York) Google Scholar
  • Myers R. H., Khuri A. I., Vining G. Response surface alternatives to the Taguchi robust design parameter approach. Amer. Statist. (1992) 46:131–139CrossrefGoogle Scholar
  • Nakayama M., Chick S., Sánchez P. J., Ferrin D., Morrice D. J. Analysis of simulation output. Proc. 2003 Winter Simulation Conf. (2003) (Institute of Electrical and Electronics Engineers, Piscataway, NJ) 49–58CrossrefGoogle Scholar
  • Nelson B. L., Goldsman D. Comparisons with a standard in simulation experiments. Management Sci. (2001) 47:449–463LinkGoogle Scholar
  • Pacheco J., Amon C., Finger S. Incorporating Information from Replications into Bayesian Surrogate Models. 2003 ASME Design Engrg. Tech. Conf. (2003) Chicago, ILDETC2003/DTM-48644CrossrefGoogle Scholar
  • Pukelsheim F.Optimal Design of Experiments (1993) (Wiley, New York) Google Scholar
  • Ramberg J. S., Sanchez S. M., Sanchez P. J., Hollick L. J., Nelson B. L., Kelton W. D., Clark G. M. Designing simulation experiments: Taguchi methods and response surface metamodels. Proc. 1991 Winter Simulation Conf. (1991) (Institute of Electrical and Electronics Engineers, Piscataway, NJ) 167–176CrossrefGoogle Scholar
  • Rao C. R. Least squares theory using an estimated dispersion matrix and its application to measurement of signals. Proc. 5th Berkeley Sympos. Math. Statist. Probab. (1967) I(University of California Press, Berkeley, CA) 355–372Google Scholar
  • Rechtschaffner R. L. Saturated fractions of 2n and 3n factorial designs. Technometrics (1967) 9:569–575Google Scholar
  • Sacks J., Welch W. J., Mitchell T. J., Wynn H. P. Design and analysis of computer experiments (includes Comments and Rejoinder). Statist. Sci. (1989) 4:409–435CrossrefGoogle Scholar
  • Saltelli A., Tarantola S., Chan P. S. A quantitative model-independent method for global sensitivity analysis of model output. Technometrics (1999) 41:39–56CrossrefGoogle Scholar
  • Sanchez P. J., Buss A. H., Thesen A., Grant H., Kelton W. D. A model for frequency domain experiments. Proc. 1987 Winter Simulation Conf. (1987) (Institute of Electrical and Electronics Engineers, Piscataway, NJ) 424–427CrossrefGoogle Scholar
  • Sanchez S. M., Joines J. A., Barton R. R., Kang K., Fishwick P. A. Robust design: Seeking the best of all possible worlds. Proc. 2000 Winter Simulation Conf. (2000) (Institute of Electrical and Electronics Engineers, Piscataway, NJ) 69–76CrossrefGoogle Scholar
  • Sanchez S. M., Lucas T. W., Yücesan E., Chen C.-H., Snowdon J. L., Charnes J. Exploring the world of agent-based simulations: Simple models, complex analyses. Proc. 2002 Winter Simulation Conf. (2002) (Institute of Electrical and Electronics Engineers, Piscataway, NJ) 116–126CrossrefGoogle Scholar
  • Sanchez S. M., Wu H.-F., Chick S., Sánchez P. J., Ferrin D., Morrice D. J. Frequency-based designs for terminating simulations: A peace-enforcement application. Proc. 2003 Winter Simulation Conf. (2003) (Institute of Electrical and Electronics Engineers, Piscataway, NJ) 952–959CrossrefGoogle Scholar
  • Sanchez S. M., Sanchez P. J., Ramberg J. S., Wang B. A simulation framework for robust system design. Concurrent Design of Products, Manufacturing Processes and Systems (1998) (Gordon and Breach, New York) 279–314Google Scholar
  • Sanchez S. M., Smith L. D., Lawrence E. C. Tolerance design revisited: Assessing the impact of correlated noise factors. (2005) . Working paper, Operations Research Department, Naval Postgraduate School, Monterey, CAGoogle Scholar
  • Sanchez S. M., Sanchez P. J., Ramberg J. S., Moeeni F. Effective engineering design through simulation. Internat. Trans. Oper. Res. (1996) 3:169–185CrossrefGoogle Scholar
  • Santner T. J., Williams B. J., Notz W. I.The Design and Analysis of Computer Experiments (2003) (Springer-Verlag, New York) CrossrefGoogle Scholar
  • SAS Institute, Inc.JMP IN® Version 5.1 for Windows, Macintosh, and Unix (2004) (Duxbury Thompson Learning, Pacific Grove, CA) Google Scholar
  • Sasena M. J., Papalambros P. Y., Goovaerts P. Exploration of metamodeling sampling criteria for constrained global optimization. Engrg. Optim. (2002) 34:263–278CrossrefGoogle Scholar
  • Schmeiser B. W. Batch size effects in the analysis of simulation output. Oper. Res. (1982) 30:556–568LinkGoogle Scholar
  • Schruben L. W., Cogliano V. J. An experimental procedure for simulation response surface model identification. Comm. ACM (1987) 30:716–730CrossrefGoogle Scholar
  • Shoemaker A. C., Tsui K.-L., Wu C. F. J. Economical experimentation methods for robust design. Technometrics (1991) 33:415–427CrossrefGoogle Scholar
  • Simon H. A.The Sciences of the Artificial (1981) 2nd ed.(MIT Press, Cambridge, MA) Google Scholar
  • Simpson T. W., Lin D. K. J., Chen W. Sampling strategies for computer experiments: Design and analysis. Internat. J. Reliability Appl. (2001) 2:209–240Google Scholar
  • Smith L. D., Sanchez S. M. Assessment of business potential at retail sites: Empirical findings from a U. S. supermarket chain. Internat. Rev. Retail, Distribution Consumer Res. (2003) 13:37–58CrossrefGoogle Scholar
  • Spall J. C.Introduction to Stochastic Search and Optimization; Estimation, Simulation, and Control (2003) (Wiley, New York) CrossrefGoogle Scholar
  • Steiger N. M., Lada E. K., Wilson J. R., Joines J. A., Alexopoulos C., Goldsman D. ASAP3: A batch means procedure for steady-state simulation output analysis. ACM Trans. Model. Comput. Simulation (2005) 15:39–73CrossrefGoogle Scholar
  • Sugiyama S. O., Chow J. W. @Risk, riskview and bestFit. OR/MS Today (1997) 24:64–66Google Scholar
  • Taguchi G.System of Experimental Designs (1987) 1, 2(UNIPUB/Krauss International, White Plains, NY) Google Scholar
  • Trocine L., Malone L. C., Peters B. A., Smith J. S., Medeiros D. J., Rohrer M. W. An overview of newer, advanced screening methods for the initial phase in an experimental design. Proc. 2001 Winter Simulation Conf. (2001) (Institute of Electrical and Electronics Engineers, Piscataway, NJ) 169–178CrossrefGoogle Scholar
  • Tufte E. R.Envisioning Information (1990) (Graphics Press, Cheshire, CT) Google Scholar
  • Tunali S., Batmaz I. Dealing with the least squares regression assumptions in simulation metamodeling. Comput. Indust. Engrg. (2000) 38:307–320CrossrefGoogle Scholar
  • van Beers W. C. M., Kleijnen J. P. C. Kriging for interpolation in random simulation. J. Oper. Res. Soc. (2003) 54:255–262CrossrefGoogle Scholar
  • van Beers W. C. M., Kleijnen J. P. C., Ingalls R. G., Rossetti M. D., Smith J. S., Peters B. A. Kriging interpolation in simulation: A survey. Proc. 2004 Winter Simulation Conf. (2004) (Institute of Electrical and Electronics Engineers, Piscataway, NJ) 113–121CrossrefGoogle Scholar
  • Vinyard W., Lucas T. W. Exploring combat models for non-monotonicities and remedies. PHALANX (2002) 35:19–38Google Scholar
  • Vonk Noordegraaf A., Nielen M., Kleijnen J. P. C. Sensitivity analysis by experimental design and metamodelling: Case study on simulation in national animal disease control. Eur. J. Oper. Res. (2003) 146:433–443CrossrefGoogle Scholar
  • Wan H., Ankenman B., Nelson B. L., Chick S., Sánchez P. J., Ferrin D., Morrice D. J. Controlled sequential bifurcation: A new factor-screening method for discrete-event simulation. Proc. 2003 Winter Simulation Conf. (2003) (Institute of Electrical and Electronics Engineers, Piscataway, NJ) 565–573Google Scholar
  • Wan S. C. An exploratory analysis on the effects of human factors on combat outcomes. (2002) . M. S. thesis, Operations Research Department, Naval Postgraduate School, Monterey, CA, http://handle.dtic.mil/100.2/ADA403526Google Scholar
  • Watson A. G., Barnes R. J. Infill sampling criteria to locate extremes. Math. Geology (1995) 27:589–608CrossrefGoogle Scholar
  • Wegman E. M. Hyperdimensional data analysis using parallel coordinates. J. Amer. Statist. Association (1990) 85:664–674CrossrefGoogle Scholar
  • Wolf E. S. Using agent-based distillations to explore logistics support to urban, humanitarian assistance/disaster relief operations. (2003) . M.S. thesis, Operations Research Department, Naval Postgraduate School, Monterey, CAGoogle Scholar
  • Wolf E. S., Sanchez S. M., Goerger N., Brown L. Using agents to model logistics. (2003) . Working paper, Operations Research Department, Naval Postgraduate School, Monterey, CAGoogle Scholar
  • Ye K. Q. Orthogonal column Latin hypercubes and their application in computer experiments. J. Amer. Statist. Association (1998) 93:1430–1439 http://handle.dtic.mil/100.2/ADA418300CrossrefGoogle Scholar
  • Zeigler B. P., Praehofer K., Kim T. G.Theory of Modeling and Simulation (2000) 2nd ed.(Academic Press, San Diego, CA) Google Scholar
INFORMS site uses cookies to store information on your computer. Some are essential to make our site work; Others help us improve the user experience. By using this site, you consent to the placement of these cookies. Please read our Privacy Statement to learn more.