Efficient Ranking and Selection in Parallel Computing Environments

References

• Amazon (2016) Amazon ec2 instance types. Accessed October 2, 2016, https://aws.amazon.com/ec2/instance-types/.Google Scholar
• Andradóttir S (1998) A review of simulation optimization techniques. Medieros DJ, Watson EF, Carson JS, Manivannan MS, eds. Proc. 1998 Winter Simulation Conf. (IEEE, Piscataway, NJ), 151–158.Crossref, Google Scholar
• Bechhofer RE, Santner TJ, Goldsman DM (1995) Design and Analysis of Experiments for Statistical Selection, Screening, and Multiple Comparisons (John Wiley & Sons, New York).Google Scholar
• Boesel J, Nelson BL, Kim S-H (2003) Using ranking and selection to “clean up” after simulation optimization. Oper. Res. 51(5):814–825.Link, Google Scholar
• Branke J, Chick SE, Schmidt C (2007) Selecting a selection procedure. Management Sci. 53(12):1916–1932.Link, Google Scholar
• Bubeck S, Cesa-Bianchi N (2012) Regret analysis of stochastic and nonstochastic multi-armed bandit problems. Foundations and Trends in Machine Learn. 5(1):1–122.Crossref, Google Scholar
• Chen C-H, Chick SE, Lee LH (2015) Ranking and selection: Efficient simulation budget allocation. Fu MC, ed. Handbook of Simulation Optimization, International Series in Operations Research & Management Science, Vol. 216, Chap. 3 (Springer, New York),45–80.Crossref, Google Scholar
• Chen C-H, Lin J, Yücesan E, Chick SE (2000) Simulation budget allocation for further enhancing the efficiency of ordinal optimization. Discrete Event Dynam. Systems 10(3):251–270.Crossref, Google Scholar
• Chen EJ (2005) Using parallel and distributed computing to increase the capability of selection procedures. Kuhl ME, Steiger NM, Armstrong FB, Joines JA, eds. Proc. 2005 Winter Simulation Conf., WSC ’05 (IEEE, Piscataway, NJ), 723–731.Crossref, Google Scholar
• Dean J, Ghemawat S (2008) MapReduce: Simplified data processing on large clusters. Comm. ACM 51(1):107–113.Crossref, Google Scholar
• Fu M (1994) Optimization via simulation: A review. Ann. Oper. Res. 53(1):199–247.Crossref, Google Scholar
• Fu M (2015) Handbook of Simulation Optimization. International Series in Operations Research & Management Science (Springer, New York).Crossref, Google Scholar
• Fu MC (2002) Optimization for simulation: Theory vs. practice. INFORMS J. Comput. 14(3):192–215.Link, Google Scholar
• Fu MC, Glover FW, April J (2005) Simulation optimization: A review, new developments, and applications. Kuhl ME, Steiger NM, Armstrong FB, Joines JA, eds. Proc. 2005 Winter Simulation Conf., WSC ’05 (IEEE, Piscataway, NJ), 83–95.Crossref, Google Scholar
• Glynn PW, Heidelberger P (1990) Bias properties of budget constrained simulations. Oper. Res. 38(5):801–814.Link, Google Scholar
• Glynn PW, Heidelberger P (1991) Analysis of parallel replicated simulations under a completion time constraint. ACM Trans. Modeling Comput. Simulation 1(1):3–23.Crossref, Google Scholar
• Glynn PW, Juneja S (2015) Ordinal optimization—Empirical large deviations rate estimators, and stochastic multi-armed bandits, Preprint arXiv:1507.04564.Google Scholar
• Glynn PW, Whitt W (1992) The asymptotic efficiency of simulation estimators. Oper. Res. 40(3):505–520.Link, Google Scholar
• Heidelberger P (1988) Discrete event simulations and parallel processing: Statistical properties. Siam J. Stat. Comput. 9(6):1114–1132.Crossref, Google Scholar
• Henderson SG, Pasupathy R (2014) Simulation optimization library. http://www.simopt.org.Google Scholar
• Hong LJ (2006) Fully sequential indifference-zone selection procedures with variance-dependent sampling. Naval Res. Logist. 53(5):464–476.Crossref, Google Scholar
• Hong LJ, Nelson BL (2005) The tradeoff between sampling and switching: New sequential procedures for indifference-zone selection. IIE Trans. 37:723–734.Crossref, Google Scholar
• Jamieson K, Nowak R (2014) Best-arm identification algorithms for multi-armed bandits in the fixed confidence setting. Proc. 48th Annual Conf. Inform. Sci. Systems CISS ’14 (IEEE, Piscataway, NJ), 1–6.Crossref, Google Scholar
• Karl AT, Eubank R, Milovanovic J, Reiser M, Young D (2014) Using RngStreams for parallel random number generation in C++ and R. Comput. Statist. 1–20.Google Scholar
• Kim S-H, Nelson BL (2001) A fully sequential procedure for indifference-zone selection in simulation. ACM Trans. Modeling Comput. Simulation 11(3):251–273.Crossref, Google Scholar
• Kim S-H, Nelson BL (2006a) Selecting the best system. Henderson SG, Nelson BL, eds. Simulation, Handbooks in Operations Research and Management Science, Vol. 13 (North-Holland, Amsterdam), 501–534.Crossref, Google Scholar
• Kim S-H, Nelson BL (2006b) On the asymptotic validity of fully sequential selection procedures for steady-state simulation. Oper. Res. 54(3):475–488.Link, Google Scholar
• L’Ecuyer P (2015) Random number generation with multiple streams for sequential and parallel computing. Yilmaz L, Chan WKV, Roeder TMK, Macal C, Rosetti M, eds. Proc. 2015 Winter Simulation Conf. (IEEE, Piscataway NJ), 31–44.Crossref, Google Scholar
• L’Ecuyer P, Simard R, Chen EJ, Kelton WD (2002) An object-oriented random-number package with many long streams and substreams. Oper. Res. 50(6):1073–1075.Link, Google Scholar
• Luo J, Hong LJ (2011) Large-scale ranking and selection using cloud computing. Jain S, Creasey RR, Himmelspach J, White KP, Fu M, eds. Proc. 2011 Winter Simulation Conf., WSC ’11 (ACM, New York), 4051–4061.Crossref, Google Scholar
• Luo J, Hong JL, Nelson BL, Wu Y (2015) Fully sequential procedures for large-scale ranking-and-selection problems in parallel computing environments. Oper. Res. 63(5):1177–1194.Link, Google Scholar
• Luo Y-C, Chen C-H, Yucesan E, Lee I (2000) Distributed web-based simulation optimization. Joines JA, Barton RR, Kang K, Fishwich PA, eds. Proc. 2000 Winter Simulation Conf., WSC ’00 (IEEE, Piscataway, NJ), 1785–1793.Google Scholar
• Mascagni M, Srinivasan A (2000) Algorithm 806: SPRNG: A scalable library for pseudorandom number generation. ACM Trans. Math. Software 26(3):436–461.Crossref, Google Scholar
• Nelson BL, Matejcik FJ (1995) Using common random numbers for indifference-zone selection and multiple comparisons in simulation. Management Sci. 41(12):1935–1945.Link, Google Scholar
• Nelson BL, Swann J, Goldsman D, Song W (2001) Simple procedures for selecting the best simulated system when the number of alternatives is large. Oper. Res. 49(6):950–963.Link, Google Scholar
• Ni EC (2015a) MapRedRnS: Parallel ranking and selection using MapReduce. Accessed October 2, 2016, https://bitbucket.org/ericni/mapredrns.Google Scholar
• Ni EC (2015b) MPIRNS: Parallel ranking and selection using MPI. Accessed October 2, 2016, https://bitbucket.org/ericni/mpirns.Google Scholar
• Ni EC (2015c) SparkRnS: Parallel ranking and selection using Spark. Accessed October 2, 2016, https://bitbucket.org/ericni/sparkrns.Google Scholar
• Ni EC, Henderson SG, Hunter SR (2014) A comparison of two parallel ranking and selection procedures. Tolk A, Diallo SD, Ryzhov IO, Yilmaz L, eds. Proc. 2014 Winter Simulation Conf., WSC ’14 (IEEE, Piscataway, NJ), 3761–3772.Crossref, Google Scholar
• Ni EC, Hunter SR, Henderson SG (2013) Ranking and selection in a high performance computing environment. Pasupathy R, Kim S-H, Tolk A, Hill R, Kuhl ME, eds. Proc. 2013 Winter Simulation Conf., WSC ’13 (IEEE, Piscataway, NJ), 833–845.Crossref, Google Scholar
• Ni EC, Ciocan DF, Henderson SG, Hunter SR (2015) Comparing Message Passing Interface and MapReduce for large-scale parallel ranking and selection. Yilmaz L, Chan WKV, Moon I, Roeder TMK, Macal C, Rossetti MD, eds. Proc. 2015 Winter Simulation Conf., WSC ’15 (IEEE, Piscataway, NJ),3858–3867.Crossref, Google Scholar
• Pasupathy R, Ghosh S (2013) Simulation optimization: A concise overview and implementation guide. Topaloglu H, ed. TutORials Oper. Res. (INFORMS, Hanover, MD), 122–150.Link, Google Scholar
• Pichitlamken J, Nelson BL, Hong LJ (2006) A sequential procedure for neighborhood selection-of-the-best in optimization via simulation. Eur. J. Oper. Res. 173(1):283–298.Crossref, Google Scholar
• Rinott Y (1978) On two-stage selection procedures and related probability-inequalities. Comm. Statist.—Theory and Methods 7(8):799–811.Crossref, Google Scholar
• Texas Advanced Computing Center (2016) What is Wrangler (TACC/IU)? Retrieved April 9, 2016, https://www.tacc.utexas.edu/user-services/user-guides/stampede-user-guide.Google Scholar
• Yoo T, Cho H, Yücesan E (2009) Web services-based parallel replicated discrete event simulation for large-scale simulation optimization. Simulation 85(7):461–475.Crossref, Google Scholar
• Zaharia M, Chowdhury M, Franklin MJ, Shenker S, Stoica I (2010) Spark: Cluster computing with working sets. Proc. 2nd USENIX Conf. Hot Topics in Cloud Comput., HotCloud ’10 (USENIX Association, Berkeley, CA), 10.Google Scholar