Designing a Framework for Solving Multiobjective Simulation Optimization Problems
References
- Abraham A, Jain L, Goldberg R, eds. (2005) Evolutionary Multiobjective Optimization: Theoretical Advances and Applications, Advanced Information and Knowledge Processing Series (Springer Verlag, London).Crossref, Google Scholar
- (2021) Thinking inside the box: A tutorial on grey-box Bayesian optimization. Proc. 2021 Winter Simulation Conf. (WSC 2021) (IEEE, Piscataway, NJ), 1–15.Google Scholar
- (2009) A progressive barrier for derivative-free nonlinear programming. SIAM J. Optim. 20(1):445–472.Crossref, Google Scholar
- (2017) Derivative-Free and Blackbox Optimization, Springer Series in Operations Research and Financial Engineering (Springer International, Cham, Switzerland).Crossref, Google Scholar
- (2023) A general mathematical framework for constrained mixed-variable blackbox optimization problems with meta and categorical variables. Oper. Res. Forum 4:12.Crossref, Google Scholar
- (2010) A mesh adaptive direct search algorithm for multiobjective optimization. Eur. J. Oper. Res. 204(3):545–556.Crossref, Google Scholar
- (2022) Algorithm 1027: NOMAD version 4: Nonlinear optimization with the MADS algorithm. ACM Trans. Math. Software 48(3):1–22.Crossref, Google Scholar
- (2021) Performance indicators in multiobjective optimization. Eur. J. Oper. Res. 292(2):397–422.Crossref, Google Scholar
- (2020) BoTorch: A framework for efficient Monte-Carlo Bayesian optimization. Larochelle H, Ranzato M, Hadsell R, Balcan M, Lin H, eds. NIPS’20: Proc. 34th Internat. Conf. Neural Inform. Processing Systems, vol. 33 (Curran Associates, Inc., Red Hook, NY), 21524–21538.Google Scholar
- (2008) A simulated annealing-based multiobjective optimization algorithm: AMOSA. IEEE Trans. Evolutionary Comput. 12(3):269–283.Crossref, Google Scholar
- (2019) jMetalPy: A Python framework for multi-objective optimization with metaheuristics. Swarm Evolutionary Comput. 51:100598.Crossref, Google Scholar
- (2021) Derivative-free multiobjective trust region descent method using radial basis function surrogate models. Math. Comput. Appl. 26(2):31.Google Scholar
- (2020) DMulti-MADS: Mesh adaptive direct multisearch for blackbox multiobjective optimization. Comput. Optim. Appl. 79(2):301–338.Crossref, Google Scholar
- (2020) A parallel global multiobjective framework for optimization: Pagmo. J. Open Source Software 5(53):2338.Crossref, Google Scholar
- (2020) Pymoo: Multi-objective optimization in Python. IEEE Access 8:89497–89509.Crossref, Google Scholar
- (2020) Optimization and supervised machine learning methods for fitting numerical physics models without derivatives. J. Phys. G Nuclear Particle Phys. 48(2):024001.Crossref, Google Scholar
- (2019) A Python surrogate modeling framework with derivatives. Adv. Engrg. Software 135:102662.Crossref, Google Scholar
- (2018) Efficient multiobjective optimization employing Gaussian processes, spectral sampling and a genetic algorithm. J. Global Optim. 71(2):407–438.Crossref, Google Scholar
- (2013) Approximation quality of the hypervolume indicator. Artificial Intelligence 195:265–290.Crossref, Google Scholar
- (2018) A multi-objective DIRECT algorithm for ship hull optimization. Comput. Optim. Appl. 71(1):53–72.Crossref, Google Scholar
- (2023) ParMOO: A Python library for parallel multiobjective simulation optimization. J. Open Source Software 8(82):4468.Crossref, Google Scholar
- (2025) Designing a framework for solving multiobjective simulation optimization problems. http://dx.doi.org/10.1287/ijoc.2023.0250.cd, https://github.com/INFORMSJoC/2023.0250.Google Scholar
- (2020a) Multiobjective optimization of the variability of the high-performance LINPACK solver. Proc. 2020 Winter Simulation Conf. (WSC 2020) (IEEE, Piscataway, NJ), 3081–3092.Google Scholar
- (2023b) ParMOO: Python library for parallel multiobjective simulation optimization. Technical Report Version 0.3.1, Argonne National Laboratory, Lemont, IL, https://parmoo.readthedocs.io/en/latest.Google Scholar
- (2020b) Managing computationally expensive blackbox multiobjective optimization problems using libEnsemble. SpringSim 2020: Proc. 2020 Spring Simulation Conf. (Society for Computer Simulation International, San Diego, CA), 1–12.Google Scholar
- (2023a) A framework for fully autonomous design of materials via multiobjective optimization and active learning: Challenges and next steps. 11th Internat. Conf. Learning Representation (ICLR 2023), Workshop on Machine Learning for Materials (ML4Materials) (OpenReview.net), 1–10.Google Scholar
- (2022) Algorithm 1028: VTMOP: Solver for blackbox multiobjective optimization problems. ACM Trans. Math. Software 48(3):1–34.Crossref, Google Scholar
- (2020) funcX: A federated function serving fabric for science. Proc. 29th Internat. Sympos. High-Performance Parallel Distributed Comput. (HPDC ‘20) (Association for Computing Machinery, New York), 65–76.Google Scholar
- (2023) An integrated multi-physics optimization framework for particle accelerator design. Preprint, submitted October 18, https://arxiv.org/abs/2311.09415.Google Scholar
- (2009) A Course in Approximation Theory, Graduate Studies in Mathematics, vol. 101 (American Mathematical Society, Providence, RI).Crossref, Google Scholar
- (2015) Keras. Accessed October 2022, https://keras.io.Google Scholar
- (2020) An augmented Lagrangian algorithm for multi-objective optimization. Comput. Optim. Appl. 77(1):29–56.Crossref, Google Scholar
- (2018) An implicit filtering algorithm for derivative-free multiobjective optimization with box constraints. Comput. Optim. Appl. 69(2):267–296.Crossref, Google Scholar
- (2008) Geometry of interpolation sets in derivative free optimization. Math. Programming 111:141–172.Crossref, Google Scholar
- (2009) Introduction to Derivative-Free Optimization, MPS-SIAM Series on Optimization (SIAM, Philadelphia).Crossref, Google Scholar
- (2020) PyMOSO: Software for multi-objective simulation optimization with R-PERLE and R-MinRLE. INFORMS J. Comput. 32(4):1101–1108.Abstract, Google Scholar
- (2018) MultiGLODS: Global and local multiobjective optimization using direct search. J. Global Optim. 72(2):323–345.Crossref, Google Scholar
- (2011) Direct multisearch for multiobjective optimization. SIAM J. Optim. 21(3):1109–1140.Crossref, Google Scholar
- (2016) Quadratic scalarization for decomposed multiobjective optimization. Oper. Res. Spectrum 38(4):1071–1096.Crossref, Google Scholar
- (1998) Normal-boundary intersection: A new method for generating the Pareto surface in nonlinear multicriteria optimization problems. SIAM J. Optim. 8(3):631–657.Crossref, Google Scholar
- (2020) Differentiable expected hypervolume improvement for parallel multi-objective Bayesian optimization. Larochelle H, Ranzato M, Hadsell R, Balcan M, Lin H, eds. NIPS’20: Proc. 34th Internat. Conf. Neural Inform. Processing Systems, vol. 33 (Curran Associates, Inc., Red Hook, NY), 9851–9864.Google Scholar
- (2013) An evolutionary many-objective optimization algorithm using reference-point-based nondominated sorting approach, part I: Solving problems with box constraints. IEEE Trans. Evolutionary Comput. 18(4):577–601.Crossref, Google Scholar
- (2002a) A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Trans. Evolutionary Comput. 6(2):182–197.Crossref, Google Scholar
- (2002b) Scalable multi-objective optimization test problems. Proc. 2002 IEEE Congress Evolutionary Comput. (CEC ‘02), vol. 1 (IEEE, Piscataway, NJ), 825–830.Google Scholar
- (2016) Multiobjective optimization using an adaptive weighting scheme. Optim. Methods Software 31(1):110–133.Crossref, Google Scholar
- (2017) JuMP: A modeling language for mathematical optimization. SIAM Rev. 59(2):295–320.Crossref, Google Scholar
- (2011) jMetal: A Java framework for multi-objective optimization. Adv. Engrg. Software 42(10):760–771.Crossref, Google Scholar
- (2005) Multicriteria Optimization, Lecture Notes in Economics and Mathematical Systems Series, 2nd ed. (Springer Verlag, Heidelberg, Germany).Google Scholar
- (2009) Scalarizations for adaptively solving multi-objective optimization problems. Comput. Optim. Appl. 44(2):249–273.Crossref, Google Scholar
- (2020) The manufacturing data and machine learning platform: Enabling real-time monitoring and control of scientific experiments via IoT. 2020 IEEE 6th World Forum Internet Things (WF-IoT) (IEEE, Piscataway, NJ), 1–2.Google Scholar
- (2016) A multicriteria generalization of Bayesian global optimization. Pardalos PM, Zhigljavsky A, Žilinskas J, eds. Advances in Stochastic and Deterministic Global Optimization, Springer Optimization and Its Applications, vol. 107 (Springer, Cham, Switzerland), 229–242.Crossref, Google Scholar
- (2019) Scalable global optimization via local Bayesian optimization. Proc. 33rd Internat. Conf. Neural Inform. Processing Systems (Curran Associates, Inc., Red Hook, NY), 5496–5507.Google Scholar
- (2018) SCORE allocations for bi-objective ranking and selection. ACM Trans. Modeling Comput. Simulation 28(1):1–28.Crossref, Google Scholar
- (2016) A Bayesian approach to constrained single- and multi-objective optimization. J. Global Optim. 67(1–2):97–133.Crossref, Google Scholar
- (2012) DEAP: Evolutionary algorithms made easy. J. Machine Learning Res. 13(1):2171–2175.Google Scholar
- (1995) Design Patterns: Elements of Reusable Object-Oriented Software (Addison-Wesley, Reading, MA).Google Scholar
- (2023) Bayesian Optimization (Cambridge University Press, Cambridge, UK).Crossref, Google Scholar
- (2017) Smart sampling algorithm for surrogate model development. Comput. Chemical Engrg. 96:103–114.Crossref, Google Scholar
- (2015) Platypus - Multiobjective optimization in Python. Technical Report Version 1.0.4, https://platypus.readthedocs.io/en/latest.Google Scholar
- (2017) Pyomo – Optimization Modeling in Python, Springer Optimization and Its Applications, vol. 67 (Springer, Cham, Switzerland).Crossref, Google Scholar
- (2022) A practical guide to multi-objective reinforcement learning and planning. Autonomous Agent Multi-Agent Systems 36(1):1–59.Google Scholar
- (2020) Advancing scientific productivity through better scientific software: Developer productivity and software sustainability report. Technical Report ORNL TM-2020 1459/ECP-U-RPT-2020-0001, Oak Ridge National Laboratory, Oak Ridge, TN.Google Scholar
- (2022) libEnsemble: A library to coordinate the concurrent evaluation of dynamic ensembles of calculations. IEEE Trans. Parallel Distribution Systems 33(4):977–988.Crossref, Google Scholar
- (2023) libEnsemble: A complete Python toolkit for dynamic ensembles of calculations. J. Open Source Software 8(92):6031.Crossref, Google Scholar
- (2019) An introduction to multiobjective simulation optimization. ACM Trans. Modeling Comput. Simulation 29(1):1–36.Crossref, Google Scholar
- (2013) An evolutionary many-objective optimization algorithm using reference-point based nondominated sorting approach, part II: Handling constraints and extending to an adaptive approach. IEEE Trans. Evolutionary Comput. 18(4):602–622.Crossref, Google Scholar
- (2020) Tuning hyperparameters without grad students: Scalable and robust Bayesian optimisation with Dragonfly. J. Machine Learning Res. 21(81):1–27.Google Scholar
- (2023) Multi-objective hyperparameter optimization in machine learning—An overview. IEEE Trans. Evolutionary Comput. 3(4):1–50.Google Scholar
- (2021) Physics-informed machine learning. Nature Rev. Phys. 3(6):422–440.Crossref, Google Scholar
- (2018) Manifold sampling for optimization of nonconvex functions that are piecewise linear compositions of smooth components. SIAM J. Optim. 28(4):3001–3024.Crossref, Google Scholar
- (2006) ParEGO: A hybrid algorithm with on-line landscape approximation for expensive multiobjective optimization problems. IEEE Trans. Evolutionary Comput. 8(5):1341–1366.Google Scholar
- (2011) Service oriented computing environment (SORCER) for large scale, distributed, dynamic fidelity aeroelastic analysis. Internat. Forum Aeroelasticity Structural Dynamics (IFASD 2011), Optim. (Citeseer), 26–30.Google Scholar
- (2024) Structure-aware methods for expensive derivative-free nonsmooth composite optimization. Math. Programming Comput. 16:1–36.Crossref, Google Scholar
- (2018) Asynchronously parallel optimization solver for finding multiple minima. Math. Programming Comput. 10:303–332.Crossref, Google Scholar
- (2019) Derivative-free optimization methods. Acta Numerica 28:287–404.Crossref, Google Scholar
- (2006) An efficient, adaptive parameter variation scheme for metaheuristics based on the epsilon-constraint method. Eur. J. Oper. Res. 169(3):932–942.Crossref, Google Scholar
- (2011) Algorithm 909: NOMAD: Nonlinear optimization with the MADS algorithm. ACM Trans. Math. Software 37(4):1–15.Crossref, Google Scholar
- (2024) A taxonomy of constraints in black-box simulation-based optimization. Optim. Engrg. 25:1125–1143.Crossref, Google Scholar
- (2002) A globally convergent augmented Lagrangian pattern search algorithm for optimization with general constraints and simple bounds. SIAM J. Optim. 12(4):1075–1089.Crossref, Google Scholar
- Liuzzi G (2024) The Derivative-free library (DFL) at DIAG. https://github.com/DerivativeFreeLibrary.Google Scholar
- (2016) A derivative-free approach to constrained multiobjective nonsmooth optimization. SIAM J. Optim. 26(4):2744–2774.Crossref, Google Scholar
- (2014) Approachability in unknown games: Online learning meets multi-objective optimization. Proc. 27th Conf. Learn. Theory (PMLR), (Barcelona, Spain), vol. 35, 339–355.Google Scholar
- (2004) Survey of multi-objective optimization methods for engineering. Structural Multidisciplinary Optim. 26(6):369–395.Crossref, Google Scholar
- (2018) Mordred: A molecular descriptor calculator. J. Cheminformatics 10:4.Crossref, Google Scholar
- (2017) SOCEMO: Surrogate optimization of computationally expensive multiobjective problems. INFORMS J. Comput. 29(4):581–596.Link, Google Scholar
- (2016) Response Surface Methodology: Process and Design Optimization Using Designed Experiments. 4th ed. (John Wiley & Sons, Inc., Hoboken, NJ).Google Scholar
- (2023) Comparison of multiobjective optimization methods for the LCLS-II photoinjector. Comput. Phys. Comm. 283:108566.Crossref, Google Scholar
- (2020) Bayesian multi-objective hyperparameter optimization for accurate, fast, and efficient neural network accelerator design. Frontiers Neurosci. 14:667.Crossref, Google Scholar
- (2019) PyTorch: An imperative style, high-performance deep learning library. Wallach H, Larochelle H, Beygelzimer A, d’Alché-Buc F, Fox E, Garnett R, eds. Proc. 33rd Internat. Conf. Neural Inform. Processing Systems (Curran Associates, Inc., Red Hook, NY), 8026–8037.Google Scholar
- (2011) Scikit-learn: Machine learning in Python. J. Machine Learning Res. 12:2825–2830.Google Scholar
- (2022) Discovering and forecasting extreme events via active learning in neural operators. Nature Comput. Sci. 2(12):823–833.Crossref, Google Scholar
- (2017) Global deterministic and stochastic optimization in a service oriented architecture. HPC’17: Proc. 25th High Performance Comput. Sympos. (Society for Computer Simulation International, San Diego, CA), 7.Google Scholar
- (2021) PDFO: Cross-platform interfaces for Powell’s derivative-free optimization solvers. https://github.com/pdfo/pdfo.Google Scholar
- (2023) Quasi-Monte Carlo methods in Python. J. Open Source Software 8(84):5309.Crossref, Google Scholar
- (2014) A derivative-free trust-region method for biobjective optimization. SIAM J. Optim. 24(1):334–362.Crossref, Google Scholar
- (2022) Optimal criteria and their asymptotic form for data selection in data-driven reduced-order modelling with Gaussian process regression. Philos. Trans. A Math. Phys. Engrg. Sci. 380(2229):20210197.Google Scholar
- Saves P, Lafage R, Bartoli N, Diouane Y, Bussemaker J, Lefebvre T, Hwang JT, Morlier J, Martins JRRA (2024) SMT 2.0: A Surrogate Modeling Toolbox with a focus on hierarchical and mixed variables Gaussian processes. Adv. Eng. Softw. 188(C).Google Scholar
- (2018) Machine learning meets continuous flow chemistry: Automated optimization towards the Pareto front of multiple objectives. Chemical Engrg. J. 352:277–282.Crossref, Google Scholar
- (2020) A survey on the hypervolume indicator in evolutionary multiobjective optimization. IEEE Trans. Evolutionary Comput. 25(1):1–20.Crossref, Google Scholar
- (2021) Bayesian reaction optimization as a tool for chemical synthesis. Nature 590(7844):89–96.Crossref, Google Scholar
- (2015) Multidisciplinary Design Optimization Supported by Knowledge Based Engineering (John Wiley & Sons, Ltd., Chichester, UK).Crossref, Google Scholar
- (1983) An interactive weighted Tchebycheff procedure for multiple objective programming. Math. Programming 26:326–344.Crossref, Google Scholar
- (2022) Parallel strategies for direct multisearch. Numer. Algorithms 92(3):1757–1788.Crossref, Google Scholar
- (2019) A trust-region algorithm for heterogeneous multiobjective optimization. SIAM J. Optim. 29(2):1017–1047.Crossref, Google Scholar
- (2017) PlatEMO: A MATLAB platform for evolutionary multi-objective optimization [educational forum]. IEEE Comput. Intelligence Magazine 12(4):73–87.Crossref, Google Scholar
- (2020) SciPy 1.0: Fundamental algorithms for scientific computing in Python. Nature Methods 17(3):261–272.Crossref, Google Scholar
- (1999) Reference point approaches. Gal T, Stewart TJ, Hanne T, eds. Multicriteria Decision Making: Advances in MCDM Models, Algorithms, Theory, and Applications (Springer, Boston), 237–275.Crossref, Google Scholar
- (2017) Solving derivative-free nonlinear least squares problems with POUNDERS. Terlaky T, Anjos MF, Ahmed S, eds. Advances and Trends in Optimization with Engineering Applications (SIAM, Philadelphia), 529–540.Crossref, Google Scholar
- (2012) On the local convergence of a derivative-free algorithm for least-squares minimization. Comput. Optim. Appl. 51(2):481–507.Crossref, Google Scholar
- (2018) Multiobjective optimization of composite flying-wings with SpaRibs and multiple control surfaces. Proc. 2018 Multidisciplinary Anal. Optim. Conf. (American Institute of Aeronautics and Astronautics, Reston, VA), 3424.Google Scholar
- (1997) Algorithm 778: L-BFGS-B: Fortran subroutines for large-scale bound-constrained optimization. ACM Trans. Math. Software 23(4):550–560.Crossref, Google Scholar
- (2001) SPEA2: Improving the strength Pareto evolutionary algorithm. TIK-Report 103, ETH Zürich, Zurich.Google Scholar

