Optimization of Tree Ensembles

References

• Atomwise Inc. (2017) Atomwise—Better medicines faster. Accessed May 27, 2017, http://www.atomwise.com.Google Scholar
• Bajari P, Nekipelov D, Ryan SP, Yang M (2015) Machine learning methods for demand estimation. Amer. Econom. Rev. 105(5):481–485.Crossref, Google Scholar
• Bertsimas D, Dunn J (2017) Optimal classification trees. Machine Learn. 106(7):1039–1082.Crossref, Google Scholar
• Bertsimas D, Kallus N (2016) The power and limits of predictive approaches to observational-data-driven optimization. Working paper, Massachusetts Institute of Technology, Cambridge.Google Scholar
• Bertsimas D, King A (2015) OR Forum: An algorithmic approach to linear regression. Oper. Res. 64(1):2–16.Link, Google Scholar
• Bertsimas D, Mišić VV (2019) Exact first-choice product line optimization. Oper. Res. 67(3):651–670.Link, Google Scholar
• Bertsimas D, Lulli G, Odoni A (2011) An integer optimization approach to large-scale air traffic flow management. Oper. Res. 59(1):211–227.Link, Google Scholar
• Bertsimas D, O’Hair A, Relyea S, Silberholz J (2016) An analytics approach to designing combination chemotherapy regimens for cancer. Management Sci. 62(5):1511–1531.Link, Google Scholar
• Besbes O, Phillips R, Zeevi A (2010) Testing the validity of a demand model: An operations perspective. Manufacturing Service Oper. Management 12(1):162–183.Link, Google Scholar
• Bezanson J, Karpinski S, Shah VB, Edelman A (2012) Julia: A fast dynamic language for technical computing. Working paper, Massachusetts Institute of Technology, Cambridge.Google Scholar
• Biau G, Scornet E (2016) A random forest guided tour. TEST 25(2):197–227.Crossref, Google Scholar
• Biau G, Devroye L, Lugosi G (2008) Consistency of random forests and other averaging classifiers. J. Machine Learn. Res. 9(Sep):2015–2033.Google Scholar
• Breiman L (1996) Bagging predictors. Machine Learn. 24(2):123–140.Crossref, Google Scholar
• Breiman L (2001) Random forests. Machine Learn. 45(1):5–32.Crossref, Google Scholar
• Breiman L, Friedman J, Stone CJ, Olshen RA (1984) Classification and Regression Trees (CRC Press, Boca Raton, FL).Google Scholar
• Chen T, Guestrin C (2016) XGBoost: A scalable tree boosting system. Proc. 22nd ACM SIGKDD Internat. Conf. Knowledge Discovery Data Mining (ACM, New York), 785–794.Google Scholar
• Cohen MC, Leung N-HZ, Panchamgam K, Perakis G, Smith A (2017) The impact of linear optimization on promotion planning. Oper. Res. 65(2):446–468.Link, Google Scholar
• Cortez P, Cerdeira A, Almeida F, Matos T, Reis J (2009) Modeling wine preferences by data mining from physicochemical properties. Decision Support Systems 47(4):547–553.Crossref, Google Scholar
• Crama Y (1993) Concave extensions for nonlinear 0–1 maximization problems. Math. Programming 61(1–3):53–60.Crossref, Google Scholar
• Díaz-Uriarte R, De Andres SA (2006) Gene selection and classification of microarray data using random forest. BMC Bioinformatics 7(1): article 3.Crossref, Google Scholar
• Fernández-Delgado M, Cernadas E, Barro S, Amorim D (2014) Do we need hundreds of classifiers to solve real world classification problems. J. Machine Learn. Res. 15(1):3133–3181.Google Scholar
• Ferreira KJ, Lee BHA, Simchi-Levi D (2015) Analytics for an online retailer: Demand forecasting and price optimization. Manufacturing Service Oper. Management 18(1):69–88.Link, Google Scholar
• Gurobi Optimization, Inc. (2015) Gurobi Optimizer Reference Manual. http://www.gurobi.com.Google Scholar
• Ho TK (1998) The random subspace method for constructing decision forests. IEEE Trans. Pattern Anal. Machine Intelligence 20(8):832–844.Crossref, Google Scholar
• Huuskonen J (2000) Estimation of aqueous solubility for a diverse set of organic compounds based on molecular topology. J. Chemical Inform. Comput. Sci. 40(3):773–777.Crossref, Google Scholar
• Kallus N (2017) Recursive partitioning for personalization using observational data. Proc. 34th Internat. Conf. Machine Learn., vol. 70, 1789–1798.Google Scholar
• Kansy M, Senner F, Gubernator K (1998) Physicochemical high throughput screening: Parallel artificial membrane permeation assay in the description of passive absorption processes. J. Medicinal Chemistry 41(7):1007–1010.Crossref, Google Scholar
• Kuhn M, Johnson K (2014) AppliedPredictiveModeling: Functions and Data Sets for ‘Applied Predictive Modeling.’ R package version 1.1-6. https://cran.r-project.org/web/packages/AppliedPredictiveModeling/index.html.Google Scholar
• Lemmens A, Croux C (2006) Bagging and boosting classification trees to predict churn. J. Marketing Res. 43(2):276–286.Crossref, Google Scholar
• Liaw A, Wiener M (2002) Classification and regression by randomForest. R News 2(3):18–22.Google Scholar
• Lichman M (2013) UCI machine learning repository. Center for Machine Learning and Intelligent Systems. Accessed October 9, 2019, http://archive.ics.uci.edu/ml.Google Scholar
• Lubin M, Dunning I (2015) Computing in operations research using Julia. INFORMS J. Comput. 27(2):238–248.Link, Google Scholar
• Ma J, Sheridan RP, Liaw A, Dahl GE, Svetnik V (2015) Deep neural nets as a method for quantitative structure–activity relationships. J. Chemical Inform. Modeling 55(2):263–274.Crossref, Google Scholar
• Mišić VV (2016) Data, models and decisions for large-scale stochastic optimization problems. Unpublished PhD thesis, Massachusetts Institute of Technology, Cambridge.Google Scholar
• Montgomery AL (1997) Creating micro-marketing pricing strategies using supermarket scanner data. Marketing Sci. 16(4):315–337.Link, Google Scholar
• Quinlan JR (1986) Induction of decision trees. Machine Learn. 1(1):81–106.Crossref, Google Scholar
• Ridgeway G (2006) gbm: Generalized boosted regression models. R Package version 1.5-7.Google Scholar
• Scannell JW, Blanckley A, Boldon H, Warrington B (2012) Diagnosing the decline in pharmaceutical R&D efficiency. National Rev. Drug Discovery 11(3):191–200.Crossref, Google Scholar
• Schapire RE, Freund Y (2012) Boosting: Foundations and Algorithms (MIT Press, Cambridge, MA).Crossref, Google Scholar
• Scornet E, Biau G, Vert J-P (2015) Consistency of random forests. Ann. Statist. 43(4):1716–1741.Crossref, Google Scholar
• Svetnik V, Liaw A, Tong C, Culberson JC, Sheridan RP, Feuston BP (2003) Random forest: A classification and regression tool for compound classification and qsar modeling. J. Chemical Inform. Comput. Sci. 43(6):1947–1958.Crossref, Google Scholar
• Tetko IV, Tanchuk VY, Kasheva TN, Villa AEP (2001) Estimation of aqueous solubility of chemical compounds using e-state indices. J. Chemical Inform. Comput. Sci. 41(6):1488–1493.Crossref, Google Scholar
• Varian HR (2014) Big data: New tricks for econometrics. J. Econom. Perspect. 28(2):3–27.Crossref, Google Scholar
• Vielma JP (2015) Mixed integer linear programming formulation techniques. SIAM Rev. 57(1):3–57.Crossref, Google Scholar
• Willett P, Barnard JM, Downs GM (1998) Chemical similarity searching. J. Chemical Inform. Comput. Sci. 38(6):983–996.Crossref, Google Scholar
• Wright MN, Ziegler A (2017) ranger: A fast implementation of random forests for high dimensional data in C++ and R. J. Statist. Software 77(1):1–17.Crossref, Google Scholar
• Yeh I-C (1998) Modeling of strength of high-performance concrete using artificial neural networks. Cement Concrete Res. 28(12):1797–1808.Crossref, Google Scholar