Slowly Varying Regression Under Sparsity

Published Online:https://doi.org/10.1287/opre.2022.0330

References

  • Alaíz CM, Barbero A, Dorronsoro JR (2013) Group fused lasso. Internat. Conf. Artificial Neural Networks (Springer, Berlin, Heidelberg), 66–73.CrossrefGoogle Scholar
  • Bertsimas D, Van Parys B (2020) Sparse high-dimensional regression: Exact scalable algorithms and phase transitions. Ann. Statist. 48(1):300–323.CrossrefGoogle Scholar
  • Bertsimas D, Cory-Wright R, Pauphilet J (2021) A unified approach to mixed-integer optimization problems with logical constraints. SIAM J. Optim. 31(3):2340–2367.CrossrefGoogle Scholar
  • Bertsimas D, Gamarnik D, Tsitsiklis J (1999) Estimation of time-varying parameters in statistical models: An optimization approach. Machine Learning 35(3):225–245.CrossrefGoogle Scholar
  • Bertsimas D, King A, Mazumder R (2016) Best subset selection via a modern optimization lens. Ann. Statist. 44(2):813–852.CrossrefGoogle Scholar
  • Besag J, York J, Mollié A (1991) Bayesian image restoration, with two applications in spatial statistics. Ann. Inst. Statist. Math. 43(1):1–20.CrossrefGoogle Scholar
  • Bleakley K, Vert JP (2011) The group fused Lasso for multiple change-point detection. Preprint, submitted June 21, https://arxiv.org/abs/1106.4199.Google Scholar
  • Brunsdon C, Fotheringham S, Charlton M (1996) Geographically weighted regression: A method for exploring spatial nonstationarity. Geographical Anal. 28(4):281–298.CrossrefGoogle Scholar
  • Candanedo L, Feldheim V, Deramaix D (2017) Data driven prediction models of energy use of appliances in a low-energy house. Energy Buildings 140:81–97.CrossrefGoogle Scholar
  • Casetti E (1972) Generating models by the expansion method: Applications to geographical research. Geographical Anal. 4(1):81–91.CrossrefGoogle Scholar
  • Chen F, Padilla A, Young PC, Garnier H (2020) Data-driven modeling of wireless power transfer systems with slowly time-varying parameters. IEEE Trans. Power Electronics 35(11):12442–12456.CrossrefGoogle Scholar
  • Chu BY, Ho CH, Tsai CH, Lin CY, Lin CJ (2015) Warm start for parameter selection of linear classifiers. Proc. 21st ACM SIGKDD Internat. Conf. Knowledge Discovery Data Mining (Association for Computing Machinery, New York), 149–158.Google Scholar
  • De Cock D (2011) Ames, Iowa: Alternative to the Boston housing data as an end of semester regression project. J. Statist. Ed. 19(3).Google Scholar
  • Duran M, Grossmann I (1986) An outer-approximation algorithm for a class of mixed-integer nonlinear programs. Math. Program. 36(3):307–339.CrossrefGoogle Scholar
  • Eubank RL (1999) Nonparametric Regression and Spline Smoothing (CRC Press, Boca Raton, FL).CrossrefGoogle Scholar
  • Fletcher R, Leyffer S (1994) Solving mixed integer nonlinear programs by outer approximation. Math. Program. 66:327–349.CrossrefGoogle Scholar
  • Hallac D, Leskovec J, Boyd S (2015) Network lasso: Clustering and optimization in large graphs. Proc. 21st ACM SIGKDD Internat. Conf. Knowledge Discovery Data Mining (Association for Computing Machinery, New York), 387–396.Google Scholar
  • Hallac D, Wong C, Diamond S, Sharang A, Sosic R, Boyd S, Leskovec J (2017) SnapVX: A network-based convex optimization solver. J. Machine Learning Res. 18(1):110–114.Google Scholar
  • Hastie T, Tibshirani R (1993) Varying-coefficient models. J. Royal Statist. Soc. B 55(4):757–779.CrossrefGoogle Scholar
  • Hazimeh H, Mazumder R, Saab A (2022) Sparse regression at scale: Branch-and-bound rooted in first-order optimization. Math. Program. 196(1–2):347–388.CrossrefGoogle Scholar
  • Kenney A, Chiaromonte F, Felici G (2021) MIP-BOOST: Efficient and effective L0 feature selection for linear regression. J. Comput. Graphical Statist. 30(3):566–577.CrossrefGoogle Scholar
  • Liu P, Fattahi S, Gómez A, Küçükyavuz S (2023) A graph-based decomposition method for convex quadratic optimization with indicators. Math. Program. 200(2):669–701.CrossrefGoogle Scholar
  • Ohlsson H, Ljung L, Boyd S (2010) Segmentation of ARX-models using sum-of-norms regularization. Automatica 46(6):1107–1111.CrossrefGoogle Scholar
  • Phillips PC (2007) Regression with slowly varying regressors and nonlinear trends. Econometric Theory 23(4):557–614.CrossrefGoogle Scholar
  • Quesada I, Grossmann I (1992) An LP/NLP based branch and bound algorithm for convex MINLP optimization problems. Comput. Chemical Engrg. 16(10–11):937–947.CrossrefGoogle Scholar
  • Rojas C, Wahlberg B (2014) On change point detection using the fused lasso method. Preprint, submitted January 21, https://arxiv.org/abs/1401.5408.Google Scholar
  • Tibshirani R (1996) Regression shrinkage and selection via the lasso. J. Royal Statist. Soc. B 58(1):267–288.CrossrefGoogle Scholar
  • Tibshirani RJ, Taylor J (2011) The solution path of the generalized lasso. Ann. Statist. 39(3):1335–1371.CrossrefGoogle Scholar
  • Tibshirani R, Saunders M, Rosset S, Zhu J, Knight K (2005) Sparsity and smoothness via the fused lasso. J. Royal Statist. Soc. Ser. B Statist. Methodology 67(1):91–108.CrossrefGoogle Scholar
  • Wei L, Gómez A, Küçükyavuz S (2022) Ideal formulations for constrained convex optimization problems with indicator variables. Math. Program. 192(1–2):57–88.CrossrefGoogle Scholar
  • Wu D, Xu J (2020) On the optimal weighted l2 regularization in overparameterized linear regression. Advances Neural Inform. Processing. Systems 33:10112–10123.Google Scholar
  • Wytock M (2014) Time-varying linear regression with total variation regularization. Accessed February, 2022, https://www.ml.cmu.edu/research/dap-papers/dap-wytock.pdf.Google Scholar
  • Wytock M, Sra S, Kolter J (2014) Fast Newton methods for the group fused lasso. UAI’14 Proc. 30th Conf. Uncertainty Artificial Intelligence (AUAI Press, Arlington, VA), 888–897.Google Scholar
  • Xu H, Caramanis C, Mannor S (2008) Robust regression and lasso. Koller D, Schuurmans D, Bengio Y, Bottou L, eds. Adv. Neural Inform. Processing Systems, vol. 21 (Curran Associates, Inc., Red Hook, NY).Google Scholar
  • Zhang Y, Zhu J, Zhu J, Wang X (2023) A splicing approach to best subset of groups selection. INFORMS J. Comput. 35(1):104–119.LinkGoogle Scholar
  • Zhang S, Guo B, Dong A, He J, Xu Z, Chen SX (2017) Cautionary tales on air-quality improvement in Beijing. Proc. Royal Soc. A Math. Phys. Engrg. Sci. 473(2205):20170457.Google Scholar
INFORMS site uses cookies to store information on your computer. Some are essential to make our site work; Others help us improve the user experience. By using this site, you consent to the placement of these cookies. Please read our Privacy Statement to learn more.