Supervised Multimodal Fission Learning

Published Online:https://doi.org/10.1287/ijds.2024.0059

References

  • Abdi H, Williams LJ, Valentin D (2013) Multiple factor analysis: Principal component analysis for multitable and multiblock data sets. WIREs Comput. Statist. 5(2):149–179.Google Scholar
  • Argelaguet R, Velten B, Arnol D, Dietrich S, Zenz T, Marioni JC, Buettner F, et al. (2018) Multi‐Omics Factor Analysis—A framework for unsupervised integration of multi‐omics data sets. Molecular Systems Biology 14(6):e8124.Google Scholar
  • Baltrušaitis T, Ahuja C, Morency LP (2018) Multimodal machine learning: A survey and taxonomy. IEEE Trans. Pattern Anal. Machine Intelligence 41(2):423–443.Google Scholar
  • Bellenguez C, Küçükali F, Jansen IE, Kleineidam L (2022) New insights into the genetic etiology of Alzheimer’s disease and related dementias. Nature Genetics 54(4):412–436.Google Scholar
  • Bertsekas DP (1997) Nonlinear programming. J. Oper. Res. Soc. 48(3):334–334. Google Scholar
  • Better MA (2023) Alzheimer’s disease facts and figures. Alzheimer’s Dementia 19(4):1598–1695.Google Scholar
  • Blum A, Mitchell T (1998) Combining labeled and unlabeled data with co-training. Ben-David S, Kogan S, eds. Proc. 11th Annual Conf. Comput. Learn. Theory (ACM Press, New York), 92–100.Google Scholar
  • Cao X, Zhang C, Fu H, Liu S, Zhang H (2015) Diversity-induced multi-view subspace clustering. Proc. IEEE Conf. Comput. Vision Pattern Recognition (IEEE Computer Society, Washington, DC), 586–594.Google Scholar
  • Cartwright H, ed. (2021) Methods in molecular biology. Artificial Neural Networks, vol. 2190 (Springer, New York).Google Scholar
  • Chen H, Caffo B, Stein-O’Brien G, Liu J, Langmead B, Colantuoni C, Xiao L (2022) Two-stage linked component analysis for joint decomposition of multiple biologically related data sets. Biostatistics 23(4):1200–1217.Google Scholar
  • Chen K, Reiman EM, Huan Z, Caselli RJ, Bandy D, Ayutyanont N, Alexander GE (2009) Linking functional and structural brain images with multivariate network analyses: A novel application of the partial least square method. Neuroimage 47(2):602–610.Google Scholar
  • Choi SG, Jung S (2022) Integrative decomposition of multi-source data by identifying partially-joint score subspaces. Preprint, submitted March 26, https://arxiv.org/abs/2203.14041.Google Scholar
  • Convit A, De Leon M, Tarshish C, De Santi S, Tsui W, Rusinek H, George A (1997) Specific hippocampal volume reductions in individuals at risk for Alzheimer’s disease. Neurobiology Aging 18(2):131–138.Google Scholar
  • Dasgupta S, Littman M, McAllester D (2001) PAC generalization bounds for co-training. Advances in Neural Information Processing Systems, vol. 14 (MIT Press, Cambridge, MA), 375–382.Google Scholar
  • Desikan RS, Ségonne F, Fischl B, Quinn BT, Dickerson BC, Blacker D, Buckner RL, et al. (2006) An automated labeling system for subdividing the human cerebral cortex on MRI scans into gyral based regions of interest. Neuroimage 31(3):968–980.Google Scholar
  • Diethe T, Hardoon DR, Shawe-Taylor J (2008) Multiview fisher discriminant analysis. Proc. NIPS Workshop Learn. Multiple Sources (MIT Press, Cambridge, MA).Google Scholar
  • Fang X, Zhou R, Gebraeel N (2015) An adaptive functional regression-based prognostic model for applications with missing data. Reliability Eng. & System Safety 133:266–274. Google Scholar
  • Feng Q, Jiang M, Hannig J, Marron JS (2018) Angle-based joint and individual variation explained. J. Multivariate Anal. 166:241–265. Google Scholar
  • Ferentinos P, Rivera M, Ising M, Spain SL, Cohen-Woods S, Butler AW, Craddock N, et al.. (2014) Investigating the genetic variation underlying episodicity in major depressive disorder: suggestive evidence for a bipolar contribution. J. Affect. Disord. 155:81–89.Google Scholar
  • Fischl B (2004) Automatically parcellating the human cerebral cortex. Cerebral Cortex 14(1):11–22.Google Scholar
  • Gao X, Lee S, Li G, Jung S (2021) Covariate‐driven factorization by thresholding for multiblock data. Biometrics 77(3):1011–1023.Google Scholar
  • Gaynanova I, Li G (2019) Structural learning and integrative decomposition of multi‐view data. Biometrics 75(4):1121–1132.Google Scholar
  • Golovanevsky M, Eickhoff C, Singh R (2022) Multimodal attention-based deep learning for Alzheimer’s disease diagnosis. J. Amer. Medical Inform. Assoc. 29(12):2014–2022.Google Scholar
  • Guo Y, Baum LW, Sham PC, Wong V, Ng PW, Lui CHT, Sin NC, et al. (2012) Two-stage genome-wide association study identifies variants in CAMSAP1L1 as susceptibility loci for epilepsy in Chinese. Human Molecular Genetics 21(5):1184–1189.Google Scholar
  • Hillary RF, McCartney DL, Harris SE, Stevenson AJ, Seeboth A, Zhang Q, Liewald DC, et al.. (2019) Genome and epigenome wide studies of neurological protein biomarkers in the Lothian Birth Cohort 1936. Nature Comm. 10(1):3160.Google Scholar
  • Hinrichs C, Singh V, Xu G, Johnson S (2009) MKL for robust multi-modality AD classification. Yang GZ, Hawkes D, Rueckert D, Noble A, Taylor C, eds. Medical Image Computing and Computer-Assisted Intervention – MICCAI 2009, Lecture Notes in Computer Science, vol. 5762 (Springer, Berlin).Google Scholar
  • Huang J, Zuber V, Matthews PM, Elliott P, Tzoulaki J, Dehghan A (2020) Sleep, major depressive disorder, and Alzheimer disease. Neurology 95(14):e1963–e1970.Google Scholar
  • Kaplan A, Lock EF (2017) Prediction with dimension reduction of multiple molecular data sources for patient survival. Cancer Informatics 16:117693511771851.Google Scholar
  • Kim JO, Mueller CW (1978) Introduction to Factor Analysis: What It is and How to Do It (Sage Publications, Beverly Hills, CA).Google Scholar
  • Klami A, Virtanen S, Leppaaho E, Kaski S (2015) Group factor analysis. IEEE Trans. Neural Networks Learn. Systems 26(9):2136–2147.Google Scholar
  • Kolda TG, Bader BW (2009) Tensor decompositions and applications. SIAM Rev. 51(3):455–500.Google Scholar
  • Lee DD, Seung HS (2000) Algorithms for non-negative matrix factorization. Advances in Neural Information Processing Systems, vol. 13 (MIT Press, Cambridge, MA).Google Scholar
  • Li G, Jung S (2017) Incorporating covariates into integrated factor analysis of multi‐view data. Biometrics 73(4):1433–1442.Google Scholar
  • Li J, Li M, Lu G, Zhang B, Yin H, Zhang D (2020) Similarity and diversity induced paired projection for cross-modal retrieval. Inform. Sci. 539:215–228. Google Scholar
  • Li L, Yu X, Sheng C, Jiang X, Zhang Q, Han Y, Jiang J (2022) A review of brain imaging biomarker genomics in Alzheimer’s disease: Implementation and perspectives. Translational Neurodegeneration 11(1):42.Google Scholar
  • Lin F, Crawford S, Guillot K, Zhang Y, Chen Y, Yuan X, Chen L, et al. (2023) Mmst-vit: Climate change-aware crop yield prediction via multi-modal spatial-temporal vision transformer. Proc. IEEE/CVF Internat. Conf. Comput. Vision (IEEE Computer Society, Washington, DC), 5774–5784.Google Scholar
  • Lock EF, Hoadley KA, Marron JS, Nobel AB (2013) Joint and individual variation explained (JIVE) for integrated analysis of multiple data types. Ann. Appl. Statist. 7(1):523–542.Google Scholar
  • Ma H, Liu Y, Wu G (2022) Elucidating multi-stage progression of neuro-degeneration process in Alzheimers disease. Alzheimer's & Dementia 18(S6).Google Scholar
  • Ma H, Shi Z, Kim M, Liu B, Smith PJ, Liu Y, Wu G, et al. (2024) Disentangling sex-dependent effects of ApoE on diverse trajectories of cognitive decline in Alzheimer’s disease. Neuroimage 292:120609.Google Scholar
  • Mao L, Dumkrieger G, Ku D, Ross K, Berisha V, Schwedt TJ, Li J, et al. (2023a) Developing multivariable models for predicting headache improvement in patients with acute post-traumatic headache attributed to mild traumatic brain injury: A preliminary study. Headache: J. Head Face Pain 63(1):136–145.Google Scholar
  • Mao L, Li J, Schwedt TJ, Berisha V, Nikjou D, Wu T, Dumkrieger GM, et al. (2023b) Questionnaire and structural imaging data accurately predict headache improvement in patients with acute post-traumatic headache attributed to mild traumatic brain injury. Cephalalgia 43(5).Google Scholar
  • Marees AT, De Kluiver H, Stringer S, Vorspan F, Curis E, Marie‐Claire C, Derks EM (2018) A tutorial on conducting genome‐wide association studies: Quality control and statistical analysis. Internat. J. Methods Psychiatric Res. 27(2):e1608.Google Scholar
  • Mueller SG, Weiner MW, Thal LJ, Petersen RC, Jack C, Jagust W, Trojanowski JQ, et al. (2005) The Alzheimer’s disease neuroimaging initiative. Neuroimaging Clinics North Amer. 15(4):869–877.Google Scholar
  • Palzer EF, Wendt CH, Bowler RP, Hersh CP, Safo SE, Lock EF (2022) sJIVE: Supervised joint and individual variation explained. Comput. Statist. Data Anal. 175:107547.Google Scholar
  • Pang Z, Wang X, Wang X, Qi J, Zhao Z, Gao Y, Yang Y, et al. (2021) A multi-modal data platform for diagnosis and prediction of Alzheimer’s disease using machine learning methods. Mobile Networks Appl. 26(6):2341–2352.Google Scholar
  • Peng P, Zhang Y, Ju Y, Wang K, Li G, Calhoun VD, Wang YP (2022) Group sparse joint non-negative matrix factorization on orthogonal subspace for multi-modal imaging genetics data analysis. IEEE/ACM Trans. Comput. Biology Bioinform. 19(1):479–490.Google Scholar
  • Purcell S, Neale B, Todd-Brown K, Thomas L, Ferreira MA, Bender D, Maller J, et al. (2007) PLINK: A tool set for whole-genome association and population-based linkage analyses. Amer. J. Human Genetics 81(3):559–575.Google Scholar
  • Ramachandram D, Taylor GW (2017) Deep multimodal learning: A survey on recent advances and trends. IEEE Signal Process. Magazine 34(6):96–108.Google Scholar
  • Ray P, Zheng L, Lucas J, Carin L (2014) Bayesian joint analysis of heterogeneous genomics data. Bioinformatics 30(10):1370–1376.Google Scholar
  • Risk BB, Gaynanova I (2021) Simultaneous non-Gaussian component analysis (SING) for data integration in neuroimaging. Ann. Appl. Statist. 15(3).Google Scholar
  • Rodosthenous T, Shahrezaei V, Evangelou M (2020) Integrating multi-OMICS data through sparse canonical correlation analysis for the prediction of complex traits: A comparison study. Bioinformatics 36(17):4616–4625.Google Scholar
  • Ruopp MD, Perkins NJ, Whitcomb BW, Schisterman EF (2008) Youden index and optimal cut‐point estimated from observations affected by a lower limit of detection. Biomedical J. 50(3):419–430.Google Scholar
  • Rupnik J, Taylor JS (2010) Multi-view canonical correlation analysis. Proc. Conf. Data Mining Data Warehouses (SiKDD 2010), vol. 473 (CEUR-WS.org, Aachen, Germany), 1–4.Google Scholar
  • Safo SE, Min EJ, Haine L (2022) Sparse linear discriminant analysis for multiview structured data. Biometrics 78(2):612–623.Google Scholar
  • Sagi O, Rokach L (2018) Ensemble learning: A survey. WIREs Data Mining Knowledge Discovery 8(4):e1249.Google Scholar
  • Sampaio AS, Fagerness J, Crane J, Leboyer M, Delorme R, Pauls DL, Stewart SE (2010) Association between polymorphisms in GRIK2 gene and obsessive‐compulsive disorder: A family‐based study. CNS Neurosci. Therapeutics 17(3):141–147.Google Scholar
  • Schouteden M, Van Deun K, Pattyn S, Van Mechelen I (2013) SCA with rotation to distinguish common and distinctive information in linked data. Behav. Res. Methods 45(3):822–833.Google Scholar
  • Smilde AK, Westerhuis JA, De Jong S (2003) A framework for sequential multiblock component methods. J. Chemometrics 17(6):323–337.Google Scholar
  • Tang TM, Allen GI (2021) Integrated principal components analysis. J. Machine Learn. Res. 22(1):8953–9023.Google Scholar
  • Thompson B (1984) Canonical Correlation Analysis: Uses and Interpretation (Sage Publications, Newbury Park, CA).Google Scholar
  • Wang Z, Yuan W, Montana G (2015) Sparse multi-view matrix factorization: A multivariate approach to multiple tissue comparisons. Bioinformatics 31(19):3163–3171.Google Scholar
  • Wang P, Wang H, Li Q, Shen D, Liu Y (2022) Joint and individual component regression. J. Comput. Graph. Statist.Google Scholar
  • Wang H, Nie F, Huang H, Yan J, Kim S, Nho K, Risacher SL, et al. (2012) From phenotype to genotype: An association study of longitudinal phenotypic markers to Alzheimer’s disease relevant SNPs. Bioinformatics 28(18):i619–i625.Google Scholar
  • Wold S, Esbensen K, Geladi P (1987) Principal component analysis. Chemometrics Intelligent Laboratory Systems 2(1–3):37–52.Google Scholar
  • Wu K, Hanna GL, Rosenberg DR, Arnold PD (2012) The role of glutamate signaling in the pathogenesis and treatment of obsessive–compulsive disorder. Pharmacology Biochemistry Behav. 100(4):726–735.Google Scholar
  • Xu C, Tao D, Xu C (2013) A survey on multi-view learning. Preprint, submitted April 20, https://arxiv.org/abs/1304.5634.Google Scholar
  • Xue X, Nie F, Wang S, Chang X, Stantic B, Yao M (2017) Multi-view correlated feature learning by uncovering shared component. Proc. 31st AAAI Conf. Artificial Intelligence, vol. 31 (AAAI Press, Palo Alto, CA), 2815–2821.Google Scholar
  • Yang Z, Michailidis G (2016) A non-negative matrix factorization method for detecting modules in heterogeneous omics multi-modal data. Bioinformatics 32(1):1–8.Google Scholar
  • Yiannopoulou KG, Papageorgiou SG (2020) Current and future treatments in Alzheimer disease: An update. J. Central Nervous System Disease 12:1–12.Google Scholar
  • Zhang C, Hu Q, Fu H, Zhu P, Cao X (2017) Latent multi-view subspace clustering. Proc. IEEE Conf. Comput. Vision Pattern Recognition (IEEE Computer Society, Washington, DC), 4279–4287.Google Scholar
  • Zhang S, Liu CC, Li W, Shen H, Laird PW, Zhou XJ (2012) Discovery of multi-dimensional modules by integrative analysis of cancer genomic data. Nucleic Acids Res. 40(19):9379–9391.Google Scholar
  • Zhang D, Chen S, Xu S, Wu J, Zhuang Y, Cao W, Chen X, et al.. (2022) The clinical correlation between Alzheimer’s disease and epilepsy. Frontiers Neurology 13:1664–2295. Google Scholar
  • Zhou G, Cichocki A, Zhang Y, Mandic DP (2016) Group component analysis for multiblock data: Common and individual feature extraction. IEEE Trans. Neural Networks Learn. Systems 27(11):2426–2439.Google Scholar
  • Zhou T, Thung KH, Zhu X, Shen D (2019) Effective feature learning and fusion of multimodality data using stage-wise deep neural network for dementia diagnosis. Human Brain Mapping 40(3):1001–1016.Google Scholar
  • Zhou T, Thung KH, Liu M, Shi F, Zhang C, Shen D (2020) Multi-modal latent space inducing ensemble SVM classifier for early dementia diagnosis with neuroimaging data. Medical Image Anal. 60:101630.Google Scholar
  • Zhu J, Shi J, Liu X, Chen X (2014) Co-training based semi-supervised classification of Alzheimer’s disease. Proc. 19th Internat. Conf. Digital Signal Processing (IEEE, Piscataway, NJ), 729–732.Google Scholar
  • Zou H, Hastie T (2005) Regularization and variable selection via the elastic net. J. Roy. Statist. Soc. Ser. B Statist. Methodology 67(2):301–320.Google Scholar
INFORMS site uses cookies to store information on your computer. Some are essential to make our site work; Others help us improve the user experience. By using this site, you consent to the placement of these cookies. Please read our Privacy Statement to learn more.