Interpretable Hierarchical Deep Learning Model for Noninvasive Alzheimer’s Disease Diagnosis

References

• Ahlström MG, Ronit A, Omland LH, Vedel S, Obel N (2019) Algorithmic prediction of HIV status using nation-wide electronic registry data. EClinicalMedicine 17:100203.Google Scholar
• Albert MS, DeKosky ST, Dickson D, Dubois B, Feldman HH, Fox NC, Gamst A, et al. (2011) The diagnosis of mild cognitive impairment due to Alzheimer’s disease: Recommendations from the National Institute on Aging-Alzheimer’s Association workgroups on diagnostic guidelines for Alzheimer’s disease. Alzheimers Dement. 7(3):270–279.Google Scholar
• Alzheimer’s Association (2018) 2018 Alzheimer’s disease facts and figures. Alzheimers Dement. 14(3):367–429.Google Scholar
• Becker JT, Boiler F, Lopez OL, Saxton J, McGonigle KL (1994) The natural history of Alzheimer’s disease: Description of study cohort and accuracy of diagnosis. Arch. Neurol. 51(6):585–594.Google Scholar
• Birks JS (2006) Cholinesterase inhibitors for Alzheimer’s disease. Cochrane Database Syst. Rev. 2006(1):CD005593.Google Scholar
• Blair M, Marczinski CA, Davis-Faroque N, Kertesz A (2007) A longitudinal study of language decline in Alzheimer’s disease and frontotemporal dementia. J. Internat. Neuropsych. Soc. 13(2):237–245.Google Scholar
• Bordes A, Chopra S, Weston J (2014) Question answering with subgraph embeddings. Preprint, submitted June 14, https://arxiv.org/abs/1406.3676.Google Scholar
• Chen J, Zhu J, Ye J (2019) An attention-based hybrid network for automatic detection of Alzheimer’s disease from narrative speech. Proc. Interspeech 2019 (International Speech Communication Association, Baixas, France), 4085–4089.Google Scholar
• Chien YW, Hong SY, Cheah WT, Yao LH, Chang YL, Fu LC (2019) An automatic assessment system for Alzheimer’s disease based on speech using feature sequence generator and recurrent neural network. Sci. Rep. 9(1):1–10.Google Scholar
• Cho K, Van Merriënboer B, Gulcehre C, Bahdanau D, Bougares F, Schwenk H, Bengio Y (2014) Learning phrase representations using RNN Encoder-Decoder for statistical machine translation. Preprint, submitted June 3, https://arxiv.org/abs/1406.1078.Google Scholar
• Choi E, Bahadori MT, Kulas J, Schuetz A, Stewart W, Sun J (2016) RETAIN: An interpretable predictive model for healthcare using reverse time attention mechanism. Lee D, Sugiyama M, Luxburg U, Guyon I, Garnett R, eds. Advances in Neural Information Processing Systems 29 (Neural Information Processing Systems Foundation, Inc., La Jolla, CA), 3512–3520.Google Scholar
• Chollet F (2021) Deep Learning with Python, 2nd ed. (Manning Publications, Shelter Island, NY).Google Scholar
• Collobert R, Weston J, Bottou L, Karlen M, Kavukcuoglu K, Kuksa P (2011) Natural language processing (almost) from scratch. J. Machine Learn. Res. 12(Aug):2493–2537.Google Scholar
• Damian AM, Jacobson SA, Hentz JG, Belden CM, Shill HA, Sabbagh MN, Caviness JN, Adler CH (2011) The Montreal cognitive assessment and the mini-mental state examination as screening instruments for cognitive impairment: Item analyses and threshold scores. Dement. Geriatr. Cogn. Disord. 31(2):126–131.Google Scholar
• Dinu A, Moldovan AC (2021) Automatic detection and classification of mental illnesses from general social media texts. Angelova G, Kunilovskaya M, Mitkov R, Nikolova-Koleva I, eds. Proc. Internat. Conf. Recent Advances in Natural Language Processing (RANLP 2021) (INCOMA Ltd., Shoumen, Bulgaria), 358–366.Google Scholar
• El-Sappagh S, Alonso JM, Islam S, Sultan AM, Kwak KS (2021) A multilayer multimodal detection and prediction model based on explainable artificial intelligence for Alzheimer’s disease. Sci. Rep. 11(1):1–26.Google Scholar
• Fabrizio C, Termine A, Caltagirone C, Sancesario G (2021) Artificial intelligence for Alzheimer’s disease: Promise or challenge? Diagnostics (Basel) 11(8):1473.Google Scholar
• Fan F, Xiong J, Wang G (2020) On interpretability of artificial neural networks. Preprint, submitted January 8, https://arxiv.org/abs/2001.02522.Google Scholar
• Feldman H, Woodward M (2005) The staging and assessment of moderate to severe Alzheimer disease. Neurology 65(6 suppl 3):S10–S17.Google Scholar
• Feng C, Cai F, Chen H, de Rijke M (2018) Attentive encoder-based extractive text summarization. Proc. 27th ACM Internat. Conf. Inform. Knowledge Management (Association for Computing Machinery, New York), 1499–1502.Google Scholar
• Fraser KC, Meltzer JA, Rudzicz F (2016) Linguistic features identify Alzheimer’s disease in narrative speech. J. Alzheimers Dis. 49(2):407–422.Google Scholar
• Fritsch J, Wankerl S, Nöth E (2019) Automatic diagnosis of Alzheimer’s disease using neural network language models. Proc. ICASSP 2019-2019 IEEE Internat. Conf. Acoustics, Speech and Signal Processing (ICASSP) (IEEE, Piscataway, NJ), 5841–5845.Google Scholar
• Goodman B, Flaxman S (2017) European Union regulations on algorithmic decision-making and a “right to explanation.” AI Mag. 38(3):50–57.Google Scholar
• Hinton G, Deng L, Yu D, Dahl GE, Mohamed A-R, Jaitly N, Senior A, et al. (2012) Deep neural networks for acoustic modeling in speech recognition. IEEE Signal Process. Mag. 29(6):82–97.Google Scholar
• Holzinger A, Biemann C, Pattichis CS, Kell DB (2017) What do we need to build explainable AI systems for the medical domain? Preprint, submitted December 28, https://arxiv.org/abs/1712.09923.Google Scholar
• Jiang ZP, Zomick J, Levitan SI, Serper M, Hirschberg J (2021) Automatic detection and prediction of psychiatric hospitalizations from social media posts. Goharian N, Resnik P, Yates A, Ireland M, Niederhoffer K, Resnik R, eds. Proc. Seventh Workshop Comput. Linguistics and Clinical Psychology: Improving Access (Association for Computation Linguistics, Stroudsburg, PA), 116–121.Google Scholar
• Karlekar S, Niu T, Bansal M (2018) Detecting linguistic characteristics of Alzheimer’s dementia by interpreting neural models. Preprint, submitted April 17, https://arxiv.org/abs/1804.06440.Google Scholar
• Katzman R (1976) The prevalence and malignancy of Alzheimer disease: A major killer. Arch. Neurol. 33(4):217–218.Google Scholar
• Kim J, Seo J (2017) Human understandable explanation extraction for black-box classification models based on matrix factorization. Preprint, submitted September 18, https://arxiv.org/abs/1709.06201.Google Scholar
• Kong W, Jang H, Carenini G, Field T (2019) A neural model for predicting dementia from language. Proc. Machine Learn. Res. 106:270–286.Google Scholar
• Laske C, Sohrabi HR, Frost SM, López-de Ipiña K, Garrard P, Buscema M, Dauwels J, et al. (2015) Innovative diagnostic tools for early detection of Alzheimer’s disease. Alzheimers Dement. 11(5):561–578.Google Scholar
• LeCun Y, Bengio Y, Hinton G (2015) Deep learning. Nature 521(7553):436–444.Google Scholar
• Lin Z, Feng M, Nogueira dos Santos C, Yu M, Xiang B, Zhou B, Bengio Y (2017) A structured self-attentive sentence embedding. Preprint, submitted March 9, https://arxiv.org/abs/1703.03130.Google Scholar
• Logan R, Zerbey SS, Miller SJ (2021) The future of artificial intelligence for Alzheimer’s disease diagnostics. Adv. Alzheimer Dis. 10(4):53–59.Google Scholar
• Lopez-de Ipiña K, Alonso JB, Solé-Casals J, Barroso N, Faundez-Zanuy M, Ecay-Torres M, Travieso CM, Ezeiza A, Estanga A (2012) Alzheimer disease diagnosis based on automatic spontaneous speech analysis. IJCCI 2012: Proc. 4th Internat. Joint Conf. Comput. Intelligence (SciTePress, Barcelona), 698–705.Google Scholar
• Ma X, Hovy E (2016) End-to-end sequence labeling via bi-directional LSTM-CNNs-CRF. Preprint, submitted March 4, https://arxiv.org/abs/1603.01354.Google Scholar
• Ma F, Chitta R, Zhou J, You Q, Sun T, Gao J (2017) Dipole: Diagnosis prediction in healthcare via attention-based bidirectional recurrent neural networks. Proc. 23rd ACM SIGKDD Internat. Conf. Knowledge Discovery and Data Mining (Association for Computing Machinery, New York), 1903–1911.Google Scholar
• MacWhinney B (2000) The CHILDES Project: Tools for Analyzing Talk, vol. II: The Database, 3rd ed. (Psychology Press, New York).Google Scholar
• Marcus JL, Hurley LB, Krakower DS, Alexeeff S, Silverberg MJ, Volk JE (2019) Use of electronic health record data and machine learning to identify candidates for HIV pre-exposure prophylaxis: A modelling study. Lancet HIV 6(10):e688–e695.Google Scholar
• Mikolov T, Chen K, Corrado G, Dean J (2013) Efficient estimation of word representations in vector space. Preprint, submitted January 16, https://arxiv.org/abs/1301.3781.Google Scholar
• Mitchell AJ (2009) A meta-analysis of the accuracy of the mini-mental state examination in the detection of dementia and mild cognitive impairment. J. Psychiatr. Res. 43(4):411–431.Google Scholar
• Mortamais M, Ash JA, Harrison J, Kaye J, Kramer J, Randolph C, Pose C, et al. (2017) Detecting cognitive changes in preclinical Alzheimer’s disease: A review of its feasibility. Alzheimers Dement. 13(4):468–492.Google Scholar
• Neyshabur B, Tomioka R, Srebro N (2014) In search of the real inductive bias: On the role of implicit regularization in deep learning. Preprint, submitted December 20, https://arxiv.org/abs/1412.6614.Google Scholar
• Olden JD, Jackson DA (2002) Illuminating the “black box”: A randomization approach for understanding variable contributions in artificial neural networks. Ecol. Model. 154(1–2):135–150.Google Scholar
• Orimaye SO, Wong JSM, Wong CP (2018) Deep language space neural network for classifying mild cognitive impairment and Alzheimer-type dementia. PLoS One 13(11):e0205636.Google Scholar
• Orimaye SO, Wong JS, Golden KJ, Wong CP, Soyiri IN (2017) Predicting probable Alzheimer’s disease using linguistic deficits and biomarkers. BMC Bioinformatics 18(1):34.Google Scholar
• Pan Y, Mirheidari B, Reuber M, Venneri A, Blackburn D, Christensen H (2019) Automatic hierarchical attention neural network for detecting AD. Proc. Interspeech 2019 (International Speech Communication Association, Baixas, France), 4105–4109.Google Scholar
• Pennington J, Socher R, Manning C (2014) Glove: Global vectors for word representation. Moschitti A, Pang B, Daelemans W, eds. Proc. 2014 Conf. Empirical Methods in Natural Language Processing (EMNLP) (Association for Computational Linguistics, Stroudsburg, PA), 1532–1543.Google Scholar
• Rajkomar A, Oren E, Chen K, Dai AM, Hajaj N, Hardt M, Liu PJ, et al. (2018) Scalable and accurate deep learning with electronic health records. NPJ Digit. Medicine 1(1):18.Google Scholar
• Sainath TN Mohamed AR, Kingsbury B, Ramabhadran B (2013) Deep convolutional neural networks for LVCSR. Proc. 2013 IEEE Internat. Conf. Acoustics, Speech and Signal Processing (IEEE, Piscataway, NJ), 8614–8618.Google Scholar
• Saleem TJ, Zahra SR, Wu F, Alwakeel A, Alwakeel M, Jeribi F, Hijji M (2022) Deep learning-based diagnosis of Alzheimer’s disease. J. Personalized Medicine 12(5):815.Google Scholar
• Salton G, McGill MJ (1983) Introduction to Modern Information Retrieval (McGraw-Hill Book Co., New York).Google Scholar
• Ševčík A, Rusko M (2022) A systematic review of Alzheimer’s disease detection based on speech and natural language processing. Proc. 2022 32nd Internat. Conf. Radioelektronika (RADIOELEKTRONIKA) (IEEE, Piscataway, NJ), 01–05.Google Scholar
• Sha Y, Wang MD (2017) Interpretable predictions of clinical outcomes with an attention-based recurrent neural network. Proc. 8th ACM Internat. Conf. Bioinformatics, Computational Biology, and Health Informatics (Association for Computing Machinery, New York), 233–240.Google Scholar
• Subasi A (2020) Use of artificial intelligence in Alzheimer’s disease detection. Barh D, ed. Artificial Intelligence in Precision Health (Academic Press, New York), 257–278.Google Scholar
• Sutskever I, Martens J, Dahl G, Hinton G (2013) On the importance of initialization and momentum in deep learning. Proc. Machine Learn. Res. 28(3):1139–1147.Google Scholar
• Tang-Wai DF, Graham NL (2008) Assessment of language function in dementia. Geriatrics Aging 11(2):103–110.Google Scholar
• Wankerl S, Nöth E, Evert S (2017) An N-gram based approach to the automatic diagnosis of Alzheimer’s disease from spoken language. Proc. Interspeech 2017 (International Speech Communication Association, Baixas, France), 3162–3166.Google Scholar
• Williams JA, Weakley A, Cook DJ, Schmitter-Edgecombe M (2013) Machine learning techniques for diagnostic differentiation of mild cognitive impairment and dementia. Proc. Workshops Twenty-Seventh AAAI Conf. Artificial Intelligence (AAAI, Washington, DC), 71–76.Google Scholar
• Yang J, Zhang Y (2018) Ncrf++: An open-source neural sequence labeling toolkit. Proc. 56th Annual Meeting of the Association for Computational Linguistics (Association for Computational Linguistics, Stroudsburg, PA). https://aclanthology.org/P18-4013/.Google Scholar
• Yang Q, Li X, Ding X, Xu F, Ling Z (2022) Deep learning-based speech analysis for Alzheimer’s disease detection: A literature review. Alzheimers Res. Ther. 14(1):1–16.Google Scholar
• Yang Z, Yang D, Dyer C, He X, Smola A, Hovy E (2016) Hierarchical attention networks for document classification. Proc. 2016 Conf. North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Association for Computational Linguistics, Stroudsburg, PA), 1480–1489.Google Scholar
• Zhang T, Schoene AM, Ji S, Ananiadou S (2022) Natural language processing applied to mental illness detection: A narrative review. NPJ Digit. Medicine 5(1):46.Google Scholar
• Zimmerer VC, Wibrow M, Varley RA (2016) Formulaic language in people with probable Alzheimer’s disease: A frequency-based approach. J. Alzheimers Dis. 53(3):1145–1160.Google Scholar