Optimizing the First Response to Sepsis: An Electronic Health Record-Based Markov Decision Process Model

References

• Abraham EP (2015) The antibiotics resistance crisis. Comprehensive Biochemistry 11(4):181–224.Google Scholar
• Alberti C, Brun-Buisson C, Chevret S, Antonelli M, Goodman SV, Martin C, Moreno R, et al. (2005) Systemic inflammatory response and progression to severe sepsis in critically ill infected patients. Amer. J. Respiratory Critical Care Medicine 171(5):461–468.Crossref, Google Scholar
• Andersson M, Östholm-Balkhed Å, Fredrikson M, Holmbom M, Hällgren A, Berg S, Hanberger H (2019) Delay of appropriate antibiotic treatment is associated with high mortality in patients with community-onset sepsis in a Swedish setting. Eur. J. Clinical Microbiology Infectious Diseases 38(7):1223–1234.Crossref, Google Scholar
• Annane D, Bellissant E, Bollaert PE, Briegel J, Keh D, Kupfer Y (2004) Corticosteroids for severe sepsis and septic shock: A systematic review and meta-analysis. BMJ 329(7464):480.Crossref, Google Scholar
• Ayvaci M, Mobini Z, Özer Z (2021) To catch a killer: A data-driven personalized and compliance-aware sepsis alert system. Working paper, The University of Texas, Dallas, TX.Google Scholar
• Bauer M, Gerlach H, Vogelmann T, Preissing F, Stiefel J, Adam D (2020) Mortality in sepsis and septic shock in Europe, North America and Australia between 2009 and 2019: Results from a systematic review and meta-analysis. Critical Care 24(1):239.Crossref, Google Scholar
• Bone RC, Fisher CJ Jr, Clemmer TP, Slotman GJ, Metz CA, Balk RA (1989) Sepsis syndrome: A valid clinical entity. Critical Care Medicine 17(5):389–393.Crossref, Google Scholar
• Buchman TG, Simpson SQ, Sciarretta KL, Finne KP, Sowers N, Collier M, Chavan S, et al. (2020) Sepsis among Medicare beneficiaries: 1. The burdens of sepsis, 2012–2018. Critical Care Medicine 48(3):276–288.Crossref, Google Scholar
• Capan M, Ivy JS, Wilson JR, Huddleston JM (2017) A stochastic model of acute-care decisions based on patient and provider heterogeneity. Health Care Management Sci. 20(2):187–206.Crossref, Google Scholar
• CDC (2019) Centers for Disease Control and Prevention. Accessed July 22, 2019, https://www.cdc.gov/sepsis/datareports/index.html.Google Scholar
• CDC (2021) How antibiotic resistance happens. Accessed March 25, 2022, https://www.cdc.gov/drugresistance/about/how-resistance-happens.html.Google Scholar
• Chen KF, Liu SH, Li CH, Wu CC, Chaou CH, Tzeng IS, Hsieh YH, et al. (2017) Development and validation of a parsimonious and pragmatic CHARM score to predict mortality in patients with suspected sepsis. Amer. J. Emergency Medicine 35(4):640–646.Crossref, Google Scholar
• Ghassemi M, Wu M, Hughes MC, Szolovits P, Doshi-Velez F (2017) Predicting intervention onset in the ICU with switching state space models. AMIA Joint Summits Translational Sci. Proc. 2017:82–91.Google Scholar
• Ghosh S, Li J, Cao L, Ramamohanarao K (2017) Septic shock prediction for ICU patients via coupled HMM walking on sequential contrast patterns. J. Biomedical Inform. 66:19–31.Crossref, Google Scholar
• Girard TD, Opal SM, Ely EW (2005) Insights into severe sepsis in older patients: From epidemiology to evidence-based management. Clinical Infectious Diseases 40(5):719–727.Crossref, Google Scholar
• Gupta A, Liu T, Crick C (2020) Utilizing time series data embedded in electronic health records to develop continuous mortality risk prediction models using hidden Markov models: A sepsis case study. Statist. Methods Medical Res. 29(11):3409–3423.Crossref, Google Scholar
• Hotchkiss RS, Moldawer LL, Opal SM, Reinhart K, Turnbull IR, Vincent JL (2016) Sepsis and septic shock. Nature Rev. Disease Primers 2:16045.Crossref, Google Scholar
• Huang DT, Clermont G, Dremsizov TT, Angus DC, ProCESS Investigators (2007) Implementation of early goal-directed therapy for severe sepsis and septic shock: A decision analysis. Critical Care Medicine 35(9):2090–2100.Crossref, Google Scholar
• Johnson AE, Pollard TJ, Shen L, Lehman LW, Feng M, Ghassemi M, Moody B, Szolovits P, Celi LA, Mark RG (2016) MIMIC-III, a freely accessible critical care database. Sci. Data 3:160035.Crossref, Google Scholar
• Komorowski M, Celi LA, Badawi O, Gordon AC, Faisal AA(2018) The artificial intelligence clinician learns optimal treatment strategies for sepsis in intensive care. Nature Medicine 24(11):1716–1720.Crossref, Google Scholar
• Kumar A, Roberts D, Wood KE, Light B, Parrillo JE, Sharma S, Suppes R, et al. (2006) Duration of hypotension before initiation of effective antimicrobial therapy is the critical determinant of survival in human septic shock. Critical Care Medicine 34(6):1589–1596.Crossref, Google Scholar
• Levy MM, Macias WL, Vincent JL, Russell JA, Silva E, Trzaskoma B, Williams MD (2005) Early changes in organ function predict eventual survival in severe sepsis. Critical Care Medicine 33(10):2194–2201.Crossref, Google Scholar
• Magni P, Quaglini S, Marchetti M, Barosi G (2000) Deciding when to intervene: A Markov decision process approach. Internat. J. Medical Inform. 60(3):237–253.Crossref, Google Scholar
• Marshall JC, Deitch E, Moldawer LL, Opal S, Redl H, van der Poll T (2005) Preclinical models of shock and sepsis: What can they tell us? Shock 24(Suppl 1):1–6.Crossref, Google Scholar
• Martin GS, Mannino DM, Moss M (2006) The effect of age on the development and outcome of adult sepsis. Critical Care Medicine 34(1):15–21.Crossref, Google Scholar
• NIH (2019) Sepsis. Accessed July 22, 2019, https://www.nigms.nih.gov/education/pages/factsheet_sepsis.aspx.Google Scholar
• Papathanassoglou E, Middleton N, Benbenishty J, Williams G, Christofi MD, Hegadoren K (2017) Systematic review of gender-dependent outcomes in sepsis. Nursing Critical Care 22(5):284–292.Crossref, Google Scholar
• Parente JD, Chase JG, Moeller K, Shaw GM (2021) High inter-patient variability in sepsis evolution: A hidden Markov model analysis. Comput. Methods Programs Biomedicine 201:105956.Crossref, Google Scholar
• Paxton C, Niculescu-Mizil A, Saria S (2013) Developing predictive models using electronic medical records: Challenges and pitfalls. AMIA Annual Symp. Proc. 2013:1109–1115.Google Scholar
• Puterman ML (2014) Markov Decision Processes: Discrete Stochastic Dynamic Programming (John Wiley & Sons, Hoboken, NJ).Google Scholar
• Raghu A, Komorowski M, Celi LA, Szolovits P, Ghassemi M (2017) Continuous state-space models for optimal sepsis treatment: A deep reinforcement learning approach. Doshi-Velez F, Fackler J, Kale D, Ranganath R, Wallace B, Wiens J, eds. Proc. 2nd Machine Learn. Healthcare Conf., Proceedings of Machine Learning Research, vol. 68 (PMLR, Cambridge, MA), 147–163.Google Scholar
• Rangel-Frausto MS, Pittet D, Hwang T, Woolson RF, Wenzel RP(1998) The dynamics of disease progression in sepsis: Markov modeling describing the natural history and the likely impact of effective antisepsis agents. Clinical Infectious Diseases 27(1):185–190.Crossref, Google Scholar
• Rhodes A, Evans LE, Alhazzani W, Levy MM, Antonelli M, Ferrer R, Kumar A, et al. (2017) Surviving sepsis campaign: International guidelines for management of sepsis and septic shock: 2016. Critical Care Medicine 45(3):486–552.Crossref, Google Scholar
• Ribas VJ, Vellido A, Ruiz-Rodríguez JC, Rello J (2012) Severe sepsis mortality prediction with logistic regression over latent factors. Expert Systems Appl. 39(2):1937–1943.Crossref, Google Scholar
• Rubulotta F, Marshall JC, Ramsay G, Nelson D, Levy M, Williams M (2009) Predisposition, insult/infection, response, and organ dysfunction: A new model for staging severe sepsis. Critical Care Medicine 37(4):1329–1335.Crossref, Google Scholar
• Saka G, Kreke JE, Schaefer AJ, Chang CCH, Roberts MS, Angus DC; GenIMS Investigators (2007) Use of dynamic microsimulation to predict disease progression in patients with pneumonia-related sepsis. Critical Care 11(3):R65.Crossref, Google Scholar
• Schoenberg MH, Weiss M, Radermacher P (1998) Outcome of patients with sepsis and septic shock after ICU treatment. Langenbecks Arch. Surgery 383(1):44–48.Crossref, Google Scholar
• Shankar-Hari M, Phillips GS, Levy ML, Seymour CW, Liu VX, Deutschman CS, Angus DC, Rubenfeld GD, Singer M, Sepsis Definitions Task Force (2016) Developing a new definition and assessing new clinical criteria for septic shock: For the third international consensus definitions for sepsis and septic shock (sepsis-3). JAMA 315(8):775–787.Crossref, Google Scholar
• Shapiro NI, Howell MD, Talmor D, Donnino M, Ngo L, Bates DW(2007) Mortality in emergency department sepsis (MEDS) score predicts 1-year mortality. Critical Care Medicine 35(1):192–198.Crossref, Google Scholar
• Shechter SM, Bailey MD, Schaefer AJ, Roberts MS (2008) The optimal time to initiate HIV therapy under ordered health states. Oper. Res. 56(1):20–33.Link, Google Scholar
• Singer M, Deutschman CS, Seymour CW, Shankar-Hari M, Annane D, Bauer M, Bellomo R, et al. (2016) The third international consensus definitions for sepsis and septic shock (sepsis-3). JAMA 315(8):801–810.Crossref, Google Scholar
• Sonnenberg FA, Beck JR (1993) Markov models in medical decision making: A practical guide. Medical Decision Making 13(4):322–338.Crossref, Google Scholar
• SSC (2016) SSC guidelines. Accessed July 22, 2019, http://www.survivingsepsis.org/Guidelines/Pages/default.aspx.Google Scholar
• Tsoukalas A, Albertson T, Tagkopoulos I (2015) From data to optimal decision making: A data-driven, probabilistic machine learning approach to decision support for patients with sepsis. JMIR Medical Inform. 3(1):e11.Crossref, Google Scholar
• van Wyk F, Khojandi A, Mohammed A, Begoli E, Davis RL, Kamaleswaran R (2019) A minimal set of physiomarkers in continuous high frequency data streams predict adult sepsis onset earlier. Internat. J. Medical Inform. 122:55–62.Crossref, Google Scholar
• Yealy DM, Huang DT, Delaney A, Knight M, Randolph AG, Daniels R, Nutbeam T (2015) Recognizing and managing sepsis: What needs to be done? BMC Medicine 13(1):98.Crossref, Google Scholar