Extubation Decisions with Predictive Information for Mechanically Ventilated Patients in the ICU

References

• Akan M, Alagoz O, Ata B, Erenay FS, Said A (2012) A broader view of designing the liver allocation system. Oper. Res. 60(4):757–770.Link, Google Scholar
• Alagoz O, Maillart LM, Schaefer AJ, Roberts MS (2004) The optimal timing of living-donor liver transplantation. Management Sci. 50(10):1420–1430.Link, Google Scholar
• Alagoz O, Maillart LM, Schaefer AJ, Roberts MS (2007a) Choosing among living-donor and cadaveric livers. Management Sci. 53(11):1702–1715.Link, Google Scholar
• Alagoz O, Maillart LM, Schaefer AJ, Roberts MS (2007b) Determining the acceptance of cadaveric livers using an implicit model of the waiting list. Oper. Res. 55(1):24–36.Link, Google Scholar
• Ayer T, Alagoz O, Stout NK (2012) OR forum—A POMDP approach to personalize mammography screening decisions. Oper. Res. 60(5):1019–1034.Link, Google Scholar
• Ayer T, Alagoz O, Stout NK, Burnside ES (2016) Heterogeneity in women’s adherence and its role in optimal breast cancer screening policies. Management Sci. 62(5):1339–1362.Link, Google Scholar
• Ayer T, Zhang C, Bonifonte A, Spaulding AC, Chhatwal J (2019) Prioritizing hepatitis C treatment in U.S. prisons. Oper. Res. 67(3):853–873.Link, Google Scholar
• Ayvaci MU, Alagoz O, Burnside ES (2012) The effect of budgetary restrictions on breast cancer diagnostic decisions. Manufacturing Service Oper. Management 14(4):600.Link, Google Scholar
• Barrett M, Smith M, Elixhauser A, Honigman L, Pines J (2014) Utilization of intensive care services, 2011. Healthcare Cost and Utilization Project (HCUP) Statistical Briefs (Agency for Healthcare Research and Quality, Rockville, MD).Google Scholar
• Bellman R (1957) A Markovian decision process. J. Math. Mechanics 6(5):679–684.Google Scholar
• Bertsimas D, Kallus N (2020) From predictive to prescriptive analytics. Management Sci. 66(3):1025–1044.Link, Google Scholar
• Bertsimas D, Kallus N, Weinstein AM, Zhuo YD (2017) Personalized diabetes management using electronic medical records. Diabetes Care 40(2):210–217.Crossref, Google Scholar
• Bertsimas D, O’Hair A, Relyea S, Silberholz J (2016) An analytics approach to designing combination chemotherapy regimens for cancer. Management Sci. 62(5):1511–1531.Link, Google Scholar
• Blum B (2018) Saving lives in the ICU through artificial intelligence. Accessed March 21, 2019, https://www.israel21c.org/saving-lives-in-the-icu-through-artificial-intelligence/.Google Scholar
• Boloori A, Saghafian S, Chakkera HA, Cook CB (2020) Data-driven management of post-transplant medications: An ambiguous partially observable Markov decision process approach. Manufacturing Service Oper. Management 22(5):1066–1087.Link, Google Scholar
• Boyarchenko S, Levendorskii S (2007) Irreversible Decisions Under Uncertainty: Optimal Stopping Made Easy, vol. 27 (Springer Science & Business Media, Boston).Google Scholar
• Chan CW, Farias VF, Bambos N, Escobar GJ (2012) Optimizing intensive care unit discharge decisions with patient readmissions. Oper. Res. 60(6):1323–1341.Link, Google Scholar
• Chan CW, Green LV, Lu Y, Leahy N, Yurt R (2013) Prioritizing burn-injured patients during a disaster. Manufacturing Service Oper. Management 15(2):170–190.Link, Google Scholar
• Chao DC, Scheinhorn DJ (2007) Determining the best threshold of rapid shallow breathing index in a therapist-implemented patient-specific weaning protocol. Respiratory Care 52(2):159–165.Google Scholar
• Chen Y, Farias VF (2013) Simple policies for dynamic pricing with imperfect forecasts. Oper. Res. 61(3):612–624.Link, Google Scholar
• Chen J, Dong J, Shi P (2023) Optimal routing under demand surges: The value of future arrival rates. Oper. Res., ePub ahead of print September 4, https://doi.org/10.1287/opre.2022.0282.Link, Google Scholar
• Chen T, Xu J, Ying H, Chen X, Feng R, Fang X, Gao H, et al. (2019) Prediction of extubation failure for intensive care unit patients using light gradient boosting machine. IEEE Access 7:150960–150968.Crossref, Google Scholar
• Chhatwal J, Alagoz O, Burnside ES (2010) Optimal breast biopsy decision-making based on mammographic features and demographic factors. Oper. Res. 58(6):1577–1591.Link, Google Scholar
• Ching WK, Ng MK, Fung ES (2008) Higher-order multivariate Markov chains and their applications. Linear Algebra Appl. 428(2–3):492–507.Crossref, Google Scholar
• Ching WK, Ng MK, So MM (2004) Customer migration, campaign budgeting, revenue estimation: The elasticity of Markov decision process on customer lifetime value. Adv. Modeling Optim. 6(2):65–80.Google Scholar
• Ching WK, Huang X, Ng MK, Siu TK (2013) Higher-order Markov chains. Markov Chains (Springer, Berlin), 141–176.Crossref, Google Scholar
• Chow Y, Robbins HA, Siegmund D (1971) Great Expectations: The Theory of Optimal Stopping (Houghton Mifflin, Boston).Google Scholar
• Chung WC, Sheu CC, Hung JY, Hsu TJ, Yang SH, Tsai JR (2020) Novel mechanical ventilator weaning predictive model. Kaohsiung J. Medical Sci. 36(10):841–849.Crossref, Google Scholar
• Ciocan DF, Mišić VV (2022) Interpretable optimal stopping. Management Sci. 68(3):1616–1638.Link, Google Scholar
• Cochran WG (1968) The effectiveness of adjustment by subclassification in removing bias in observational studies. Biometrics 24(2):295–313.Crossref, Google Scholar
• Dai JG, Shi P (2019) Inpatient overflow: An approximate dynamic programming approach. Manufacturing Service Oper. Management 21(4):894–911.Link, Google Scholar
• Dai JG, Shi P (2021) Recent modeling and analytical advances in hospital inpatient flow management. Production Oper. Management 30(6):1838–1862.Crossref, Google Scholar
• Demling RH, Read T, Lind LJ, Flanagan HL (1988) Incidence and morbidity of extubation failure in surgical intensive care patients. Critical Care Medicine 16(6):573–577.Crossref, Google Scholar
• Denton BT, Kurt M, Shah ND, Bryant SC, Smith SA (2009) Optimizing the start time of statin therapy for patients with diabetes. Medical Decision Making 29(3):351–367.Crossref, Google Scholar
• Desai VV, Farias VF, Moallemi CC (2012) Pathwise optimization for optimal stopping problems. Management Sci. 58(12):2292–2308.Link, Google Scholar
• Detemple J (2005) American-Style Derivatives: Valuation and Computation (CRC Press, Boca Raton, FL).Crossref, Google Scholar
• Epstein SK, Ciubotaru RL, Wong JB (1997) Effect of failed extubation on the outcome of mechanical ventilation. Chest 112(1):186–192.Crossref, Google Scholar
• Erat S, Kavadias S (2008) Sequential testing of product designs: Implications for learning. Management Sci. 54(5):956–968.Link, Google Scholar
• Erenay FS, Alagoz O, Said A (2014) Optimizing colonoscopy screening for colorectal cancer prevention and surveillance. Manufacturing Service Oper. Management 16(3):381–400.Link, Google Scholar
• Feng Y, Gallego G (1995) Optimal starting times for end-of-season sales and optimal stopping times for promotional fares. Management Sci. 41(8):1371–1391.Link, Google Scholar
• Fitch ZW, Debesa O, Ohkuma R, Duquaine D, Steppan J, Schneider EB, Whitman GJ (2014) A protocol-driven approach to early extubation after heart surgery. J. Thoracic Cardiovascular Surgery 147(4):1344–1350.Crossref, Google Scholar
• Fontela PS, Piva JP, Garcia PC, Bered PL, Zilles K (2005) Risk factors for extubation failure in mechanically ventilated pediatric patients. Pediatric Critical Care Medicine 6(2):166–170.Crossref, Google Scholar
• Girault C, Bubenheim M, Abroug F, Diehl JL, Elatrous S, Beuret P, Richecoeur J, et al. (2011) Noninvasive ventilation and weaning in patients with chronic hypercapnic respiratory failure: A randomized multicenter trial. Amer. J. Respiratory Critical Care Medicine 184(6):672–679.Crossref, Google Scholar
• Givan R, Leach S, Dean T (2000) Bounded-parameter Markov decision processes. Artificial Intelligence 122(1–2):71–109.Crossref, Google Scholar
• Goh J, Bayati M, Zenios SA, Singh S, Moore D (2018) Data uncertainty in Markov chains: Application to cost-effectiveness analyses of medical innovations. Oper. Res. 66(3):697–715.Link, Google Scholar
• Goldenberg DA, Chen Y (2018) Polynomial time algorithm for optimal stopping with fixed accuracy. Preprint, submitted July 6, https://doi.org/10.48550/arXiv.1807.02227.Google Scholar
• Goyal V, Grand-Clément J (2022) Robust Markov decision processes: Beyond rectangularity. Math. Oper. Res. 48(1):203–226.Link, Google Scholar
• Grand-Clément J, Chan C, Goyal V, Chuang E (2021) Interpretable machine learning for resource allocation with application to ventilator triage. Preprint, submitted October 21, https://arxiv.org/abs/2110.10994.Google Scholar
• Grand-Clément J, Chan CW, Goyal V, Escobar G (2022) Robustness of proactive intensive care unit transfer policies. Oper. Res. 71(5):1653–1688.Google Scholar
• Halpern NA, Pastores SM (2015) Critical care medicine beds, use, occupancy and costs in the United States: A methodological review. Critical Care Medicine 43(11):2452.Crossref, Google Scholar
• Haugh MB, Kogan L (2004) Pricing American options: A duality approach. Oper. Res. 52(2):258–270.Link, Google Scholar
• Hess DR (2011) Approaches to conventional mechanical ventilation of the patient with acute respiratory distress syndrome. Respiratory Care 56(10):1555–1572.Crossref, Google Scholar
• Hu W, Chan CW, Zubizarreta JR, Escobar GJ (2018) An examination of early transfers to the ICU based on a physiologic risk score. Manufacturing Service Oper. Management 20(3):531–549.Link, Google Scholar
• Huang T, Bergman D, Gopal R (2019) Predictive and prescriptive analytics for location selection of add-on retail products. Production Oper. Management 28(7):1858–1877.Crossref, Google Scholar
• Iancu DA, Trichakis N, Yoon DY (2020) Monitoring with limited information. Management Sci. 67(7):4233–4251.Link, Google Scholar
• Iyengar GN (2005) Robust dynamic programming. Math. Oper. Res. 30(2):257–280.Link, Google Scholar
• Jagannatha A, Thomas P, Yu H (2018) Toward high confidence off-policy reinforcement learning for clinical applications. CausalML Workshop, ICML.Google Scholar
• Kc DS (2020) Heuristic thinking in patient care. Management Sci. 66(6):2545–2563.Link, Google Scholar
• Kc DS, Terwiesch C (2009) Impact of workload on service time and patient safety: An econometric analysis of hospital operations. Management Sci. 55(9):1486–1498.Link, Google Scholar
• Kc DS, Terwiesch C (2012) An econometric analysis of patient flows in the cardiac intensive care unit. Manufacturing Service Oper. Management 14(1):50–65.Link, Google Scholar
• Kim SH, Pinker E, Rimar J (2024) Impact of capacity strain on the health status of patients discharged from an intensive care unit. Production Oper. Management, ePub ahead of print August 9, https://doi.org/10.1177/10591478241276134.Google Scholar
• Kim SH, Chan CW, Olivares M, Escobar G (2014) ICU admission control: An empirical study of capacity allocation and its implication for patient outcomes. Management Sci. 61(1):19–38.Link, Google Scholar
• Krishnamurthy V (2016) Partially Observed Markov Decision Processes: From Filtering to Controlled Sensing (Cambridge University Press, Cambridge, UK).Crossref, Google Scholar
• Kuntz L, Mennicken R, Scholtes S (2014) Stress on the ward: Evidence of safety tipping points in hospitals. Management Sci. 61(4):754–771.Link, Google Scholar
• Kuo HJ, Chiu HW, Lee CN, Chen TT, Chang CC, Bien MY (2015) Improvement in the prediction of ventilator weaning outcomes by an artificial neural network in a medical ICU. Respiratory Care 60(11):1560–1569.Crossref, Google Scholar
• Kwong MT, Colopy GW, Weber AM, Ercole A, Bergmann JH (2019) The efficacy and effectiveness of machine learning for weaning in mechanically ventilated patients at the intensive care unit: A systematic review. Biodesign Manufacturing 2(1):31–40.Crossref, Google Scholar
• Li L, Linetsky V (2013) Optimal stopping and early exercise: An eigenfunction expansion approach. Oper. Res. 61(3):625–643.Link, Google Scholar
• Luo D, Bayati M, Plambeck EL, Aratow M (2018) Low-acuity patients delay high-acuity patients in an emergency department. Preprint, submitted January 5, https://dx.doi.org/10.2139/ssrn.3095039.Google Scholar
• Mahle WT, Nicolson SC, Hollenbeck-Pringle D, Gaies MG, Witte MK, Lee EK, Goldsworthy M, et al. (2016) Utilizing a collaborative learning model to promote early extubation following infant heart surgery. Pediatric Critical Care Medicine 17(10):939–947.Crossref, Google Scholar
• McConville JF, Kress JP (2012) Weaning patients from the ventilator. New England J. Medicine 367(23):2233–2239.Crossref, Google Scholar
• Meade M, Guyatt G, Cook D, Griffith L, Sinuff T, Kergl C, Mancebo J, et al. (2001) Predicting success in weaning from mechanical ventilation. Chest 120(6):400S–424S.Crossref, Google Scholar
• Mišić VV, Aleman DM, Sharpe MB (2010) Neighborhood search approaches to non-coplanar beam orientation optimization for total marrow irradiation using IMRT. Eur. J. Oper. Res. 205(3):522–527.Crossref, Google Scholar
• Moran JL, Bristow P, Solomon PJ, George C, Hart GK (2008) Mortality and length-of-stay outcomes, 1993–2003, in the binational Australian and New Zealand intensive care adult patient database. Critical Care Medicine 36(1):46–61.Crossref, Google Scholar
• Nilim A, El Ghaoui L (2005) Robust control of Markov decision processes with uncertain transition matrices. Oper. Res. 53(5):780–798.Link, Google Scholar
• Niskanen M, Reinikainen M, Pettilä V (2009) Case-mix-adjusted length of stay and mortality in 23 Finnish ICUs. Intensive Care Medicine 35(6):1060–1067.Crossref, Google Scholar
• Prasad N, Cheng LF, Chivers C, Draugelis M, Engelhardt BE (2017) A reinforcement learning approach to weaning of mechanical ventilation in intensive care units. Preprint, submitted April 20, https://arxiv.org/abs/1704.06300.Google Scholar
• Raftery AE (1985) A model for high-order Markov chains. J. Roy. Statist. Soc. B 47(3):528–539.Crossref, Google Scholar
• Randolph AG, Wypij D, Venkataraman ST, Hanson JH, Gedeit RG, Meert KL, Luckett PM, et al. (2002) Effect of mechanical ventilator weaning protocols on respiratory outcomes in infants and children: A randomized controlled trial. JAMA 288(20):2561–2568.Crossref, Google Scholar
• Riedmiller M (2005) Neural fitted Q iteration: First experiences with a data efficient neural reinforcement learning method. Proc. Eur. Conf. Machine Learn. (Springer, Berlin), 317–328.Google Scholar
• Rosenbaum PR, Rubin DB (1983) The central role of the propensity score in observational studies for causal effects. Biometrika 70(1):41–55.Crossref, Google Scholar
• Sato M, Suenaga E, Koga S, Matsuyama S, Kawasaki H, Maki F (2009) Early tracheal extubation after on-pump coronary artery bypass grafting. Ann. Thoracic Cardiovascular Surgery 15(4):239–242.Google Scholar
• Schaefer AJ, Bailey MD, Shechter SM, Roberts MS (2005) Modeling medical treatment using Markov decision processes. Operations Research and Healthcare (Springer, Boston), 593–612.Crossref, Google Scholar
• Shechter SM, Bailey MD, Schaefer AJ, Roberts MS (2008) The optimal time to initiate HIV therapy under ordered health states. Oper. Res. 56(1):20–33.Link, Google Scholar
• Shi P, Helm JE, Deglise-Hawkinson J, Pan J (2021) Timing it right: Balancing inpatient congestion vs. readmission risk at discharge. Oper. Res. 69(6):1842–1865.Link, Google Scholar
• Shrank WH, Rogstad TL, Parekh N (2019) Waste in the US healthcare system: Estimated costs and potential for savings. JAMA 322(15):1501–1509.Crossref, Google Scholar
• Spencer J, Sudan M, Xu K (2014) Queuing with future information. Ann. Appl. Probability 24(5):2091–2142.Crossref, Google Scholar
• Sturt B (2021) A nonparametric algorithm for optimal stopping based on robust optimization. Preprint, submitted March 4, https://arxiv.org/abs/2103.03300.Google Scholar
• Thille AW, Richard JCM, Brochard L (2013) The decision to extubate in the intensive care unit. Amer. J. Respiratory Critical Care Medicine 187(12):1294–1302.Crossref, Google Scholar
• Tsai TL, Huang MH, Lee CY, Lai WW (2019) Data science for extubation prediction and value of information in surgical intensive care unit. J. Clinical Medicine 8(10):1709.Crossref, Google Scholar
• Verburg IW, de Keizer NF, de Jonge E, Peek N (2014) Comparison of regression methods for modeling intensive care length of stay. PLoS One 9(10):e109684.Crossref, Google Scholar
• Vincent JL, Moreno R, Takala J, Willatts S, De Mendonça A, Bruining H, Reinhart C, et al. (1996) The SOFA (Sepsis-related Organ Failure Assessment) score to describe organ dysfunction/failure. On behalf of the Working Group on Sepsis-Related Problems of the European Society of Intensive Care Medicine. Intensive Care Medicine 22(7):707–710.Google Scholar
• Wang A, Mahfouf M, Mills GH, Panoutsos G, Linkens DA, Goode K, Kwok HF, et al. (2010) Intelligent model-based advisory system for the management of ventilated intensive care patients. Part II: Advisory system design and evaluation. Comput. Methods Programs Biomedicine 99(2):208–217.Crossref, Google Scholar
• Wiesemann W, Kuhn D, Rustem B (2013) Robust Markov decision processes. Math. Oper. Res. 38(1):153–183.Link, Google Scholar
• Wilmore DW, Kehlet H (2001) Management of patients in fast track surgery. BMJ 322(7284):473–476.Crossref, Google Scholar
• Wong WT, Lai VK, Chee YE, Lee A (2016) Fast-track cardiac care for adult cardiac surgical patients. Cochrane Database Syst. Rev. 9(9):CD003587.Google Scholar
• Xie J, Cheng G, Zheng Z, Luo H, Ooi OC (2019) To extubate or not to extubate: Risk factors for extubation failure and deterioration with further mechanical ventilation. J. Cardiac Surgery 34(10):1004–1011.Crossref, Google Scholar
• Xu K (2015) Necessity of future information in admission control. Oper. Res. 63(5):1213–1226.Link, Google Scholar
• Xu K, Chan CW (2016) Using future information to reduce waiting times in the emergency department via diversion. Manufacturing Service Oper. Management 18(3):314–331.Link, Google Scholar
• Yang KL, Tobin MJ (1991) A prospective study of indexes predicting the outcome of trials of weaning from mechanical ventilation. New England J. Medicine 324(21):1445–1450.Crossref, Google Scholar
• Zhang Y, Steimle LN, Denton BT (2017) Robust Markov Decision Processes for Medical Treatment Decisions (Optimization Online).Google Scholar
• Zhang J, Denton BT, Balasubramanian H, Shah ND, Inman BA (2012) Optimization of prostate biopsy referral decisions. Manufacturing Service Oper. Management 14(4):529–547.Link, Google Scholar
• Zhu F, Lee A, Chee YE (2012) Fast-track cardiac care for adult cardiac surgical patients. Cochrane Database Syst. Rev. 10(10):CD003587.Crossref, Google Scholar