Inpatient Overflow: An Approximate Dynamic Programming Approach

J. G. Dai
J. G. Dai
http://orcid.org/0000-0002-5223-0129
School of Operations Research and Information Engineering, Cornell University, Ithaca, New York 14853;Institute for Data and Decision Analytics, The Chinese University of Hong Kong, Shenzhen 518172, China;
Search for more papers by this author
,
Pengyi Shi
Pengyi Shi
http://orcid.org/0000-0003-0905-7858
Krannert School of Management, Purdue University, West Lafayette, Indiana 47907
Search for more papers by this author

School of Operations Research and Information Engineering, Cornell University, Ithaca, New York 14853;Institute for Data and Decision Analytics, The Chinese University of Hong Kong, Shenzhen 518172, China;

Search for more papers by this author

Pengyi Shi

http://orcid.org/0000-0003-0905-7858

Krannert School of Management, Purdue University, West Lafayette, Indiana 47907

Search for more papers by this author

Published Online:16 May 2019https://doi.org/10.1287/msom.2018.0730

Supplemental Material

msom.2018.0730.sm1.pdf

Cited by
- A bi-objective Markov decision process design approach to redundancy allocation with dynamic maintenance for a parallel system
  European Journal of Operational Research, Vol. 332, No. 3
- Online refueling policy for liner ships with offline learning
  European Journal of Operational Research, Vol. 332, No. 2
- Workload Balancing in Hospitals using Dynamic Programming with a Multi-Agent C-QMIX Algorithm
  20 May 2026 | Journal of Systems Science and Systems Engineering, Vol. 35, No. 3
- Bi-level stochastic optimisation of integrated bed allocation and inpatient scheduling in dedicated inpatient systems with overflow capability
  20 May 2026 | International Journal of Production Research, Vol. 19
- Dynamic Relief Provision Planning for En Route Refugees: Modeling Probabilistic Movements Using Migration Pull Drivers
  3 November 2025 | Production and Operations Management, Vol. 35, No. 5
- Capacity Management in Networks: A Structural Estimation Approach for Hospital Inpatient Wards
  Jing Dong,
  Pengyi Shi,
  Fanyin Zheng,
  Xin Jin
  27 March 2026 | Manufacturing & Service Operations Management, Vol. 0, No. 0
- Optimizing Interhospital Patient Transfer Decisions: A Queueing Network Approach
  Timothy C. Y. Chan,
  Jangwon Park,
  Frances Pogacar,
  Vahid Sarhangian,
  Erik Hellsten,
  Fahad Razak,
  Amol Verma
  11 March 2026 | Manufacturing & Service Operations Management, Vol. 0, No. 0
- Joint Capacity Allocation and Job Assignment Under Uncertainty
  Peng Wang,
  Yun Fong Lim,
  Gar Goei Loke
  2 July 2025 | Operations Research, Vol. 74, No. 2
- Multi-Priority Patient Transfer Under Ambulance Offload Delay
  26 August 2025 | Production and Operations Management, Vol. 35, No. 3
- Joint evaluation of surgical patient scheduling and admission policies with bed management
  25 February 2026 | Flexible Services and Manufacturing Journal, Vol. 260
- A Primal-Dual Approach to Constrained Markov Decision Processes with Applications to Queue Scheduling and Inventory Management
  Yi Chen,
  Jing Dong,
  Zhaoran Wang,
  Chuheng Zhang
  20 May 2025 | Management Science, Vol. 72, No. 2
- An Adaptive Optimization Approach to Personalized Financial Incentives In Behavioral Interventions
  29 July 2025 | Production and Operations Management, Vol. 35, No. 2
- Platelet Inventory Management with Approximate Dynamic Programming
  Hossein Abouee-Mehrizi,
  Mahdi Mirjalili,
  Vahid Sarhangian
  11 March 2025 | INFORMS Journal on Computing, Vol. 38, No. 1
- Operations measures for inpatient beds in hospitals
- An interval type-2 fuzzy multi-criteria decision-making approach for patient bed allocation
  1 July 2025 | Scientific Reports, Vol. 15, No. 1
- Inpatient Overflow Decisions Based on Proximal Policy Optimization and Sinusoidal Positional Encoding
- Extubation Decisions with Predictive Information for Mechanically Ventilated Patients in the ICU
  Guang Cheng,
  Jingui Xie,
  Zhichao Zheng,
  Haidong Luo,
  Oon Cheong Ooi
  24 October 2024 | Management Science, Vol. 71, No. 7
- Reinforcement learning for healthcare operations management: methodological framework, recent developments, and future research directions
  9 April 2025 | Health Care Management Science, Vol. 28, No. 2
- Patient admission control and bed allocation during a pandemic using dynamic programming and simulation
  13 January 2025 | Journal of Modelling in Management, Vol. 20, No. 4
- Markov decision process and approximate dynamic programming for a patient assignment scheduling problem
  11 March 2025 | Annals of Operations Research, Vol. 347, No. 3
- AI-enhanced robust method for integrated healthcare resource pre-positioning and patient scheduling
  31 January 2024 | International Journal of Production Research, Vol. 63, No. 2
- An Integrated Approach to Improving Itinerary Completion in Coordinated Care Networks
  Yiqiu Liu; ,
  Pengyi Shi; ,
  Jonathan E. Helm; ,
  Mark P. Van Oyen; ,
  Lei Ying; ,
  Todd Hucshka
  15 October 2024 | Manufacturing & Service Operations Management, Vol. 27, No. 1
- Sharing service in healthcare systems: A recent survey
  Omega, Vol. 129
- The Spillover Effects of Capacity Pooling in Hospitals
  Jong Myeong Lim,
  Hummy Song,
  Julius J. Yang
  16 January 2024 | Management Science, Vol. 70, No. 11
- Optimizing hospital bed allocation for coordinated medical efficiency and quality improvement
  21 October 2024 | Journal of Combinatorial Optimization, Vol. 48, No. 4
- Admission, discharge, and transfer control in patient flow logistics: Overview and future research
  Transportation Research Part E: Logistics and Transportation Review, Vol. 191
- Robust Elective Hospital Admissions With Contextual Information
  IEEE Transactions on Automation Science and Engineering, Vol. 21, No. 4
- Preference-based allocation of patients to nursing homes
  Operations Research for Health Care, Vol. 42
- Hospital-Wide Inpatient Flow Optimization
  Dimitris Bertsimas,
  Jean Pauphilet
  25 September 2023 | Management Science, Vol. 70, No. 7
- Design of Patient Visit Itineraries in Tandem Systems
  Nan Liu,
  Guohua Wan,
  Shan Wang
  21 March 2024 | Manufacturing & Service Operations Management, Vol. 26, No. 3
- Dynamic capacity planning of hospital resources under COVID-19 uncertainty using approximate dynamic programming
  19 January 2023 | Journal of the Operational Research Society, Vol. 75, No. 1
- Data-Driven Hospital Admission Control: A Learning Approach
  Mohammad Zhalechian,
  Esmaeil Keyvanshokooh,
  Cong Shi,
  Mark P. Van Oyen
  10 August 2023 | Operations Research, Vol. 71, No. 6
- Adopting a hierarchical diagnosis and treatment system to optimize elective surgery scheduling
  Computers & Operations Research, Vol. 159
- Hospital Boarding Crises: The Impact of Urgent vs. Prevention Responses on Length of Stay
  Temidayo Adepoju,
  Anita L. Carson,
  Helen S. Jin,
  Christopher S. Manasseh
  21 March 2023 | Management Science, Vol. 69, No. 10
- Overflow in systems with two servers: the negative consequences
  13 June 2022 | Flexible Services and Manufacturing Journal, Vol. 35, No. 3
- Dynamic scheduling with uncertain job types
  European Journal of Operational Research, Vol. 309, No. 3
- Approximate Linear Program for Multi-Type Inpatient Allocation Admission Scheduling Problem
- To Batch or Not to Batch? Impact of Admission Batching on Emergency Department Boarding Time and Physician Productivity
  Arshya Feizi,
  Anita Carson,
  Jillian Berry Jaeker,
  William Evan Baker
  12 August 2022 | Operations Research, Vol. 71, No. 3
- Strategic Pathway Determination for a State Hospital in Terms of an Integrated Facility Management System
- Applications of fluid models in service operations management
  5 November 2022 | Queueing Systems, Vol. 103, No. 1-2
- A partially flexible routing strategy for assigning emergency department patients to inpatient wards
  Computers & Industrial Engineering, Vol. 176
- Routing and staffing in emergency departments: A multiclass queueing model with workload dependent service times
  26 July 2022 | IISE Transactions on Healthcare Systems Engineering, Vol. 13, No. 1
- The Analytics of Bed Shortages: Coherent Metric, Prediction, and Optimization
  Jingui Xie,
  Gar Goei Loke,
  Melvyn Sim,
  Shao Wei Lam
  31 January 2022 | Operations Research, Vol. 71, No. 1
- Multi-Priority Patient Transfer under Ambulance Offload Delay
  1 January 2023 | SSRN Electronic Journal, Vol. 226
- Design of Patient Visit Itineraries in Tandem Systems
  1 January 2023 | SSRN Electronic Journal, Vol. 258
- Asymptotically Optimal Policies for Dynamic Ambulance Dispatch
  1 January 2023 | SSRN Electronic Journal, Vol. 22
- Managing hospital inpatient beds under clustered overflow configuration
  Computers & Operations Research, Vol. 148
- Advance admission scheduling via resource satisficing
  1 November 2022 | Production and Operations Management, Vol. 31, No. 11
- Dynamic scheduling of home care patients to medical providers
  1 November 2022 | Production and Operations Management, Vol. 31, No. 11
- Admission Control Policies in Loss Networks
  IEEE Transactions on Automation Science and Engineering, Vol. 19, No. 4
- Surgical scheduling by Fuzzy model considering inpatient beds shortage under uncertain surgery durations
  22 March 2022 | Annals of Operations Research, Vol. 315, No. 1
- Dynamic Intra-Cell Repositioning in Free-Floating Bike-Sharing Systems Using Approximate Dynamic Programming
  Xue Luo,
  Li Li,
  Lei Zhao,
  Jianfeng Lin
  10 February 2022 | Transportation Science, Vol. 56, No. 4
- How does the hospital make a safe and stable elective surgery plan during COVID-19 pandemic?
  Computers & Industrial Engineering, Vol. 169
- Queueing Network Controls via Deep Reinforcement Learning
  J. G. Dai,
  Mark Gluzman
  3 December 2021 | Stochastic Systems, Vol. 12, No. 1
- Strategic Admission Behavior and Its Implications: Evidence from a Cardiac Surgery Department
  7 February 2022 | Journal of the Operations Research Society of China, Vol. 14
- A robust queueing network analyzer based on indices of dispersion
  4 July 2021 | Naval Research Logistics (NRL), Vol. 69, No. 1
- Integrated Multiresource Capacity Planning and Multitype Patient Scheduling
  Liping Zhou,
  Na Geng,
  Zhibin Jiang,
  Shan Jiang
  18 March 2021 | INFORMS Journal on Computing, Vol. 34, No. 1
- Applied Machine Learning in Operations Management
  11 May 2021
- Cope with the COVID-19 pandemic: Dynamic bed allocation and patient subsidization in a public healthcare system
  International Journal of Production Economics, Vol. 243
- Robot Scheduling for Mobile‐Rack Warehouses: Human–Robot Coordinated Order Picking Systems
  1 January 2022 | Production and Operations Management, Vol. 31, No. 1
- Joint Capacity Allocation and Job Assignment under Uncertainty
  SSRN Electronic Journal, Vol. 58
- Timing It Right: Balancing Inpatient Congestion vs. Readmission Risk at Discharge
  Pengyi Shi,
  Jonathan E. Helm,
  Jivan Deglise-Hawkinson,
  Julian Pan
  4 March 2021 | Operations Research, Vol. 69, No. 6
- Dynamic Server Assignment in Multiclass Queues with Shifts, with Applications to Nurse Staffing in Emergency Departments
  Carri W. Chan,
  Michael Huang,
  Vahid Sarhangian
  27 January 2021 | Operations Research, Vol. 69, No. 6
- Improved delivery policies for future drone-based delivery systems
  European Journal of Operational Research, Vol. 294, No. 3
- Learning and Information in Stochastic Networks and Queues
  Neil Walton,
  Kuang Xu
  18 October 2021
- Is it Time to Include Post‐Transplant Survival in Heart Transplantation Allocation Rules?
  1 August 2021 | Production and Operations Management, Vol. 30, No. 8
- Recent Modeling and Analytical Advances in Hospital Inpatient Flow Management
  1 June 2021 | Production and Operations Management, Vol. 30, No. 6
- Specialist care in rural hospitals: From Emergency Department consultation to hospital discharge
  13 August 2020 | IISE Transactions, Vol. 53, No. 4
- Markov chain analysis for the neonatal inpatient flow in a hospital
  30 September 2020 | Health Care Management Science, Vol. 24, No. 1
- Addressing artificial variability in patient flow
  Operations Research for Health Care, Vol. 28
- Patient Transfer Under Ambulance Offload Delays: An Approximate Dynamic Programming Approach
  12 November 2021
- Introducing AI General Practitioners to Improve Healthcare Services
  12 November 2021
- Reallocation of unoccupied beds among requesting wards
  7 August 2020 | Journal of Ambient Intelligence and Humanized Computing, Vol. 12, No. 1
- The Spillover Effects of Capacity Pooling in Hospitals
  SSRN Electronic Journal, Vol. 20
- To Batch or Not to Batch? Impact of Admission Batching on Emergency Department Boarding Time and Physician Productivity
  SSRN Electronic Journal, Vol. 5
- Limits of Capacity Flexibility: Impact of Hallway Placement on Patient Flow and Quality of Care in the Emergency Department
  SSRN Electronic Journal, Vol. 11
- Optimizing Inter-Hospital Patient Transfer Decisions During a Pandemic: A Queueing Network Approach
  SSRN Electronic Journal, Vol. 5
- A survey on skill-based routing with applications to service operations management
  4 October 2020 | Queueing Systems, Vol. 96, No. 1-2
- Capacity Pooling in Hospitals: The Hidden Consequences of Off-Service Placement
  Hummy Song,
  Anita L. Tucker,
  Ryan Graue,
  Sarah Moravick,
  Julius J. Yang
  15 August 2019 | Management Science, Vol. 66, No. 9
- Queueing Models for Patient-Flow Dynamics in Inpatient Wards
  Jing Dong,
  Ohad Perry
  15 November 2019 | Operations Research, Vol. 68, No. 1
- Coordinated Care: Capacity Allocation to Improve Itinerary Completion in Queueing Networks
  SSRN Electronic Journal, Vol. 5
- Applied Machine Learning in Operations Management
  SSRN Electronic Journal, Vol. 67
- Managing Portfolio of Elective Surgical Procedures: A Multidimensional Inverse Newsvendor Problem
  Hessam Bavafa,
  Charles M. Leys,
  Lerzan Örmeci,
  Sergei Savin
  29 October 2019 | Operations Research, Vol. 67, No. 6
- Optimal Stopping for Medical Treatment with Predictive Information
  SSRN Electronic Journal, Vol. 60
- Exploiting Hidden Convexity in Queueing Networks: A Novel Approach to Optimal Control of Flows
  SSRN Electronic Journal, Vol. 5
- Timing it Right: Balancing Inpatient Congestion Versus Readmission Risk at Discharge
  SSRN Electronic Journal, Vol. 14

cover image Manufacturing & Service Operations Management

Volume 21, Issue 4

Fall 2019

Pages 713-948

Article Information

Supplemental Material

Metrics

Information

Received:February 23, 2017
Accepted:January 21, 2018
Published Online:May 16, 2019

Cite as

J. G. Dai, Pengyi Shi (2019) Inpatient Overflow: An Approximate Dynamic Programming Approach. Manufacturing & Service Operations Management 21(4):894-911.

https://doi.org/10.1287/msom.2018.0730

Keywords

PDF download

Available Issues

Available Issues

Available Issues

Available Issues

Available Issues

Inpatient Overflow: An Approximate Dynamic Programming Approach

Supplemental Material

Volume 21, Issue 4

Article Information

Supplemental Material

Metrics

Information

Cite as

Keywords

Sign Up for INFORMS Publications Updates and News