The Optimal Time to Initiate HIV Therapy Under Ordered Health States

Steven M. Shechter
Steven M. Shechter
[email protected]
Operations and Logistics Division, Sauder School of Business, University of British Columbia, Vancouver, British Columbia, Canada V6T 1Z2
Search for more papers by this author
,
Matthew D. Bailey
Matthew D. Bailey
[email protected]
Department of Management, Bucknell University, Lewisburg, Pennsylvania 17837
Search for more papers by this author
,
Andrew J. Schaefer
Andrew J. Schaefer
[email protected]
Department of Industrial Engineering, University of Pittsburgh, Pittsburgh, Pennsylvania 15261
Search for more papers by this author
,
Mark S. Roberts
Mark S. Roberts
[email protected]
Section of Decision Sciences and Clinical Systems Modeling, Department of Medicine, Department of Health Policy and Management, Department of Industrial Engineering, University of Pittsburgh, Pittsburgh, Pennsylvania 15213
Search for more papers by this author

Operations and Logistics Division, Sauder School of Business, University of British Columbia, Vancouver, British Columbia, Canada V6T 1Z2

Search for more papers by this author

Matthew D. Bailey

[email protected]

Department of Management, Bucknell University, Lewisburg, Pennsylvania 17837

Search for more papers by this author

Andrew J. Schaefer

[email protected]

Department of Industrial Engineering, University of Pittsburgh, Pittsburgh, Pennsylvania 15261

Search for more papers by this author

Mark S. Roberts

[email protected]

Section of Decision Sciences and Clinical Systems Modeling, Department of Medicine, Department of Health Policy and Management, Department of Industrial Engineering, University of Pittsburgh, Pittsburgh, Pennsylvania 15213

Search for more papers by this author

Published Online:1 Feb 2008https://doi.org/10.1287/opre.1070.0480

Supplemental Material

opre.1070.0480-sm-ec.pdf (117 KB)

Cited by
- Markov decision processes: Monotonicity of optimal policy in exponential and quasi-hyperbolic discounting parameters
  European Journal of Operational Research, Vol. 328, No. 3
- Chronic disease progression prediction in healthcare operations
- Optimal Staffing and Treatment for Collaborative Care of Diabetes and Depression
  21 October 2025 | Production and Operations Management, Vol. 9
- Modeling multidimensional aging in community-dwelling older adults: Insights from a heterogeneous population
  1 October 2025 | IISE Transactions on Healthcare Systems Engineering, Vol. 15, No. 4
- Improving Health Outcomes With Less Cost? Provision of Mobile Clinic in Developing Economies
  11 July 2025 | Production and Operations Management, Vol. 20
- Extubation Decisions with Predictive Information for Mechanically Ventilated Patients in the ICU
  Guang Cheng,
  Jingui Xie,
  Zhichao Zheng,
  Haidong Luo,
  Oon Cheong Ooi
  24 October 2024 | Management Science, Vol. 71, No. 7
- Quantifying the benefits of increasing decision-making frequency for health applications with regular decision epochs
  10 April 2024 | IISE Transactions, Vol. 57, No. 5
- Modified monotone policy iteration for interpretable policies in Markov decision processes and the impact of state ordering rules
  24 July 2024 | Annals of Operations Research, Vol. 347, No. 2
- Cost-effectiveness of personalized policies for implementing organ-at-risk sparing adaptive radiation therapy in head and neck cancer
  Physics and Imaging in Radiation Oncology, Vol. 34
- Finding the Maximum Safe Treatment Interval for Patients With Chronic Conditions
  4 October 2024 | Production and Operations Management, Vol. 34, No. 2
- State discretization for continuous-state MDPs in infectious disease control
  27 November 2024 | IISE Transactions on Healthcare Systems Engineering, Vol. 15, No. 1
- Optimal timing of organs-at-risk-sparing adaptive radiation therapy for head-and-neck cancer under re-planning resource constraints
  Physics and Imaging in Radiation Oncology, Vol. 33
- Strategic flexibility in healthcare: an exploration of real options
  13 February 2024 | Journal of Economic Studies, Vol. 51, No. 9
- Is Separately Modeling Subpopulations Beneficial for Sequential Decision-Making?
  Ilbin Lee
  18 May 2023 | Operations Research, Vol. 72, No. 6
- Dynamic tuberculosis screening for healthcare employees
  Computers & Operations Research, Vol. 169
- Patient adherence in healthcare operations: A narrative review
  Socio-Economic Planning Sciences, Vol. 91
- A Causal Network-Based Markov Decision Process Model for Intervention Planning
  IEEE Transactions on Automation Science and Engineering, Vol. 21, No. 1
- Reducing the Price of Naïveté in return‐to‐play from sports‐related concussion
  1 October 2023 | Production and Operations Management, Vol. 32, No. 10
- Robustness of Proactive Intensive Care Unit Transfer Policies
  Julien Grand-Clément,
  Carri W. Chan,
  Vineet Goyal,
  Gabriel Escobar
  22 November 2022 | Operations Research, Vol. 71, No. 5
- Partially observable collaborative model for optimizing personalized treatment selection
  European Journal of Operational Research, Vol. 309, No. 3
- Optimal discharge of patients from intensive care via a data-driven policy learning framework
  Operations Research for Health Care, Vol. 38
- Inverse Markov decision processes with unknown transition probabilities
  22 August 2022 | IISE Transactions, Vol. 55, No. 6
- Optimal treatment policies for pelvic organ prolapse in women
  24 May 2021 | Decision Sciences, Vol. 54, No. 2
- Data-driven dynamic treatment planning for chronic diseases
  European Journal of Operational Research, Vol. 305, No. 2
- Reinforcement learning strategies in cancer chemotherapy treatments: A review
  Computer Methods and Programs in Biomedicine, Vol. 229
- Markov Decision Processes: Application to Treatment Planning
  23 September 2022
- Optimizing Interpretable Treatment and Screening Policies in Healthcare
  11 July 2023
- Utilizing Clinical Trial Data to Assess Timing of Surgical Treatment for Emphysema Patients
  9 December 2022 | Medical Decision Making, Vol. 43, No. 1
- Markov Decision Processes: Monotonicity of Optimal Policy in Exponential and Quasi-Hyperbolic Discounting Parameters
  1 January 2023 | SSRN Electronic Journal, Vol. 207
- Optimizing the First Response to Sepsis: An Electronic Health Record-Based Markov Decision Process Model
  Erik Rosenstrom,
  Sareh Meshkinfam,
  Julie Simmons Ivy,
  Shadi Hassani Goodarzi,
  Muge Capan,
  Jeanne Huddleston,
  Santiago Romero-Brufau
  22 July 2022 | Decision Analysis, Vol. 19, No. 4
- An Analytics Approach to Guide Randomized Controlled Trials in Hypertension Management
  Anthony Bonifonte,
  Turgay Ayer,
  Benjamin Haaland
  17 January 2022 | Management Science, Vol. 68, No. 9
- Optimal treatment of chronic kidney disease with uncertainty in obtaining a transplantable kidney: an MDP based approach
  1 September 2020 | Annals of Operations Research, Vol. 316, No. 1
- Expert Systems in Behavioral and Mental Healthcare: Applications of AI in Decision‐Making and Consultancy
  27 May 2022
- A Markov Decision Process Framework for Optimal Cancer Chemotherapy Dose Selection
  Journal of Physics: Conference Series, Vol. 2287, No. 1
- Quantile Markov Decision Processes
  Xiaocheng Li,
  Huaiyang Zhong,
  Margaret L. Brandeau
  9 November 2021 | Operations Research, Vol. 70, No. 3
- Personalized Medicine
- How AI Can Help Depression Treatment
- Optimizing diabetes screening frequencies for at-risk groups
  6 August 2021 | Health Care Management Science, Vol. 25, No. 1
- Personalized Chronic Disease Follow‐Up Appointments: Risk‐Stratified Care Through Big Data
  1 February 2022 | Production and Operations Management, Vol. 31, No. 2
- Customizing Primary Care Delivery Using E‐Visits
  1 November 2021 | Production and Operations Management, Vol. 30, No. 11
- An Analytics‐Driven Approach for Optimal Individualized Diabetes Screening
  1 September 2021 | Production and Operations Management, Vol. 30, No. 9
- Monitoring with Limited Information
  Dan Andrei Iancu,
  Nikolaos Trichakis,
  Do Young Yoon
  7 October 2020 | Management Science, Vol. 67, No. 7
- Broadening the Concept of Value: A Scoping Review on the Option Value of Medical Technologies
  Value in Health, Vol. 24, No. 7
- Multi-model Markov decision processes
  10 May 2021 | IISE Transactions, Vol. 59
- Patient-Type Bayes-Adaptive Treatment Plans
  M. Reza Skandari,
  Steven M. Shechter
  15 February 2021 | Operations Research, Vol. 69, No. 2
- Policy-based branch-and-bound for infinite-horizon Multi-model Markov decision processes
  Computers & Operations Research, Vol. 126
- Managing Collaborative Care for Diabetes and Depression
  SSRN Electronic Journal, Vol. 55
- A reinforcement learning model to inform optimal decision paths for HIV elimination
  Mathematical Biosciences and Engineering, Vol. 18, No. 6
- To Catch A Killer: A Data-Driven Personalized and Compliance-Aware Sepsis Alert System
  SSRN Electronic Journal, Vol. 25
- A finite-horizon Markov decision process model for cancer chemotherapy treatment planning: an application to sequential treatment decision making in clinical trials
  17 July 2020 | Annals of Operations Research, Vol. 295, No. 1
- Analysis via Markov decision process to evaluate glycemic control strategies of a large retrospective cohort with type 2 diabetes: the ameliorate study
  21 February 2020 | Acta Diabetologica, Vol. 57, No. 7
- Designing a rural network of dialysis facilities
  European Journal of Operational Research, Vol. 282, No. 3
- A Multi-Fidelity Rollout Algorithm for Dynamic Resource Allocation in Population Disease Management
  7 September 2018 | Health Care Management Science, Vol. 22, No. 4
- Prioritizing Hepatitis C Treatment in U.S. Prisons
  Turgay Ayer,
  Can Zhang,
  Anthony Bonifonte,
  Anne C. Spaulding,
  Jagpreet Chhatwal
  13 March 2019 | Operations Research, Vol. 67, No. 3
- Automatic EEG classification: a path to smart and connected sleep interventions
  12 April 2018 | Annals of Operations Research, Vol. 276, No. 1-2
- Dynamic Monitoring and Control of Irreversible Chronic Diseases with Application to Glaucoma
  1 May 2019 | Production and Operations Management, Vol. 28, No. 5
- Using a game-theoretic approach to design optimal health insurance for chronic disease
  15 April 2019 | IISE Transactions on Healthcare Systems Engineering, Vol. 9, No. 1
- Cost-effectiveness analysis of prognostic-based depression monitoring
  9 May 2019 | IISE Transactions on Healthcare Systems Engineering, Vol. 9, No. 1
- Optimal coinsurance rates for a heterogeneous population under inequality and resource constraints
  6 February 2019 | IISE Transactions, Vol. 51, No. 1
- Optimal Stopping for Medical Treatment with Predictive Information
  SSRN Electronic Journal, Vol. 60
- Population-level intervention and information collection in dynamic healthcare policy
  8 September 2017 | Health Care Management Science, Vol. 21, No. 4
- Designing Risk‐Adjusted Therapy for Patients with Hypertension
  1 December 2018 | Production and Operations Management, Vol. 27, No. 12
- Optimization of Sequential Decision Making for Chronic Diseases: From Data to Decisions
  Brian T. Denton
  19 October 2018
- Determining the optimal strategy for the live-attenuated herpes zoster vaccine in adults
  Vaccine, Vol. 36, No. 41
- Markov Decision Processes
  3 August 2018
- Personalized Medicine
  3 August 2018
- Application of Constrained Optimization Methods in Health Services Research: Report 2 of the ISPOR Optimization Methods Emerging Good Practices Task Force
  Value in Health, Vol. 21, No. 9
- Humanitarian medical supply chain in disaster response
  10 August 2018 | Journal of Humanitarian Logistics and Supply Chain Management, Vol. 8, No. 2
- MODELING CHRONIC HEPATITIS C DURING RAPID THERAPEUTIC ADVANCE
  9 February 2018
- USING FINITE‐HORIZON MARKOV DECISION PROCESSES FOR OPTIMIZING POST‐MAMMOGRAPHY DIAGNOSTIC DECISIONS
  9 February 2018
- Bayesian learning of dose–response parameters from a cohort under response-guided dosing
  European Journal of Operational Research, Vol. 265, No. 1
- Using claims data linked with electronic health records to monitor and improve adherence to medication
  29 June 2017 | IISE Transactions on Healthcare Systems Engineering, Vol. 7, No. 4
- Optimal Timing to Initiate Medical Treatment for a Disease Evolving as a Semi-Markov Process
  19 July 2017 | Journal of Optimization Theory and Applications, Vol. 175, No. 1
- An Overview of R in Health Decision Sciences
  6 January 2017 | Medical Decision Making, Vol. 37, No. 7
- Integrated testing strategies can be optimal for chemical risk classification
  Mathematical Biosciences, Vol. 290
- A stochastic model of acute-care decisions based on patient and provider heterogeneity
  21 October 2015 | Health Care Management Science, Vol. 20, No. 2
- Sensitivity Analysis in Sequential Decision Models
  29 September 2016 | Medical Decision Making, Vol. 37, No. 2
- Markov Decision Processes for Screening and Treatment of Chronic Diseases
  11 March 2017
- Living-Donor Liver Transplantation Timing under Ambiguous Health State Transition Probabilities
  SSRN Electronic Journal, Vol. 42
- Mining Major Transitions of Chronic Conditions in Patients with Multiple Chronic Conditions
  24 January 2018 | Methods of Information in Medicine, Vol. 56, No. 05
- A Modeling Framework for Control of Preventive Services
  E. Lerzan Örmeci,
  Evrim Didem Güneş,
  Derya Kunduzcu
  4 November 2015 | Manufacturing & Service Operations Management, Vol. 18, No. 2
- Designing Personalized Treatment: An Application to Anticoagulation Therapy
  1 May 2016 | Production and Operations Management, Vol. 25, No. 5
- An Innovative Framework to Improve Efficiency of Interhospital Transfer of Children in Respiratory Failure
  1 May 2016 | Annals of the American Thoracic Society, Vol. 13, No. 5
- Modelling adherence behaviour for the treatment of obstructive sleep apnoea
  European Journal of Operational Research, Vol. 249, No. 3
- Response-guided dosing for rheumatoid arthritis
  8 December 2015 | IIE Transactions on Healthcare Systems Engineering, Vol. 6, No. 1
- Markov Models and Cost Effectiveness Analysis: Applications in Medical Research
  10 September 2016
- Expert Systems in Mental Health Care
- Dynamic Monitoring and Control of Irreversible Chronic Diseases with Application to Glaucoma
  SSRN Electronic Journal, Vol. 69
- The Price of Nonabandonment: HIV in Resource-Limited Settings
  Amin Khademi,
  Denis R. Saure,
  Andrew J. Schaefer,
  Ronald S. Braithwaite,
  Mark S. Roberts
  29 June 2015 | Manufacturing & Service Operations Management, Vol. 17, No. 4
- Optimal Vascular Access Choice for Patients on Hemodialysis
  M. Reza Skandari,
  Steven M. Shechter,
  Nadia Zalunardo
  10 August 2015 | Manufacturing & Service Operations Management, Vol. 17, No. 4
- Dynamic Forecasting and Control Algorithms of Glaucoma Progression for Clinician Decision Support
  Jonathan E. Helm,
  Mariel S. Lavieri,
  Mark P. Van Oyen,
  Joshua D. Stein,
  David C. Musch
  9 September 2015 | Operations Research, Vol. 63, No. 5
- Behavioral Intervention Improves Treatment Outcomes Among HIV-Infected Individuals Who Have Delayed, Declined, or Discontinued Antiretroviral Therapy: A Randomized Controlled Trial of a Novel Intervention
  3 April 2015 | AIDS and Behavior, Vol. 19, No. 10
- Control-limit policies for a class of stopping time problems with termination restrictions
  31 December 2014 | Optimization Letters, Vol. 9, No. 7
- Characterizing workflow for pediatric asthma patients in emergency departments using electronic health records
  Journal of Biomedical Informatics, Vol. 57
- Optimally solving Markov decision processes with total expected discounted reward function: Linear programming revisited
  Computers & Industrial Engineering, Vol. 87
- Planning for HIV Screening, Testing, and Care at the Veterans Health Administration
  Sarang Deo,
  Kumar Rajaram,
  Sandeep Rath,
  Uday S. Karmarkar,
  Matthew B. Goetz
  4 March 2015 | Operations Research, Vol. 63, No. 2
- Improving the health-care delivery process at hospital emergency services by a better use of inpatient bed information
  Electronic Commerce Research and Applications, Vol. 14, No. 1
- From Data to Optimal Decision Making: A Data-Driven, Probabilistic Machine Learning Approach to Decision Support for Patients With Sepsis
  24 February 2015 | JMIR Medical Informatics, Vol. 3, No. 1
- Should Expectations about the Rate of New Antiretroviral Drug Development Impact the Timing of HIV Treatment Initiation and Expectations about Treatment Benefits?
  25 June 2014 | PLoS ONE, Vol. 9, No. 6
- Optimizing the simultaneous management of blood pressure and cholesterol for type 2 diabetes patients
  European Journal of Operational Research, Vol. 233, No. 3
- Improving Health Outcomes Through Better Capacity Allocation in a Community-Based Chronic Care Model
  Sarang Deo,
  Seyed Iravani,
  Tingting Jiang,
  Karen Smilowitz,
  Stephen Samuelson
  30 December 2013 | Operations Research, Vol. 61, No. 6
- Impact of health care payer type on HIV stage of illness at time of initiation of antiretroviral therapy in the USA
  AIDS Care, Vol. 25, No. 11
- State‐space size considerations for disease‐progression models
  23 April 2013 | Statistics in Medicine, Vol. 32, No. 22
- Optimal Policies for Reducing Unnecessary Follow-Up Mammography Exams in Breast Cancer Diagnosis
  Oguzhan Alagoz,
  Jagpreet Chhatwal,
  Elizabeth S. Burnside
  25 June 2013 | Decision Analysis, Vol. 10, No. 3
- Analyzing Screening Policies for Childhood Obesity
  Yan Yang,
  Jeremy D. Goldhaber-Fiebert,
  Lawrence M. Wein,
  5 November 2012 | Management Science, Vol. 59, No. 4
- Rescue therapy planning based on HIV genotyping testing
  Chemical Engineering Science, Vol. 93
- Optimal management of a limited number of replacements under Markovian deterioration
  IIE Transactions, Vol. 45, No. 2
- Disease Prevention, Detection, and Treatment
  23 January 2016
- Artificial intelligence framework for simulating clinical decision-making: A Markov decision process approach
  Artificial Intelligence in Medicine, Vol. 57, No. 1
- Balancing Immunological Benefits and Cardiovascular Risks of Antiretroviral Therapy: When Is Immediate Treatment Optimal?
  31 August 2012 | Clinical Infectious Diseases, Vol. 55, No. 10
- Initial Management Strategies for Follicular Lymphoma
  24 September 2012 | International Journal of Hematologic Oncology, Vol. 1, No. 1
- Efficient solutions for a class of optimal stopping problems
  Operations Research Letters, Vol. 40, No. 5
- When to treat prostate cancer patients based on their PSA dynamics
  IIE Transactions on Healthcare Systems Engineering, Vol. 2, No. 1
- Optimizing Statin Treatment Decisions for Diabetes Patients in the Presence of Uncertain Future Adherence
  29 April 2011 | Medical Decision Making, Vol. 32, No. 1
- Cost‐Effectiveness Analysis, Health‐Care Policy, and Operations Research Models
  14 January 2011
- MDP Basic Components
  14 January 2011
- Stochastic Dynamic Programming Models and Applications
  15 February 2011
- Treatment Evolution and New Standards of Care
  30 March 2010 | Medical Decision Making, Vol. 31, No. 1
- Improving Access to Community-Based Chronic Care Through Improved Capacity Allocation
  SSRN Electronic Journal, Vol. 50
- Markov Decision Processes: A Tool for Sequential Decision Making under Uncertainty
  31 December 2009 | Medical Decision Making, Vol. 30, No. 4
- Irreversible treatment decisions under consideration of the research and development pipeline for new therapies
  IIE Transactions, Vol. 42, No. 9
- Using Mechanistic Models to Simulate Comparative Effectiveness Trials of Therapy and to Estimate Long-term Outcomes in HIV Care
  Medical Care, Vol. 48, No. 6
- A Markov decision process approach to temporal modulation of dose fractions in radiation therapy planning
  26 June 2009 | Physics in Medicine and Biology, Vol. 54, No. 14
- Optimal Initiation and Management of Dialysis Therapy
  Chris P. Lee,
  Glenn M. Chertow,
  Stefanos A. Zenios,
  1 December 2008 | Operations Research, Vol. 56, No. 6
- Modeling hospital discharge policies for patients with pneumonia-related sepsis
  IIE Transactions, Vol. 40, No. 9
- A modeling framework for replacing medical therapies
  IIE Transactions, Vol. 40, No. 9

Volume 56, Issue 1

January-February 2008

Pages ii-266

Article Information

Supplemental Material

Metrics

Information

Received:December 01, 2005
Accepted:July 01, 2007
Published Online:February 01, 2008

Cite as

Steven M. Shechter, Matthew D. Bailey, Andrew J. Schaefer, Mark S. Roberts, (2008) The Optimal Time to Initiate HIV Therapy Under Ordered Health States. Operations Research 56(1):20-33.

https://doi.org/10.1287/opre.1070.0480

Keywords

PDF download

Available Issues

Available Issues

Available Issues

Available Issues

Available Issues

Available Issues

Available Issues

Available Issues

Available Issues

The Optimal Time to Initiate HIV Therapy Under Ordered Health States

Supplemental Material

Volume 56, Issue 1

Article Information

Supplemental Material

Metrics

Information

Cite as

Keywords

Sign Up for INFORMS Publications Updates and News