Platelet Inventory Management with Approximate Dynamic Programming

References

• Abouee-Mehrizi H, Mirjalili M, Sarhangian V (2022) Data-driven platelet inventory management under uncertainty in the remaining shelf-life of units. Production Oper. Management 31(10):3914–3932.Crossref, Google Scholar
• Abouee-Mehrizi H, Mirjalili M, Sarhangian V (2025) Platelet inventory management with approximate dynamic programming. http://dx.doi.org/10.1287/ijoc.2023.0245.cd, https://github.com/INFORMSJoC/2023.0245.Google Scholar
• Astaraky D, Patrick J (2015) A simulation based approximate dynamic programming approach to multi-class, multi-resource surgical scheduling. Eur. J. Oper. Res. 245(1):309–319.Crossref, Google Scholar
• Ban GY, Rudin C (2019) The big data newsvendor: Practical insights from machine learning. Oper. Res. 67(1):90–108.Link, Google Scholar
• Bertsekas DP (2011) Dynamic Programming and Optimal Control, vol. II, 3rd ed. (Athena Scientific, Belmont, MA).Google Scholar
• Bertsekas DP, Tsitsiklis JN (1996) Neuro-Dynamic Programming (Athena Scientific, Belmont, MA).Google Scholar
• Brodheim E, Derman C, Prastacos G (1975) On the evaluation of a class of inventory policies for perishable products such as blood. Management Sci. 21(11):1320–1325.Link, Google Scholar
• Brown DB, Haugh MB (2017) Information relaxation bounds for infinite horizon Markov decision processes. Oper. Res. 65(5):1355–1379.Link, Google Scholar
• Brown DB, Smith JE (2022) Information relaxations and duality in stochastic dynamic programs: A review and tutorial. Foundations Trends Optim. 5(3):246–339.Crossref, Google Scholar
• Brown DB, Smith JE, Sun P (2010) Information relaxations and duality in stochastic dynamic programs. Oper. Res. 58(4 Part 1):785–801.Link, Google Scholar
• Bu J, Gong X, Chao X (2023) Asymptotic optimality of base-stock policies for perishable inventory systems. Management Sci. 69(2):846–864.Link, Google Scholar
• Chao X, Gong X, Shi C, Zhang H (2015) Approximation algorithms for perishable inventory systems. Oper. Res. 63(3):585–601.Link, Google Scholar
• Chen S, Li Y, Yang Y, Zhou W (2021) Managing perishable inventory systems with age-differentiated demand. Production Oper. Management 30(10):3784–3799.Crossref, Google Scholar
• Chen X, Pang Z, Pan L (2014) Coordinating inventory control and pricing strategies for perishable products. Oper. Res. 62(2):284–300.Link, Google Scholar
• Civelek I, Karaesmen I, Scheller-Wolf A (2015) Blood platelet inventory management with protection levels. Eur. J. Oper. Res. 243(3):826–838.Crossref, Google Scholar
• Cooper WL (2001) Pathwise properties and performance bounds for a perishable inventory system. Oper. Res. 49(3):455–466.Link, Google Scholar
• Dai JG, Shi P (2019) Inpatient overflow: An approximate dynamic programming approach. Manufacturing Service Oper. Management 21(4):894–911.Link, Google Scholar
• De Farias DP, Van Roy B (2003) The linear programming approach to approximate dynamic programming. Oper. Res. 51(6):850–865.Link, Google Scholar
• Deniz B, Karaesmen I, Scheller-Wolf A (2010) Managing perishables with substitution: Inventory issuance and replenishment heuristics. Manufacturing Service Oper. Management 12(2):319–329.Link, Google Scholar
• Farrington J, Li K, Wong WK, Utley M (2023) Going faster to see further: GPU-accelerated value iteration and simulation for perishable inventory control using JAX. Preprint, submitted March 19, https://arxiv.org/abs/2303.10672.Google Scholar
• Free RJ, Sapiano MR, Chavez Ortiz JL, Stewart P, Berger J, Basavaraju SV (2023) Continued stabilization of blood collections and transfusions in the United States: Findings from the 2021 National Blood Collection and Utilization Survey. Transfusion 63(Suppl 4):S8–S18.Crossref, Google Scholar
• Fries BE (1975) Optimal ordering policy for a perishable commodity with fixed lifetime. Oper. Res. 23(1):46–61.Link, Google Scholar
• Glasserman P, Yao DD (1992) Some guidelines and guarantees for common random numbers. Management Sci. 38(6):884–908.Link, Google Scholar
• Gocgun Y, Puterman ML (2014) Dynamic scheduling with due dates and time windows: An application to chemotherapy patient appointment booking. Health Care Management Sci. 17(1):60–76.Crossref, Google Scholar
• Guan L, Tian X, Gombar S, Zemek AJ, Krishnan G, Scott R, Narasimhan B, Tibshirani RJ, Pham TD (2017) Big data modeling to predict platelet usage and minimize wastage in a tertiary care system. Proc. Natl. Acad. Sci. USA 114(43):11368–11373.Crossref, Google Scholar
• Haijema R, van Dijk NM, van der Wal J (2017) Blood platelet inventory management. Boucherie R, van Dijk N, eds. Markov Decision Processes in Practice, International Series in Operations Research & Management Science, vol. 248 (Springer, Cham, Switzerland), 293–317.Crossref, Google Scholar
• Karaesmen IZ, Scheller-Wolf A, Deniz B (2011) Managing perishable and aging inventories: Review and future research directions. Kempf K, Keskinocak P, Uzsoy R, eds. Planning Production and Inventories in the Extended Enterprise, International Series in Operations Research & Management Science, vol. 151 (Springer, New York), 393–436.Crossref, Google Scholar
• Ke J, Zhang D, Zheng H (2019) An approximate dynamic programming approach to dynamic pricing for network revenue management. Production Oper. Management 28(11):2719–2737.Crossref, Google Scholar
• Levi R, Pál M, Roundy RO, Shmoys DB (2007) Approximation algorithms for stochastic inventory control models. Math. Oper. Res. 32(2):284–302.Link, Google Scholar
• Li N, Chiang F, Down DG, Heddle NM (2021) A decision integration strategy for short-term demand forecasting and ordering for red blood cell components. Oper. Res. Health Care 29:100290.Crossref, Google Scholar
• Li N, Arnold DM, Down DG, Barty R, Blake J, Chiang F, Courtney T, Waito M, Trifunov R, Heddle NM (2022) From demand forecasting to inventory ordering decisions for red blood cells through integrating machine learning, statistical modeling, and inventory optimization. Transfusion 62(1):87–99.Crossref, Google Scholar
• Li N, Pham T, Cheng C, McElfresh DC, Metcalf RA, Russell WA, Birch R, et al. (2023) Blood demand forecasting and supply management: An analytical assessment of key studies utilizing novel computational techniques. Transfusion Medicine Rev. 37(4):150768.Crossref, Google Scholar
• Li Q, Yu P (2014) Multimodularity and its applications in three stochastic dynamic inventory problems. Manufacturing Service Oper. Management 16(3):455–463.Link, Google Scholar
• Maxwell MS, Henderson SG, Topaloglu H (2013) Tuning approximate dynamic programming policies for ambulance redeployment via direct search. Stochastic Systems 3(2):322–361.Link, Google Scholar
• Maxwell MS, Restrepo M, Henderson SG, Topaloglu H (2010) Approximate dynamic programming for ambulance redeployment. INFORMS J. Comput. 22(2):266–281.Link, Google Scholar
• Mirjalili M, Abouee Mehrizi H, Barty R, Heddle NM, Sarhangian V (2022) A data-driven approach to determine daily platelet order quantities at hospitals. Transfusion 62(10):2048–2056.Crossref, Google Scholar
• Motamedi M, Down DG, Li N (2024) Optimal ordering policy for perishable products by incorporating demand forecasts. Preprint, submitted April 25, http://dx.doi.org/10.2139/ssrn.4807963.Google Scholar
• Nahmias S (1975) Optimal ordering policies for perishable inventory—II. Oper. Res. 23(4):735–749.Link, Google Scholar
• Nahmias S (1976) Myopic approximations for the perishable inventory problem. Management Sci. 22(9):1002–1008.Link, Google Scholar
• Nahmias S (1977) On ordering perishable inventory when both demand and lifetime are random. Management Sci. 24(1):82–90.Link, Google Scholar
• Nahmias S (1978) The fixed-charge perishable inventory problem. Oper. Res. 26(3):464–481.Link, Google Scholar
• Nahmias S (2011) Perishable Inventory Systems, vol. 160 (Springer Science & Business Media, New York).Crossref, Google Scholar
• Nahmias S, Pierskalla WP (1973) Optimal ordering policies for a product that perishes in two periods subject to stochastic demand. Naval Res. Logist. Quart. 20(2):207–229.Crossref, Google Scholar
• Nandakumar P, Morton TE (1993) Near myopic heuristics for the fixed-life perishability problem. Management Sci. 39(12):1490–1498.Link, Google Scholar
• Nelson B, Pei L (2021) Foundations and Methods of Stochastic Simulation: A First Course, International Series in Operations Research & Management Science (Springer, Cham, Switzerland).Crossref, Google Scholar
• Powell WB (2007) Approximate Dynamic Programming: Solving the Curses of Dimensionality, vol. 703 (John Wiley & Sons, Hoboken, NJ).Crossref, Google Scholar
• Puterman ML (1994) Markov Decision Processes: Discrete Stochastic Dynamic Programming (John Wiley & Sons, Hoboken, NJ).Crossref, Google Scholar
• Rajendran S, Srinivas S (2020) Hybrid ordering policies for platelet inventory management under demand uncertainty. IISE Trans. Healthcare Systems Engrg. 10(2):113–126.Crossref, Google Scholar
• Sauré A, Begen MA, Patrick J (2020) Dynamic multi-priority, multi-class patient scheduling with stochastic service times. Eur. J. Oper. Res. 280(1):254–265.Crossref, Google Scholar
• Sauré A, Patrick J, Puterman ML (2015) Simulation-based approximate policy iteration with generalized logistic functions. INFORMS J. Comput. 27(3):579–595.Link, Google Scholar
• Sauré A, Patrick J, Tyldesley S, Puterman ML (2012) Dynamic multi-appointment patient scheduling for radiation therapy. Eur. J. Oper. Res. 223(2):573–584.Crossref, Google Scholar
• Scarf H (1960) The optimality of (S,s) policies in the dynamic inventory problem. Arrow KJ, Karlin S, Suppes P, eds. Math. Methods Soc. Sci. 1959 Proc. First Stanford Sympos. (Stanford University Press, Stanford, CA), 196–202.Google Scholar
• Sun P, Wang K, Zipkin P (2014) Quadratic approximation of cost functions in lost sales and perishable inventory control problems. Working paper, Fuqua School of Business, Duke University, Durham, NC.Google Scholar
• Sutton RS (1988) Learning to predict by the methods of temporal differences. Machine Learn. 3(1):9–44.Crossref, Google Scholar
• Watkins CJCH, Dayan P (1992) Technical note: Q-learning. Machine Learn. 8(3):279–292.Crossref, Google Scholar
• Zhang C, Ayer T, White CC III (2023) Truncated balancing policy for perishable inventory management: Combating high shortage penalties. Manufacturing Service Oper. Management 25(6):2352–2370.Abstract, Google Scholar
• Zhou D, Leung LC, Pierskalla WP (2011) Inventory management of platelets in hospitals: Optimal inventory policy for perishable products with regular and optional expedited replenishments. Manufacturing Service Oper. Management 13(4):420–438.Link, Google Scholar