A Stochastic Game Analysis of Incentives and Behavioral Barriers in Chronic Disease Management

References

• Alagoz O, Chhatwal J, Burnside ES (2013) Optimal policies for reducing unnecessary follow-up mammography exams in breast cancer diagnosis. Decision Anal. 10(3):200–224.Link, Google Scholar
• Alagoz O, Maillart LM, Schaefer AJ, Roberts MS (2004) The optimal timing of living-donor liver transplantation. Management Sci. 50(10):1420–1430.Link, Google Scholar
• Bodenheimer T, Wagner EH, Grumbach K (2002) Improving primary care for patients with chronic illness. Jama 288(14):1775–1779.Crossref, Google Scholar
• Boronico JS, Newbert SL (2001) An empirically driven mathematical modelling analysis for play calling strategy in American football. Eur. Sport Management Quart. 1(1):21–38.Crossref, Google Scholar
• Brown R, Peikes D, Peterson G, Schore J (2009) The promise of care coordination: Models that decrease hospitalizations and improve outcomes for beneficiaries with chronic illnesses. Center for Health Care Strategies Webinar. Accessed May 15, 2018, https://cire.mathematica-mpr.com/~/media/publications/pdfs/health/care_coordination_models.pdf.Google Scholar
• Campbell NC, Thain J, Deans HG, Ritchie LD, Rawles JM, Squair JL (1998) Secondary prevention clinics for coronary heart disease: Randomised trial of effect on health. BMJ 316(7142):1434–1437.Crossref, Google Scholar
• Cohen J, Neumann P (2009) The Cost Savings and Cost-Effectiveness of Clinical Preventive Care (Robert Wood Johnson Foundation, Princeton, NJ).Google Scholar
• Coleman E, Eilertsen T, Kramer A, Magid D, Beck A, Conner D (2001) Reducing emergency visits in older adults with chronic illness. A randomized, controlled trial of group visits. Effective Clinical Practice 4(2):49–57.Google Scholar
• DeVol R, Bedroussian A, Charuworn A, Chatterjee A, Kim K, Kim S (2007) An unhealthy America: The economic burden of chronic disease. Milken Institute Rev., (October 1), http://www.milkeninstitute.org/publications/view/321.Google Scholar
• Eborall H, Davies R, Kinmonth A-L, Griffin S, Lawton J (2007) Patients’ experiences of screening for type 2 diabetes: Prospective qualitative study embedded in the addition (Cambridge) randomised controlled trial. BMJ 335(7618):490.Crossref, Google Scholar
• Filar JA (1980) Algorithms for solving some undiscounted stochastic games. Doctoral thesis, University of Illinois, Chicago.Google Scholar
• Filar JA, Raghavan T (1984) A matrix game solution of the single-controller stochastic game. Math. Oper. Res. 9(3):356–362.Link, Google Scholar
• Filar JA, Vrieze K (2012) Competitive Markov Decision Processes (Springer Science and Business Media, New York).Google Scholar
• Francisco VT, Paine AL, Fawcett SB, Johnston J, Banks D (1994) An experimental evaluation of an incentive program to reduce serum cholesterol levels among health fair participants. Arch. Family Medicine 3(3):246–251.Crossref, Google Scholar
• Ganji A, Khalili D, Karamouz M (2007) Development of stochastic dynamic Nash game model for reservoir operation. I. The symmetric stochastic model with perfect information. Adv. Water Resources 30(3):528–542.Crossref, Google Scholar
• Göhler A, Geisler BP, Manne JM, Kosiborod M, Zhang Z, Weintraub WS, Spertus JAet al. (2009) Utility estimates for decision-analytic modeling in chronic heart failure health states based on New York Heart Association classes and number of rehospitalizations. Value Health 12(1):185–187.Crossref, Google Scholar
• Haskell WL, Alderman EL, Fair JM, Maron DJ, Mackey SF, Superko HR, Williams PTet al. (1994) Effects of intensive multiple risk factor reduction on coronary atherosclerosis and clinical cardiac events in men and women with coronary artery disease: The Stanford Coronary Risk Intervention Project (SCRIP). Circulation 89(3):975–990.Crossref, Google Scholar
• Heidenreich PA, Trogdon JG, Khavjou OA, Butler J, Dracup K, Ezekowitz MD, Finkelstein EAet al. (2011) Forecasting the future of cardiovascular disease in the United States: A policy statement from the American Heart Association. Circulation 123(8):933–944.Crossref, Google Scholar
• Hey JD, Patel MS (1983) Prevention and cure: Is an ounce of prevention worth a pound of cure. J. Health Econom. 2(2):119–138.Crossref, Google Scholar
• Holman H, Lorig K (2004) Patient self-management: A key to effectiveness and efficiency in care of chronic disease. Public Health Reports 119(3):239–243.Crossref, Google Scholar
• Holtrop JS, Luo Z, Alexanders L (2015) Inadequate reimbursement for care management to primary care offices. J. Amer. Board Family Medicine 28(2):271–279.Crossref, Google Scholar
• Huang JW, Krishnamurthy V (2009) Game theoretic issues in cognitive radio systems. J. Comm. 4(10):790–802.Crossref, Google Scholar
• Hunt SA, Abraham WT, Chin MH, Feldman AM, Francis GS, Ganiats TG, Jessup Met al. (2005) ACC/AHA 2005 guideline update for the diagnosis and management of chronic heart failure in the adult—summary article: A report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines (Writing Committee to Update the 2001 Guidelines for the Evaluation and Management of Heart Failure): Developed in collaboration with the American College of Chest Physicians and the International Society for Heart and Lung Transplantation: Endorsed by the Heart Rhythm Society. Circulation 112(12):1825–1852.Google Scholar
• Kourlaba G, Parissis J, Karavidas A, Beletsi A, Milonas C, Branscombe N, Maniadakis N (2014) Economic evaluation of ivabradine in the treatment of chronic heart failure in Greece. BMC Health Services Res. 14(1):631.Crossref, Google Scholar
• Lye K, Wing JM (2005) Game strategies in network security. Internat. J. Inform. Security 4(1):71–86.Crossref, Google Scholar
• Maillart LM, Ivy JS, Ransom S, Diehl K (2008) Assessing dynamic breast cancer screening policies. Oper. Res. 56(6):1411–1427.Link, Google Scholar
• McEneaney WM, Fitzpatrick BG, Lauko IG (2004) Stochastic game approach to air operations. IEEE Trans. Aerospace Electronic Systems 40(4):1191–1216.Crossref, Google Scholar
• McPhee SJ, Schroeder SA (1987) Promoting preventive care: Changing reimbursement is not enough. Amer. J. Public Health 77(7):780–781.Crossref, Google Scholar
• Ornish D, Brown SE, Billings J, Scherwitz L, Armstrong WT, Ports TA, McLanahan SMet al. (1990) Can lifestyle changes reverse coronary heart disease? The lifestyle heart trial. Lancet 336(8708):129–133.Crossref, Google Scholar
• Park H, Clear T, Rouse WB, Basole RC, Braunstein ML, Brigham KL, Cunningham L (2012) Multilevel simulations of health delivery systems: A prospective tool for policy, strategy, planning, and management. Service Sci. 4(3):253–268.Link, Google Scholar
• Parthasarathy T, Tijs SH, Vrieze OJ (1984) Stochastic games with state independent transitions and separable rewards. Hammer G, Pallaschke D, eds. Selected Topics in Operations Research and Mathematical Economics. Lecture Notes in Economics and Mathematical Systems, Vol. 226 (Springer, Berlin), 262–271.Crossref, Google Scholar
• Paul JA, MacDonald L, Hariharan G (2014) Modeling risk factors and disease conditions to study associated lifetime medical costs. Service Sci. 6(1):47–62.Link, Google Scholar
• Pliskin JS, Shepard DS, Weinstein MC (1980) Utility functions for life years and health status. Oper. Res. 28(1):206–224.Link, Google Scholar
• Prasad H, Bhatnagar S (2012) General-sum stochastic games: Verifiability conditions for Nash equilibria. Automatica 48(11):2923–2930.Crossref, Google Scholar
• Raghavan TE, Tijs S, Vrieze O (1985) On stochastic games with additive reward and transition structure. J. Optim. Theory Appl. 47(4):451–464.Crossref, Google Scholar
• Reinganum JF (1981) Dynamic games of innovation. J. Econom. Theory 25(1):21–41.Crossref, Google Scholar
• Reiter KL, Nahra TA, Alexander JA, Wheeler JRC (2006) Hospital responses to pay-for-performance incentives. Health Services Management Res. 19(2):123–134.Crossref, Google Scholar
• Sassi F, Hurst J (2008) The prevention of lifestyle-related chronic diseases: An economic framework. Working paper, Organisation for Economic Cooperation and Development (OECD), Paris.Google Scholar
• Schaefer AJ, Bailey MD, Shechter SM, Roberts MS (2005) Modeling medical treatment using Markov decision processes. Brandeau ML, Sainfort F, Pierskalla WP, eds. Operations Research and Health Care. International Series in Operations Research and Management Science, Vol. 70 (Springer, Boston), 593–612.Crossref, Google Scholar
• Shapley LS (1953) Stochastic games. Proc. National Acad. Sci. USA 39(10):1095–1100.Crossref, Google Scholar
• Sheeran P, Abraham C (1996) The health belief model. Conner M, Norman P, eds. Predicting Health Behaviour: Research and Practice with Social Cognition Models (Open University Press, Maidenhead, UK), 23–61.Google Scholar
• Strecher VJ, Rosenstock IM (1997) The health belief model. Baum A, ed. Cambridge Handbook of Psychology, Health and Medicine (Cambridge University Press, Cambridge, UK), 113–117.Google Scholar
• Thuijsman F (1992) Optimality and Equilibria in Stochastic Games. CWI Tract, Vol. 82 (Centrum voor Wiskunde en Informatica, Amsterdam).Google Scholar
• Thuijsman F, Raghavan TES (1997) Perfect information stochastic games and related classes. Internat. J. Game Theory 26(3):403–408.Crossref, Google Scholar
• Vrieze O, Tijs S, Raghavan TES, Filar JA (1983) A finite algorithm for the switching control stochastic game. Oper. Res. Spektrum 5(1):15–24.Crossref, Google Scholar
• Yancy CW, Jessup M, Bozkurt B, Butler J, Casey DE, Drazner MH, Fonarow GCet al. (2013) 2013 ACCF/AHA guideline for the management of heart failure: A report of the American College of Cardiology Foundation/American Heart Association Task Force on Practice Guidelines. J. Amer. College Cardiology 62(16):e147–e239.Crossref, Google Scholar
• Yao G, Freemantle N, Calvert MJ, Bryan S, Daubert J, Cleland JG (2007) The long-term cost-effectiveness of cardiac resynchronization therapy with or without an implantable cardioverter-defibrillator. Eur. Heart J. 28(1):42–51.Crossref, Google Scholar
• Yarnall KSH, Pollak KI, Stbye T, Krause KM, Michener JL (2003) Primary care: Is there enough time for prevention? Amer. J. Public Health 93(4):635–641.Crossref, Google Scholar
• Yusuf S, Reddy S, Ounpuu S, Anand S (2001) Global burden of cardiovascular diseases: Part II: Variations in cardiovascular disease by specific ethnic groups and geographic regions and prevention strategies. Circulation 104(23):2855–2864.Crossref, Google Scholar
• Zhang H, Wernz C, Hughes DR (2018) Modeling and designing health care payment innovations for medical imaging. Health Care Management Sci. 21(1):37–51.Crossref, Google Scholar
• Zhang H, Wernz C, Slonim AD (2016) Aligning incentives in health care: A multiscale decision theory approach. EURO J. Decision Processes 4(3–4):219–244.Crossref, Google Scholar