Dynamic Contract Design with Learning

References

• Amin K, Rostamizadeh A, Syed U (2013) Learning prices for repeated auctions with strategic buyers. Burges CJC, Bottou L, Welling M, Ghahramani Z, Weinberger KQ, eds. NIPS’13: Proc. 27th Internat. Conf. Neural Inform. Processing Systems, vol. 1 (Curran Associates, Inc., Red Hook, NY), 1169–1177.Google Scholar
• Amin K, Rostamizadeh A, Syed U (2014) Repeated contextual auctions with strategic buyers. Ghahramani Z, Welling M, Cortes C, Lawrence ND, Weinberger KQ, eds. NIPS’14: Proc. 28th Internat. Conf. Neural Inform. Processing Systems, vol. 1 (Curran Associates, Inc., Red Hook, NY), 622–630.Google Scholar
• Auer P, Cesa-Bianchi N, Fischer P (2002) Finite-time analysis of the multiarmed bandit problem. Machine Learn. 47(2):235–256.Crossref, Google Scholar
• Biais B, Mariotti T, Rochet JC, Villeneuve S (2010) Large risks, limited liability, and dynamic moral hazard. Econometrica 78(1):73–118.Crossref, Google Scholar
• Cao P, Sun P, Tian F (2023) Punish underperformance with suspension: Optimal dynamic contracts in the presence of switching cost. Management Sci. 70(5):3020–3037.Link, Google Scholar
• Dawande M, Janakiraman G, Qi A, Wu Q (2019) Optimal incentive contracts in project management. Production Oper. Management 28(6):1431–1445.Crossref, Google Scholar
• DeMarzo PM, Sannikov Y (2017) Learning, termination, and payout policy in dynamic incentive contracts. Rev. Econom. Stud. 84(1):182–236.Crossref, Google Scholar
• Doepke M, Townsend RM (2006) Dynamic mechanism design with hidden income and hidden actions. J. Econom. Theory 126(1):235–285.Crossref, Google Scholar
• Fernandes A, Phelan C (2000) A recursive formulation for repeated agency with history dependence. J. Econom. Theory 91(2):223–247.Crossref, Google Scholar
• Georgiadis G, Powell M (2022) A/B contracts. Amer. Econom. Rev. 112(1):267–303.Crossref, Google Scholar
• Gibbons R, Murphy KJ (1992) Optimal incentive contracts in the presence of career concerns: Theory and evidence. J. Political Econom. 100(3):468–505.Crossref, Google Scholar
• Grossman SJ, Hart OD (1983) An analysis of the principal-agent problem. Econometrica 51(1):7–45.Crossref, Google Scholar
• Gupta S, Chen W, Dawande M, Janakiraman G (2022) Three years, two papers, one course off: Optimal nonmonetary reward policies. Management Sci. 69(5):2852–2869.Link, Google Scholar
• He Z, Wei B, Yu J, Gao F (2017) Optimal long-term contracting with learning. Rev. Financial Stud. 30(6):2006–2065.Crossref, Google Scholar
• Holmström B (1979) Moral hazard and observability. Bell J. Econom. 10(1):74–91.Crossref, Google Scholar
• Holmström B (1999) Managerial incentive problems: A dynamic perspective. Rev. Econom. Stud. 66(1):169–182.Crossref, Google Scholar
• Kaynar N, Siddiq A (2022) Estimating effects of incentive contracts in online labor platforms. Management Sci. 69(4):2106–2126.Link, Google Scholar
• Lattimore T, Szepesvári C (2020) Bandit Algorithms (Cambridge University Press, Cambridge, UK).Crossref, Google Scholar
• Li S, Mehrotra S (2025) Adaptive learning in uncertain and sequential competition. Oper. Res. 74(1):301–338.Link, Google Scholar
• Liang Y, Sun P, Tang R, Zhang C (2022) Efficient resource allocation contracts to reduce adverse events. Oper. Res. 71(5):1889–1907.Link, Google Scholar
• Mintz Y, Aswani A, Kaminsky P, Flowers E, Fukuoka Y (2020) Nonstationary bandits with habituation and recovery dynamics. Oper. Res. 68(5):1493–1516.Link, Google Scholar
• Prat J, Jovanovic B (2014) Dynamic contracts when the agent’s quality is unknown. Theoret. Econom. 9(3):865–914.Crossref, Google Scholar
• Rogerson WP (1985) Repeated moral hazard. Econometrica 53(1):69–76.Crossref, Google Scholar
• Sannikov Y (2008) A continuous-time version of the principal-agent problem. Rev. Econom. Stud. 75(3):957–984.Crossref, Google Scholar
• Shalev-Shwartz S (2011) Online learning and online convex optimization. Foundations Trends Machine Learn. 4(2):107–194.Crossref, Google Scholar
• Slivkins A (2019) Introduction to multi-armed bandits. Foundations Trends Machine Learn. 12(1–2):1–286.Crossref, Google Scholar
• Spear SE, Srivastava S (1987) On repeated moral hazard with discounting. Rev. Econom. Stud. 54(4):599–617.Crossref, Google Scholar
• Sun P, Tian F (2017) Optimal contract to induce continued effort. Management Sci. 64(9):4193–4217.Link, Google Scholar
• Sutton RS, Barto AG (2018) Reinforcement Learning: An Introduction, 2nd ed. (MIT Press, Cambridge, MA).Google Scholar
• Yang Y, Lee YC, Chen PA (2024) Competitive demand learning: A noncooperative pricing algorithm with coordinated price experimentation. Production Oper. Management 33(1):48–68.Crossref, Google Scholar
• Zhang H, Zenios S (2007) A dynamic principal-agent model with hidden information: Sequential optimality through truthful state revelation. Oper. Res. 56(3):681–696.Link, Google Scholar
• Zhao X, Zhu R, Haskell WB (2025) Learning to price supply chain contracts against a learning retailer. Management Sci. 72(3):2168–2187.Link, Google Scholar
• Zhu B, Bates S, Yang Z, Wang Y, Jiao J, Jordan MI (2023) The sample complexity of online contract design. EC’23: Proc. 24th ACM Conf. Econom. Comput. (Association for Computing Machinery, New York), 1188.Google Scholar
• Zorc S, Tsetlin I, Hasija S, Chick SE (2023) The when and how of delegated search. Oper. Res. 73(1):461–482.Link, Google Scholar