When to Push Ads: Optimal Mobile Ad Campaign Strategy Under Markov Customer Dynamics

References

• Aflaki S, Popescu I (2014) Managing retention in service relationships. Management Sci. 60(2):415–433.Link, Google Scholar
• Amin K, Rostamizadeh A, Syed U (2013) Learning prices for repeated auctions with strategic buyers. Burges CJC, Bottou L, Welling M, Ghahramani Z, Weinberger KQ, eds. Proc. 27th Annual Conf. Neural Inform. Processing Systems (Curran Associates Inc., Red Hook, NY), 1169–1177.Google Scholar
• Andrews M, Luo X, Fang Z, Ghose A (2016) Mobile ad effectiveness: Hyper-contextual targeting with crowdedness. Marketing Sci. 35(2):218–233.Link, Google Scholar
• Aravindakshan A, Naik PA (2015) Understanding the memory effects in pulsing advertising. Oper. Res. 63(1):35–47.Link, Google Scholar
• Bai X, Chen X, Stolyar AL (2022) Average cost optimality in partially observable lost-sales inventory systems. Oper. Res. 71(6):2390–2396.Link, Google Scholar
• Bastani H, Harsha P, Perakis G, Singhvi D (2022) Learning personalized product recommendations with customer disengagement. Manufacturing Service Oper. Management 24(4):2010–2028.Link, Google Scholar
• Bemmaor AC, Glady N (2012) Modeling purchasing behavior with sudden “death”: A flexible customer lifetime model. Management Sci. 58(5):1012–1021.Link, Google Scholar
• Bernstein F, Chakraborty S, Swinney R (2022) Intertemporal content variation with customer learning. Manufacturing Service Oper. Management 24(3):1664–1680.Link, Google Scholar
• Bertsekas D, Shreve SE (1996) Stochastic Optimal Control: The Discrete-Time Case, vol. 5 (Athena Scientific, Belmont, MA).Google Scholar
• Brodie RJ, Hollebeek LD, Jurić B, Ilić A (2011) Customer engagement: Conceptual domain, fundamental propositions, and implications for research. J. Service Res. 14(3):252–271.Crossref, Google Scholar
• Brown DB, Smith JE (2020) Index policies and performance bounds for dynamic selection problems. Management Sci. 66(7):3029–3050.Link, Google Scholar
• Brown DB, Zhang J (2022) Dynamic programs with shared resources and signals: Dynamic fluid policies and asymptotic optimality. Oper. Res. 70(5):3015–3033.Link, Google Scholar
• Brown DB, Zhang J (2023) Fluid policies, reoptimization, and performance guarantees in dynamic resource allocation. Oper. Res. 73(2):1029–1045.Link, Google Scholar
• Bumpensanti P, Wang H (2020) A re-solving heuristic with uniformly bounded loss for network revenue management. Management Sci. 66(7):2993–3009.Link, Google Scholar
• Chen L, Jain R, Luo H (2022a) Learning infinite-horizon average-reward Markov decision process with constraints. Chaudhuri K, Jegelka S, Song L, Szepesvari C, Niu G, Sabato S, eds. Proc. 39th Internat. Conf. Machine Learn. (PMLR, New York), 3246–3270.Google Scholar
• Chen X, Gao J, Ge D, Wang Z (2022b) Bayesian dynamic learning and pricing with strategic customers. Production Oper. Management 31(8):3125–3142.Crossref, Google Scholar
• Cooper WL (2002) Asymptotic behavior of an allocation policy for revenue management. Oper. Res. 50(4):720–727.Link, Google Scholar
• Da’u A, Salim N (2020) Recommendation system based on deep learning methods: A systematic review and new directions. Artificial Intelligence Rev. 53(4):2709–2748.Crossref, Google Scholar
• DeCroix G, Long X, Tong J (2021) How service quality variability hurts revenue when customers learn: Implications for dynamic personalized pricing. Oper. Res. 69(3):683–708.Link, Google Scholar
• Deloitte (2021) COVID-19 broke the orthodoxies of customer loyalty and retention. https://www2.deloitte.com/us/en/pages/consulting/articles/the-orthodoxies-of-loyalty.html.Google Scholar
• Fader PS, Hardie BG, Lee KL (2005) “Counting your customers” the easy way: An alternative to the Pareto/NBD model. Marketing Sci. 24(2):275–284.Link, Google Scholar
• Fader PS, Hardie BG, Shang J (2010) Customer-base analysis in a discrete-time noncontractual setting. Marketing Sci. 29(6):1086–1108.Link, Google Scholar
• Feinberg EA, Kasyanov PO, Zadoianchuk NV (2012) Average cost Markov decision processes with weakly continuous transition probabilities. Math. Oper. Res. 37(4):591–607.Link, Google Scholar
• Feinberg EA, Kasyanov PO, Zgurovsky MZ (2016) Partially observable total-cost Markov decision processes with weakly continuous transition probabilities. Math. Oper. Res. 41(2):656–681.Link, Google Scholar
• Gallego G (1992) A minmax distribution free procedure for the (Q, R) inventory model. Oper. Res. Lett. 11(1):55–60.Crossref, Google Scholar
• Gallego G, Topaloglu H (2019) Revenue Management and Pricing Analytics (Springer, Berlin).Crossref, Google Scholar
• Ghosh A, Zhou X, Shroff N (2023) Achieving sub-linear regret in infinite horizon average reward constrained MDP with linear function approximation. Proc. 17th Internat. Conf. Learn. Representations (OpenReview.net).Google Scholar
• Goldfarb A, Tucker C (2011) Online display advertising: Targeting and obtrusiveness. Marketing Sci. 30(3):389–404.Link, Google Scholar
• Guo X, Rieder U (2006) Average optimality for continuous-time Markov decision processes in Polish spaces. Ann. Appl. Probability 16(2):730–756.Crossref, Google Scholar
• Hahn M, Hyun JS (1991) Advertising cost interactions and the optimality of pulsing. Management Sci. 37(2):157–169.Link, Google Scholar
• Huang Y, Jasin S, Manchanda P (2019) “Level up”: Leveraging skill and engagement to maximize player game-play in online video games. Inform. Systems Res. 30(3):927–947.Link, Google Scholar
• Jain D, Singh SS (2002) Customer lifetime value research in marketing: A review and future directions. J. Interactive Marketing 16(2):34–46.Crossref, Google Scholar
• Jasin S, Kumar S (2012) A re-solving heuristic with bounded revenue loss for network revenue management with customer choice. Math. Oper. Res. 37(2):313–345.Link, Google Scholar
• Jiang J (2023) Constant approximation for network revenue management with Markovian-correlated customer arrivals. Preprint, submitted May 10, https://arxiv.org/abs/2305.05829.Google Scholar
• Kanoria Y, Lobel I, Lu J (2024) Managing customer churn via service mode control. Math. Oper. Res. 49(2):1192–1222.Link, Google Scholar
• KPMG (2020) Customer experience in the new reality. Accessed April 14, 2026, https://assets.kpmg.com/content/dam/kpmg/xx/pdf/2020/07/customer-experience-in-the-new-reality.pdf.Google Scholar
• Lan H, Gallego G, Wang Z, Ye Y (2026) LP-based control for network revenue management under markovian demands. Mavronicolas M, Qi Q, Schoenebeck G, eds. Proc. 20th Conf. Web Internet Econom. (Springer, Berlin), 476–493.Google Scholar
• Li G, Wang Z, Zhang J (2024) Infrequent resolving algorithm for online linear programming. Preprint, submitted August 1, https://arxiv.org/abs/2408.00465.Google Scholar
• Mahajan V, Muller E (1986) Advertising pulsing policies for generating awareness for new products. Marketing Sci. 5(2):89–106.Link, Google Scholar
• Meta (2024) Customer list formatting guidelines for custom audiences. Accessed April 14, 2026, https://www.facebook.com/business/help/2082575038703844.Google Scholar
• Mohri M, Munoz A (2015) Revenue optimization against strategic buyers. Cortes C, Lawrence ND, Lee DD, Sugiyama M, Garnett R, eds. Proc. 29th Annual Conf. Neural Inform. Processing Systems (Curran Associates Inc., Red Hook, NY), 2521–2529.Google Scholar
• Neslin SA, Van Heerde HJ (2009) Promotion dynamics. Foundations Trends Marketing 3(4):177–268.Crossref, Google Scholar
• Netzer O, Lattin JM, Srinivasan V (2008) A hidden Markov model of customer relationship dynamics. Marketing Sci. 27(2):185–204.Link, Google Scholar
• Portugal I, Alencar P, Cowan D (2018) The use of machine learning algorithms in recommender systems: A systematic review. Expert Systems Appl. 97:205–227.Crossref, Google Scholar
• Rafieian O, Yoganarasimhan H (2021) Targeting and privacy in mobile advertising. Marketing Sci. 40(2):193–218.Link, Google Scholar
• Reiman MI, Wang Q (2008) An asymptotically optimal policy for a quantity-based network revenue management problem. Math. Oper. Res. 33(2):257–282.Link, Google Scholar
• Ross SM (2013) Applied Probability Models with Optimization Applications (Dover Publications, Mineola, NY).Google Scholar
• Schmittlein DC, Morrison DG, Colombo R (1987) Counting your customers: Who are they and what will they do next? Management Sci. 33(1):1–24.Link, Google Scholar
• Schwartz EM, Bradlow ET, Fader PS (2014) Model selection using database characteristics: Developing a classification tree for longitudinal incidence data. Marketing Sci. 33(2):188–205.Link, Google Scholar
• Sheng L, Ryan CT, Nagarajan M, Cheng Y, Tong C (2022) Incentivized actions in freemium games. Manufacturing Service Oper. Management 24(1):275–284.Link, Google Scholar
• StackAdapt (2023) 5 tips for avoiding ad fatigue. Accessed April 14, 2026, https://www.stackadapt.com/resources/blog/ad-fatigue.Google Scholar
• Statista (2025) Share of global mobile website traffic. https://www.statista.com/statistics/277125/share-of-website-traffic-coming-from-mobile-devices/.Google Scholar
• Talluri K, Van Ryzin G (1998) An analysis of bid-price controls for network revenue management. Management Sci. 44(11):1577–1593.Link, Google Scholar
• TechSee (2022) New data shows post pandemic impact of customer loyalty resulting in increased likelihood to churn from poor service. Accessed April 14, 2026, https://www.prnewswire.com/news-releases/new-data-shows-post-pandemic-impact-of-customer-loyalty-resulting-in-increased-likelihood-to-churn-from-poor-service-301606607.html.Google Scholar
• The New York Times (2019) The advertising industry has a problem: People hate ads. Accessed April 14, 2026, https://www.nytimes.com/2019/10/28/business/media/advertising-industry-research.html.Google Scholar
• UNCTAD (2020) COVID-19 has changed online shopping forever, survey shows. Accessed April 14, 2026, https://unctad.org/news/covid-19-has-changed-online-shopping-forever-survey-shows.Google Scholar
• Vera A, Banerjee S, Gurvich I (2021) Online allocation and pricing: Constant regret via bellman inequalities. Oper. Res. 69(3):821–840.Link, Google Scholar
• VMR (2024) Global mobile engagement market size. Accessed April 14, 2026, https://www.verifiedmarketresearch.com/product/mobile-engagement-market/.Google Scholar
• Whittle P (1988) Restless bandits: Activity allocation in a changing world. J. Appl. Probability 25(A):287–298.Crossref, Google Scholar
• Zhang Y, Li B, Luo X, Wang X (2019) Personalized mobile targeting with user engagement stages: Combining a structural hidden Markov model and field experiment. Inform. Systems Res. 30(3):787–804.Link, Google Scholar