Efficiently Evaluating Targeting Policies: Improving on Champion vs. Challenger Experiments

References

• Dubé J-P, Misra S (2017) Scalable price targeting. Working paper, University of Chicago, Chicago.Google Scholar
• Dudík M, Langford J, Li L (2011) Doubly robust policy evaluation and learning. Proc. 28th Internat. Conf. Machine Learn., Bellevue, Washington, 1097–1104.Google Scholar
• Eicker F (1967) Limit theorems for regression with unequal and dependent errors. Proc. 5th Berkeley Sympos. Math. Statist. Probab. (University of California Press, Berkeley), 59–82.Google Scholar
• Hitsch G, Misra S (2018) Heterogeneous treatment effects and optimal targeting policy. Working paper, University of Chicago, Chicago.Google Scholar
• Horvitz DG, Thompson DJ (1952) A generalization of sampling without replacement from a finite universe. J. Amer. Statist. Assoc. 47(260):663–685.Crossref, Google Scholar
• Huber PJ (1967) The behavior of maximum likelihood estimates under nonstandard conditions. Proc. 5th Berkeley Sympos. Math. Statist. Probab. (University of California Press, Berkeley), 221–233.Google Scholar
• Johnson GA, Lewis RA, Nubbemeyer EI (2017) Ghost ads: Improving the economics of measuring online ad effectiveness. J. Marketing Res. 54(6):867–884.Crossref, Google Scholar
• Johnson GA, Lewis RA, Reiley DH (2016) When less is more: Data and power in advertising experiments. Marketing Sci. 36(1):43–53.Link, Google Scholar
• Langford J, Strehl A, Wortman J (2008) Exploration scavenging. Proc. 25th Internat. Conf. Machine Learn. (ACM, New York), 528–535.Google Scholar
• Mantrala MK, Seetharaman PB, Kaul R, Gopalakrishna S, Stam A (2006) Optimal pricing strategies for an automotive aftermarket retailer. J. Marketing Res. 43(4):588–604.Crossref, Google Scholar
• Ostrovsky M, Schwarz M (2011) Reserve prices in internet advertising auctions: A field experiment. Proc. 12th ACM Conf. Electronic Commerce (ACM, New York), 59–60.Google Scholar
• Rafieian O, Yoganarasimhan H (2018) Targeting and privacy in mobile advertising. Working paper, University of Washington, Seattle.Google Scholar
• Simester D, Sun P, Tsitsiklis JN (2006) Dynamic catalog mailing policies. Management Sci. 52(5):683–696.Link, Google Scholar
• Simester D, Timoshenko A, Zoumpoulis SI (2019) Targeting prospective customers: Robustness of machine learning methods to typical data challenges. Management Sci., ePub ahead of print November 15, https://doi.org/10.1287/mnsc.2019.3308.Link, Google Scholar
• Skiera B, Nabout NA (2013) PROSAD: A bidding decision support system for profit optimizing search engine advertising. Marketing Sci. 32(2):213–220.Link, Google Scholar
• Strehl AL, Langford J, Li L, Kakade SM (2010) Learning from logged implicit exploration data. Proc. 23rd Internat. Conf. Neural Inform. Processing Systems, vol. 2 (Neural Information Processing Systems, San Diego), 2217–2225.Google Scholar
• Sutton RS, Barto AG (1998) Introduction to Reinforcement Learning, 1st ed. (MIT Press, Cambridge, MA).Crossref, Google Scholar
• White H (1980) A heteroskedasticity-consistent covariance matrix estimator and a direct test for heteroskedasticity. Econometrica 48(4):817–838.Crossref, Google Scholar