Multicell Experiments for Marginal Treatment Effect Estimation of Digital Ads

References

• Baardman L, Fata E, Pani A, Perakis G (2019) Learning optimal online advertising portfolios with periodic budgets. Preprint, submitted March 27, https://dx.doi.org/10.2139/ssrn.3346642.Google Scholar
• Barajas J, Bhamidipati N (2021) Incrementality testing in programmatic advertising: Enhanced precision with double-blind designs. Leskovec J, Grobelnik M, Najork M, Tang J, Zia L, eds. Proc. Web Conf. 2021 (ACM, New York), 2818–2827.Google Scholar
• Basu AK, Batra R (1988) ADSPLIT: A multi-brand advertising budget allocation model. J. Advertising 17(2):44–51.Crossref, Google Scholar
• Björklund A, Moffitt R (1987) The estimation of wage gains and welfare gains in self-selection models. Rev. Econom. Statist. 69(1):42–49.Crossref, Google Scholar
• Brinch CN, Mogstad M, Wiswall M (2017) Beyond LATE with a discrete instrument. J. Political Econom. 125(4):985–1039.Crossref, Google Scholar
• Brodersen KH, Gallusser F, Koehler J, Remy N, Scott SL (2015) Inferring causal impact using Bayesian structural time-series models. Ann. Appl. Statist. 9(1):247–274.Crossref, Google Scholar
• Carneiro P, Heckman JJ, Vytlacil E (2010) Evaluating marginal policy changes and the average effect of treatment for individuals at the margin. Econometrica 78(1):377–394.Crossref, Google Scholar
• Chetty R, Hendren N, Katz LF (2016) The effects of exposure to better neighborhoods on children: New evidence from the moving to opportunity experiment. Amer. Econom. Rev. 106(4):855–902.Crossref, Google Scholar
• Crépon B, Devoto F, Duflo E, Parienté W (2015) Estimating the impact of microcredit on those who take it up: Evidence from a randomized experiment in Morocco. Amer. Econom. J. Appl. Econom. 7(1):123–150.Crossref, Google Scholar
• Crépon B, Duflo E, Gurgand M, Rathelot R, Zamora P (2013) Do labor market policies have displacement effects? Evidence from a clustered randomized experiment. Quart. J. Econom. 128(2):531–580.Crossref, Google Scholar
• Daljord Ø, Mela Carl F, Roos MJ, Sprigg J, Yao S (2023) The design and targeting of compliance promotions. Marketing Sci. 42(5):866–891.Link, Google Scholar
• Deng A, Yuan L-H, Kanai N, Salama-Manteau A (2023) Zero to hero: Exploiting null effects to achieve variance reduction in experiments with one-sided triggering. Chua TS, Lauw H, eds. Proc. 16th ACM Internat. Conf. Web Search Data Mining (ACM, New York), 823–831.Google Scholar
• Forbes (2019) Marketing best practices for frequency capping.Google Scholar
• Geng T, Sun F, Wu D, Zhou W, Nair HS, Lin Z (2021) Automated bidding and budget optimization for performance advertising campaigns. Preprint, submitted August 31, https://dx.doi.org/10.2139/ssrn.3913039.Google Scholar
• Gordon BR, Moakler R, Zettelmeyer F (2023) Close enough? A large-scale exploration of non-experimental approaches to advertising measurement. Marketing Sci. 42(4):768–793.Link, Google Scholar
• Gordon BR, Zettelmeyer F, Bhargava N, Chapsky D (2019) A comparison of approaches to advertising measurement: Evidence from big field experiments at Facebook. Marketing Sci. 38(2):193–225.Link, Google Scholar
• Green DP, Gerber AS, Nickerson DW (2003) Getting out the vote in the local elections: Results from six door-to-door canvassing experiments. J. Politics 65(4):653–663.Crossref, Google Scholar
• Gui G, Nair HS, Niu F (2021) Auction throttling and causal inference of online advertising effects. Preprint, submitted December 30, https://arxiv.org/abs/2112.15155.Google Scholar
• Heckman JJ, Vytlacil E (2005) Structural equations, treatment effects, and econometric policy evaluation. Econometrica 73(3):669–738.Crossref, Google Scholar
• Heckman JJ, Tobias JL, Vytlacil E (2001) Four parameters of interest in the evaluation of social programs. Southern Econom. J. 68(2):210–223.Google Scholar
• Heckman JJ, Tobias JL, Vytlacil E (2003) Simple estimators for treatment parameters in a latent-variable framework. Rev. Econom. Statist. 85(3):748–755.Crossref, Google Scholar
• Heckman JJ, Urzua S, Vytlacil E (2006) Understanding instrumental variables in models with essential heterogeneity. Rev. Econom. Statist. 88(3):389–432.Crossref, Google Scholar
• Hermle J, Martini G (2022) Valid and unobtrusive measurement of returns to advertising through asymmetric budget split. Preprint, submitted July 1, https://arxiv.org/abs/2207.00206.Google Scholar
• Holthausen DM Jr, Assmus G (1982) Advertising budget allocation under uncertainty. Management Sci. 28(5):487–499.Link, Google Scholar
• Imbens GW, Angrist JD (1994) Identification and estimation of local average treatment effects. Econometrica 62(2):467–475.Crossref, Google Scholar
• Johnson GA (2023) Inferno: A guide to field experiments in online display advertising. J. Econom. Management Strategy 32(3):469–490.Crossref, Google Scholar
• Johnson GA, Lewis RA, Nubbemeyer EI (2017a) The online ad effectiveness funnel & carryover: Lessons from 432 field experiments. Preprint, submitted December 11, 2015, https://dx.doi.org/10.2139/ssrn.2701578.Google Scholar
• Johnson GA, Lewis RA, Reiley DH (2013) Location, location, location: Repetition and proximity increase advertising effectiveness. Preprint, submitted May 23, https://dx.doi.org/10.2139/ssrn.2268215.Google Scholar
• Johnson GA, Lewis RA, Reiley DH (2017b) When less is more: Data and power in advertising experiments. Marketing Sci. 36(1):43–53.Link, Google Scholar
• Kitagawa T, Tetenov A (2018) Who should be treated? Empirical welfare maximization methods for treatment choice. Econometrica 86(2):591–616.Crossref, Google Scholar
• Lewis RA (2014) Worn-out or just getting started: The impact of frequency in online advertising.Google Scholar
• Lewis RA, Reiley DH (2014) Online ads and offline sales: Measuring the effect of retail advertising via a controlled experiment on Yahoo!. Quant. Marketing Econom. 12(3):43–53.Google Scholar
• Lewis RA, Wong J (2022) Incrementality bidding & attribution. Preprint, submitted August 25, https://arxiv.org/abs/2208.12809.Google Scholar
• Manski CF (1997) Monotone treatment response. Econometrica 65(6):1311–1334.Crossref, Google Scholar
• Mealli F, Imbens GW, Ferro S, Biggeri A (2004) Analyzing a randomized trial on breast self-examination with noncompliance and missing outcomes. Biostatistics 5(2):207–222.Crossref, Google Scholar
• Miguel E, Kremer M (2004) Worms: Identifying impacts on education and health in the presence of treatment externalities. Econometrica 72(1):159–217.Crossref, Google Scholar
• Mogstad M, Santos A, Torgovitsky A (2018) Using instrumental variables for inference about policy relevant treatment parameters. Econometrica 86(5):1589–1619.Crossref, Google Scholar
• Pani AA, Raghavan S, Sahin M (2017) Large-scale advertising portfolio optimization in online marketing.Google Scholar
• Sahni NS (2015) Effect of temporal spacing between advertising exposures: Evidence from online field experiments. Quant. Marketing Econom. 13(3):203–247.Crossref, Google Scholar
• Sahni NS, Narayanan S, Kalyanam K (2019) An experimental investigation of the effects of retargeted advertising: The role of frequency and timing. J. Marketing Res. 56(3):401–418.Crossref, Google Scholar
• Sasaki Y, Ura T (2024) Welfare analysis via marginal treatment effects. Econometric Theory, ePub ahead of print September 16, https://doi.org/10.1017/S0266466624000227.Google Scholar
• Schochet PZ, Burghardt J, Sheena M (2008) Does Job Corps work? Impact findings from the National Job Corps Study. Amer. Econom. Rev. 98(5):855–902.Google Scholar
• Sethi SP (1977) Optimal advertising for the Nerlove-Arrow model under a budget constraint. J. Oper. Res. Soc. 28(3):683–693.Crossref, Google Scholar
• Simon H (1982) ADPULS: An advertising model with wearout and pulsation. J. Marketing Res. 19(3):352–363.Crossref, Google Scholar
• Sommer A, Zeger SL (1991) On estimating efficacy from clinical trials. Statist. Medicine 10(1):45–52.Crossref, Google Scholar
• Vytlacil E (2002) Independence, monotonicity, and latent index models: An equivalence result. Econometrica 70(1):331–341.Crossref, Google Scholar
• Waisman C, Nair HS, Carrion C (2024a) Online causal inference for advertising in real-time bidding auctions. Marketing Sci., ePub ahead of print August 14, https://doi.org/10.1287/mksc.2022.0406.Google Scholar
• Waisman C, Sahni NS, Nair HS, Lin X (2024b) Parallel experimentation and competitive interference on online advertising platforms. Marketing Sci., ePub ahead of print https://doi.org/10.1287/mksc.2022.0194.Google Scholar
• Yuan S, Wang J, Zhao X (2013) Real-time bidding for online advertising: Measurement and analysis. Saka E, Shen D, Gao B, Yan J, Li Y, eds. Proc. Seventh ACM ADKDD Internat. Workshop Data Mining Online Advertising (ACM, New York), 1–8.Google Scholar
• Zhao K, Hua J, Yan L, Zhang Q, Xu H, Yang C (2019) A unified framework for marketing budget allocation. Teredesai A, Kumar V, eds. Proc. 25th ACM SIGKDD Internat. Conf. Knowledge Discovery Data Mining (ACM, New York), 1820–1830.Google Scholar
• Zigler CM, Watts K, Yeh RW, Wang Y, Coull BA, Dominici F (2013) Model feedback in Bayesian propensity score estimation. Biometrics 69(1):263–273.Crossref, Google Scholar