Parallel Experimentation and Competitive Interference on Online Advertising Platforms

References

• Acemoglu D (2010) Theory, general equilibrium, and political economy in development economics. J. Econom. Perspective 24(3):17–32.Crossref, Google Scholar
• Anderson ET, Simester D (2013) Advertising in a competitive market: The role of product standards, customer learning, and switching costs. J. Marketing Res. 50(4):489–504.Crossref, Google Scholar
• Athey S, Eckles D, Imbens GW (2018) Exact p-values for network interference. J. Amer. Statist. Assoc. 113(521):230–240.Crossref, Google Scholar
• Barclay WD (1969) Factorial design in a pricing experiment. J. Marketing Res. 6(4):427–429.Crossref, Google Scholar
• Burke RR, Srull TK (1988) Competitive interference and consumer memory for advertising. J. Consumer Res. 15(1):55–68.Crossref, Google Scholar
• Chernozhukov V, Chetverikov D, Demirer M, Duflo E, Hansen C, Newey W, Robins J (2018) Double/debiased machine learning for treatment and structural parameters. Econom. J. 21(1):C1–C68.Crossref, Google Scholar
• Clarke DG (1973) Sales-advertising cross-elasticities and advertising competition. J. Marketing Res. 10(3):250–261.Crossref, Google Scholar
• Danaher PJ, Bonfrer A, Dhar S (2008) The effect of competitive advertising interference on sales for packaged goods. J. Marketing Res. 45(2):211–225.Crossref, Google Scholar
• Dubé J-P, Manchanda P (2005) Differences in dynamic brand competition across markets: An empirical analysis. Marketing Sci. 24(1):81–95.Link, Google Scholar
• Dubé J-P, Hitsch GJ, Manchanda P (2005) An empirical model of advertising dynamics. Quant. Marketing Econom. 3(2):107–144.Crossref, Google Scholar
• Gomes R, Immorlica N, Markakis E (2009) Externalities in keyword auctions: An empirical and theoretical assessment. Leonardi S, ed. Proc. 5th Internat. Conf. Web Internet Econom. (Springer, Berlin), 172–183.Google Scholar
• Gordon BR, Moakler R, Zettelmeyer F (2023) Close enough? A large-scale exploration of non-experimental approaches to advertising measurement. Marketing Sci. 42(4):768–793.Link, Google Scholar
• Gordon BR, Jerath K, Katona Z, Narayanan S, Shin J, Wilbur KC (2021) Inefficiencies in digital advertising markets. J. Marketing 85(1):7–25.Crossref, Google Scholar
• Heckman J, Hohmann N, Smith J, Khoo M (2000) Substitution and dropout bias in social experiments: A study of an influential social experiment. Quart. J. Econom. 115(2):651–694.Crossref, Google Scholar
• Hudgens MC, Halloran ME (2008) Toward causal inference with interference. J. Amer. Statist. Assoc. 103(482):832–842.Crossref, Google Scholar
• Imai K, Jiang Z, Malani A (2021) Causal inference with interference and noncompliance in two-stage randomized experiments. J. Amer. Statist. Assoc. 116(534):632–644.Crossref, Google Scholar
• JD.com (2022) Conversion lift in jzt. Accessed November 28, 2022, https://jzt.jd.com/.Google Scholar
• Johnson GA, Lewis RA, Nubbemeyer EI (2017) Ghost ads: Improving the economics of measuring online ad effectiveness. J. Marketing Res. 54(6):867–884.Crossref, Google Scholar
• Keller KL (1987) Memory factors in advertising: The effect of advertising retrieval cues on brand evaluations. J. Consumer Res. 14(3):316–333.Crossref, Google Scholar
• Keller KL (1991) Memory and evaluation effects in competitive advertising environments. J. Consumer Res. 17(4):463–476.Crossref, Google Scholar
• Kohavi R, Longbotham R, Sommerfield D, Henne RM (2009) Controlled experiments on the web: Survey and practical guide. Data Mining Knowledge Discovery 18(1):140–181.Crossref, Google Scholar
• Lambrecht A, Tucker C (2013) From generic to branded: A model of spillover in paid search advertising. J. Marketing Res. 50(5):561–576.Crossref, Google Scholar
• Lewis R, Nguyen D (2015) Display advertising’s competitive spillovers to consumer search. Quant. Marketing Econom. 13(2):93–115.Crossref, Google Scholar
• Li Q, Racine JS (2003) Nonparametric estimation of distributions with categorical and continuous data. J. Multivariate Anal. 86(2):266–292.Crossref, Google Scholar
• Li Q, Ouyang D, Racine JS (2013) Categorical semiparametric varying-coefficient models. J. Appl. Econometrics 28(4):551–579.Crossref, Google Scholar
• Montgomery DC (2017) Design and Analysis of Experiments (John Wiley & Sons, Hoboken, NJ).Google Scholar
• Munro E, Wager S, Xu K (2021) Treatment effects in market equilibrium. Preprint, submitted September 28, https://arxiv.org/abs/1109.6263.Google Scholar
• Muralidharan K, Niehaus P (2017) Experimentation at scale. J. Econom. Perspective 31(4):103–124.Crossref, Google Scholar
• Narayanan S, Kalyanam K (2015) Position effects in search advertising and their moderators: A regression discontinuity approach. Marketing Sci. 34(3):388–407.Link, Google Scholar
• Racine JS, Li Q (2004) Nonparametric estimation of regression functions with both categorical and continuous data. J. Econometrics 119(1):99–130.Crossref, Google Scholar
• Rivest RL (1992) The MD5 message digest algorithm. Internet RFC 1321.Google Scholar
• Sahni NS (2016) Advertising spillovers: Evidence from online field experiments and implications for returns on advertising. J. Marketing Res. 53(4):459–478.Crossref, Google Scholar
• Sahni NS, Narayanan S, Kalyanam K (2019) An experimental investigation of the effects of retargeted advertising: The role of frequency and timing. J. Marketing Res. 56(3):401–418.Crossref, Google Scholar
• Shapiro BT (2018) Positive spillovers and free riding in advertising of prescription pharmaceuticals: The case of antidepressants. J. Political Econom. 126(1):381–437.Crossref, Google Scholar
• Simester D, Timoshenko A, Zoumpoulis SI (2020) Efficiently evaluating targeting policies: Improving on champion vs. challenger experiments. Management Sci. 66(8):3412–3424.Link, Google Scholar
• Simonov A, Hill S (2021) Competitive advertising on brand search: Traffic stealing and click quality. Marketing Sci. 40(5):923–945.Link, Google Scholar
• Simonov A, Nosko C, Rao JM (2018) Competition and crowd-out for brand keywords in sponsored search. Marketing Sci. 37(2):200–215.Link, Google Scholar
• Stein C (1956) Inadmissability of the usual estimator for the mean of a multivariate normal distribution. Neyman J, ed. Proc. 3rd Berkeley Sympos. Math. Statist. Probability (University of California Press, Berkeley), 197–206.Google Scholar
• Tang D, Agarwal A, O’Brien D, Meyer M (2010) Overlapping experiment infrastructure: More, better, faster experimentation. Rao B, Krishnapuram B, eds. Proc. 16th ACM SIGKDD Internat. Conf. Knowledge Discovery Data Mining (ACM, New York), 17–26.Google Scholar
• Unnava HR, Sirdeshmukh D (1994) Reducing competitive ad interference. J. Marketing Res. 31(3):403–411.Crossref, Google Scholar
• van Belle G (2002) Statistical Rules of Thumb (John Wiley & Sons, Hoboken, NJ).Google Scholar
• Vilcassim NJ, Kadiyali V, Chintagunta PK (1999) Investigating dynamic multifirm market interactions in price and advertising. Management Sci. 45(4):499–518.Link, Google Scholar
• Wager S, Xu K (2021) Experimenting in equilibrium. Management Sci. 67(11):6694–6715.Link, Google Scholar
• Yang S, Lu S, Lu X (2014) Modeling competition and its impact on paid-search advertising. Marketing Sci. 33(1):134–153.Link, Google Scholar
• Ye Z, Zhang Z, Zhang D, Zhang H, Zhang R (2023) Deep learning based causal inference for large-scale combinatorial experiments: Theory and empirical evidence. Preprint, submitted March 14, https://dx.doi.org/10.2139/ssrn.4375327.Google Scholar