Unlimited Testing: Let’s Test Your Emails with AI

Published Online:https://doi.org/10.1287/mksc.2021.0126

References

  • Alhuzali H, Ananiadou S (2021) Spanemo: Casting multi-label emotion classification as span-prediction. Preprint, submitted January 25, https://arxiv.org/abs/2101.10038v1.Google Scholar
  • Ameer I, Bölücü N, Siddiqui MH, Can B, Sidorov G, Gelbukh A (2023) Multi-label emotion classification in texts using transfer learning. Expert Syst. Appl. 213:118534.CrossrefGoogle Scholar
  • Balakrishnan R, Parekh R (2014) Learning to predict subject-line opens for large-scale email marketing. 2014 IEEE International Conference on Big Data (IEEE, Piscataway, NJ), 579–584.Google Scholar
  • Baziotis C, Athanasiou N, Chronopoulou A, Kolovou A, Paraskevopoulos G, Ellinas N, Narayanan S, Potamianos A (2018) Ntua-SLP at Semeval-2018 task 1: Predicting affective content in tweets with deep attentive RNNS and transfer learning. Proceedings of The 12th International Workshop on Semantic Evaluation (Association for Computational Linguistics, Stroudsburg, PA), 245–255.Google Scholar
  • Blattberg RC, Kim B-D, Neslin SA (2009) Database Marketing: Analyzing and Managing Customers (Springer, New York).Google Scholar
  • Blei D, Ng A, Jordan M (2003) Latent Dirichlet allocation. J. Machine Learning Res. 3:993–1022.Google Scholar
  • Bonfrer A, Drèze X (2009) Real-time evaluation of email campaign performance. Marketing Sci. 28(2):251–263.LinkGoogle Scholar
  • Boyd R, Ashokkumar A, Seraj S, Pennebaker J (2022) The development and psychometric properties of LIWC-22. LIWC. Accessed January 10, 2023, https://www.liwc.app/static/documents/LIWC-22%20Manual%20-%20Development%20and%20Psychometrics.pdf.Google Scholar
  • Chakraborty I, Kim M, Sudhir K (2022) Attribute sentiment scoring with online text reviews: Accounting for Language Structure and missing attributes. J. Marketing Res. 59(3):600–622.CrossrefGoogle Scholar
  • Chatterjee A, Narahari KN, Joshi M, Agrawal P (2019) Semeval-2019 task 3: Emocontext contextual emotion detection in text. Proc. 13th Internat. Workshop Semantic Evaluation (Association for Computational Linguistics, Stroudsburg, PA), 39–48.Google Scholar
  • Chen T, Guestrin C (2016) XGBoost: A scalable tree boosting system. Proc. 22nd ACM SIGKDD Internat. Conf. Knowledge Discovery and Data Mining (ACM, New York), 785–794.Google Scholar
  • Chochlakis G, Mahajan G, Baruah S, Burghardt K, Lerman K, Narayanan S (2022) Leveraging label correlations in a multi-label setting: A case study in Emotion. Preprint, submitted October 28, https://arxiv.org/abs/2210.15842.Google Scholar
  • Clark K, Luong M-T, Le QV, Manning CD (2020) ELECTRA: Pre-training text encoders as discriminators rather than generators. Preprint, submitted March 23, https://arxiv.org/abs/2003.10555.Google Scholar
  • Cortiz D (2021) Exploring transformers in emotion recognition: A comparison of BERT, DistillBERT, RoBERTa, XLNet and ELECTRA. Preprint, submitted April 5, https://arxiv.org/abs/2104.02041.Google Scholar
  • Demszky D, Movshovitz-Attias D, Ko J, Cowen A, Nemade G, Ravi S (2020) GoEmotions: A data set of fine-grained emotions. Proc. 58th Annual Meeting Associ. for Comput. Linguistics (Association for Computational Linguistics, Stroudsburg, PA), 4040–4054.Google Scholar
  • Devlin J, Chang M-W, Lee K, Toutanova K (2018) BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. Preprint, submitted October 11, https://arxiv.org/abs/1810.04805v1.Google Scholar
  • Dorogush AV, Ershov V, Gulin A (2018) CatBoost: Gradient boosting with categorical features support. Preprint, submitted October 24, https://arxiv.org/abs/1810.11363.Google Scholar
  • Duppada V, Jain R, Hiray S (2018) SeerNet at SemEval-2018 task 1: Domain adaptation for affect in tweets. Proc. 12th Internat. Workshop on Semantic Evaluation (Association for Computational Linguistics, Stroudsburg, PA), 1–17.Google Scholar
  • Fei H, Zhang Y, Ren Y, Ji D (2020) Latent emotion memory for multi-label emotion classification. Proc. AAAI Conf. Artificial Intelligence (AAAI Press, Washington, DC), 34(05):7692–7699.CrossrefGoogle Scholar
  • Feit EMD, Berman R (2019) Test & Roll: Profit-maximizing A/B tests. Marketing Sci. 38(6):1038–1058.LinkGoogle Scholar
  • Fong NM (2017) How targeting affects customer search: A field experiment. Management Sci. 63(7):2353–2364.LinkGoogle Scholar
  • Hanson W (2000) Principles of Internet Marketing (South-Western College Publishing, San Diego, CA).Google Scholar
  • Hartmann J (2022) Emotion English DistilRoBERTa-base. Huggingface. Accessed January 10, 2023, https://huggingface.co/j-hartmann/emotion-english-distilroberta-base.Google Scholar
  • Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput. 9(8):1735–1780.CrossrefGoogle Scholar
  • Holbrook MB, Lehmann DR (1980) Form vs. content in predicting Starch scores. J. Advert. Res. 20(4):53–62.Google Scholar
  • Jaidka K, Goyal T, Chhaya N (2018) Predicting email and article clickthroughs with domain-adaptive language models. Proc. 10th ACM Conf. Web Science (ACM, New York), 177–184.Google Scholar
  • Joulin A, Grave E, Bojanowski P, Mikolov T (2017) Bag of tricks for efficient text classification. Proc. 15th Conf. Eur. Chapter Assoc. for Comput. Linguistics: Volume 2, Short Papers (Association for Computational Linguistics, Stroudsburg, PA), 427–431.Google Scholar
  • Kant N, Puri R, Yakovenko N, Catanzaro B (2018) Practical text classification with large pre-trained language models. Preprint, submitted December 4, https://arxiv.org/abs/1812.01207.Google Scholar
  • Ke G, Meng Q, Finely T, Wang T, Chen W, Ma W, Ye Q, Liu T-Y (2019) Lightgbm: A highly efficient gradient boosting decision tree. Microsoft Research. Accessed September 13, 2021, from https://www.microsoft.com/en-us/research/publication/lightgbm-a-highly-efficient-gradient-boosting-decision-tree/.Google Scholar
  • Kim Y (2014) Convolutional neural networks for sentence classification. ACL Anthology. Accessed December 30, 2021, https://aclanthology.org/D14-1181/.Google Scholar
  • Kristensen E (2022) 8 of the Best Fomo marketing examples you must see. The Ecommerce Revenue Engine. Accessed December 27, 2022, https://www.drip.com/blog/fomo-marketing.Google Scholar
  • Kumar V, Zhang XI, Luo A (2014) Modeling customer opt-in and opt-out in a permission-based marketing context. J. Marketing Res. 51(4):403–419.CrossrefGoogle Scholar
  • Li J, Luo X, Lu X, Moriguchi T (2020) The double-edged effects of e-commerce cart retargeting: Does retargeting too early backfire? J. Marketing 85(4):123–140.CrossrefGoogle Scholar
  • Liu Y, Ott M, Goyal N, Du J, Joshi M, Chen D, Levy O, Lewis M, Zettlemoyer L, Stoyanov V (2019) RoBERTa: A robustly optimized BERT pretraining approach. Preprint, submitted July 26, https://arxiv.org/abs/1907.11692.Google Scholar
  • Loshchilov I, Hutter F (2019) Decoupled weight decay regularization. Preprint, submitted November 14, https://arxiv.org/abs/1711.05101v3.Google Scholar
  • Manning CD, Raghavan P, Schütze H (2008) Introduction to Information Retrieval (Cambridge University Press, New York).CrossrefGoogle Scholar
  • McCorkle S (2015) Why email marketing is still in style – and thriving. VentureBeat. Accessed March 3, 2021, https://venturebeat.com/2015/03/05/why-email-marketing-is-still-in-style-and-thriving/.Google Scholar
  • McInnes L, Healy J (2018) UMAP: Uniform manifold approximation and projection for dimension reduction. Preprint, submitted February 9, https://arxiv.org/abs/1802.03426v1.Google Scholar
  • McInnes L, Healy J, Astels S (2017) Hdbscan: Hierarchical density based clustering. J. Open Source Softw. 2(11):205–206.CrossrefGoogle Scholar
  • Meisheri H, Dey L (2018) TCS Research at Semeval-2018 task 1: Learning robust representations using multi-attention architecture. Proc. 12th Internat. Workshop Semantic Evaluation (Association for Computational Linguistics, Stroudsburg, PA), 291–299.Google Scholar
  • Mikolov T, Chen K, Corrado G, Dean J (2013) Efficient estimation of word representations in vector space. Preprint, submitted January 16, https://arxiv.org/abs/1301.3781v3.Google Scholar
  • Neuendorf KA (2002) The Content Analysis Guidebook (Sage, Thousand Oaks, CA).Google Scholar
  • Ogilvy D (1983) Ogilvy on Advertising (Pan Books, Hampshire, UK). https://find-and-update.company-information.service.gov.uk/company/00389591.Google Scholar
  • Öhman E, Kajava K, Tiedemann J, Honkela T (2018) Creating a data set for multilingual fine-grained emotion-detection using gamification-based annotation. Proc. 9th Workshop Comput. Approaches to Subjectivity, Sentiment and Social Media Analysis (Association for Computational Linguistics, Stroudsburg, PA), 24–30.Google Scholar
  • Padilla N, Ascarza E (2021) Overcoming the cold start problem of customer relationship management using a probabilistic machine learning approach. J. Marketing Res. 58(5):981–1006.CrossrefGoogle Scholar
  • Park JH, Xu P, Fung P (2018) PlusEmo2Vec at Semeval-2018 task 1: Exploiting emotion knowledge from emoji and #hashtags. Proc. 12th Internat. Workshop on Semantic Evaluation (Association for Computational Linguistics, Stroudsburg, PA), 264–272.Google Scholar
  • Pedregosa F, Profile V, Varoquaux G, Gramfort A, Michel V, Thirion B, Grisel O, et al. (2011) Scikit-learn: Machine Learning in Python. The Journal of Machine Learning Research. Accessed March 4, 2021, https://dl.acm.org/doi/10.5555/1953048.2078195.Google Scholar
  • Pennington J, Socher R, Manning C (2014) Glove: Global vectors for word representation. Proc. 2014 Conf. Empirical Methods Natl. Language Processing (Association for Computational Linguistics, Stroudsburg, PA), 1532–1543.Google Scholar
  • Poria S, Gelbukh A, Cambria E, Hussain A, Huang G-B (2014) EmoSenticSpace: A novel framework for affective common-sense reasoning. Knowl. Base. Syst. 69:108–123.CrossrefGoogle Scholar
  • Qiang J, Qian Z, Li Y, Yuan Y, Wu X (2022) Short text topic modeling techniques, applications, and performance: A survey. IEEE Trans. Knowl. Data Eng. 34(3):1427–1445. https://doi.org/10.1109/tkde.2020.2992485.CrossrefGoogle Scholar
  • Radford A, Wu J, Child R, Luan D, Amodei D, Sutskever I (2019) Language Models are Unsupervised Multitask Learners. OpenAI. Accessed March 4, 2021, https://d4mucfpksywv.cloudfront.net/better-language-models/language_models_are_unsupervised_multitask_learners.pdf.Google Scholar
  • Raffel C, Shazeer N, Roberts A, Lee K, Narang S, Matena M, Zhou Y, Li W, Liu PJ (2020) Exploring the limits of transfer learning with a unified text-to-text transformer. Preprint, submitted October 23, https://arxiv.org/abs/1910.10683.Google Scholar
  • Reimers N, Gurevych I (2019) Sentence-BERT: Sentence EMBEDDINGS using Siamese bert-networks. Proc. 2019 Conf. Empirical Methods in Natl. Language Processing and the 9th Internat. Joint Conf. Natl. Language Processing (Association for Computational Linguistics, Stroudsburg, PA), 3982–3992.Google Scholar
  • Rossiter JR (1981) Predicting starch scores. J. Advert. Res. 21(5):63–68.Google Scholar
  • Sahni NS, Wheeler SC, Chintagunta P (2018) Personalization in email marketing: The role of noninformative advertising content. Marketing Sci. 37(2):236–258.LinkGoogle Scholar
  • Sahni NS, Zou D, Chintagunta PK (2017) Do targeted discount offers serve as advertising? Evidence from 70 field experiments. Management Sci. 63(8):2688–2705.LinkGoogle Scholar
  • Sanh V, Debut L, Chaumond J, Wolf T (2020) DistilBERT, a distilled version of BERT: Smaller, faster, cheaper and lighter. Preprint, submitted October 2, https://arxiv.org/abs/1910.01108/.Google Scholar
  • Saravia E, Liu H-CT, Huang Y-H, Wu J, Chen Y-S (2018) CARER: Contextualized affect representations for emotion recognition. Proc. 2018 Conf. Empirical Methods in Natl. Language Processing (Association for Computational Linguistics, Stroudsburg, PA), 3687–3697.Google Scholar
  • Schuster M, Paliwal KK (1997) Bidirectional recurrent neural networks. IEEE Trans. Signal Process 45(11):2673–2681.CrossrefGoogle Scholar
  • Schwartz EM, Bradlow ET, Fader PS (2017) Customer acquisition via display advertising using multi-armed bandit experiments. Marketing Sci. 36(4):500–522.LinkGoogle Scholar
  • Shi X, Mueller J, Erickson N, Li M, Smola AJ (2021). Benchmarking multimodal AutoML for tabular data with text fields. Preprint, submitted November 4, https://arxiv.org/abs/2111.02705.Google Scholar
  • Shwartz-Ziv R, Armon A (2021) Tabular data: Deep learning is not all you need. Preprint, submitted June 6, https://arxiv.org/abs/2106.03253v1.Google Scholar
  • Sinha M, Vinay V, Singh H (2018) Modeling time to open of emails with a latent state for user engagement level. Proc. Eleventh ACM Internat. Conf. Web Search and Data Mining (ACM, New York), 531–539.Google Scholar
  • Statista Research Department (2016a) Leading customer acquisition methods in the U.S. 2015. Statista. Accessed December 30, 2022, https://www.statista.com/statistics/187303/share-of-us-customer-acquisition-by-social-media-channel/.Google Scholar
  • Statista Research Department (2016b) Leading customer retention methods in the U.S. 2015. Statista. Accessed December 30, 2022, https://www.statista.com/statistics/316104/effective-digital-marketing-channels-customer-retention-usa/.Google Scholar
  • Statista Research Department (2022a) Most popular digital marketing channels worldwide 2020. Statista. Accessed December 30, 2022, https://www.statista.com/statistics/1203256/digital-marketing-channels-worldwide/.Google Scholar
  • Statista Research Department (2022b) Email marketing revenue worldwide 2020–2027. Statista. Accessed December 30, 2022, https://www.statista.com/statistics/812060/email-marketing-revenue-worldwide/.Google Scholar
  • Strapparava C, Mihalcea R (2007) SemEval-2007 task 14. Proc. 4th Internat. Workshop on Semantic Evaluations (Association for Computational Linguistics, Stroudsburg, PA), 70–74.Google Scholar
  • Tellis GJ, MacInnis DJ, Tirunillai S, Zhang Y (2019) What drives virality (sharing) of online digital content? The critical role of information, emotion, and brand prominence. J. Marketing 83(4):1–20.CrossrefGoogle Scholar
  • Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser Ł, Polosukhin I (2017) Attention is all you need. Proceedings of the 31st International Conference on Neural Information Processing Systems. Accessed March 4, 2021, https://dl.acm.org/doi/10.5555/3295222.3295349.Google Scholar
  • Wang A, Singh A, Michael J, Hill F, Levy O, Bowman SR (2018) GLUE: A multi-task benchmark and analysis platform for natural language understanding. Preprint, submitted April 20, https://arxiv.org/abs/1804.07461v1.Google Scholar
  • Wells W, Burnett J, Moriarty SE (1992) Advertising Principles and Practice (Prentice Hall, Upper Saddle River, NJ).Google Scholar
  • Wilbur WJ (1994) Non-parametric significance tests of retrieval performance comparisons. J. Inform. Sci. 20(4):270–284.CrossrefGoogle Scholar
  • Williams P, Aaker JL (2002) Can mixed emotions peacefully coexist? J. Consumer Res. 28(4):636–649.CrossrefGoogle Scholar
  • Wood SN, Goude Y, Shaw S (2014) Generalized additive models for large data sets. J. R. Stat. Soc. Ser. C. Appl. Stat. 64(1):139–155.CrossrefGoogle Scholar
  • Xu P, Liu Z, Winata GI, Lin Z, Fung P (2020) EmoGraph: Capturing emotion correlations using graph networks. Preprint, submitted August 21, https://arxiv.org/abs/2008.09378.Google Scholar
  • Yang Z, Dai Z, Yang Y, Carbonell J, Salakhutdinov R, Le QV (2020) XLNet: Generalized autoregressive pretraining for language understanding. Accessed March 4, 2021, https://arxiv.org/pdf/1906.08237v2.pdf.Google Scholar
  • Ying W, Xiang R, Lu Q (2019) Improving multi-label emotion classification by integrating both general and domain-specific knowledge. Proc. 5th Workshop on Noisy User-Generated Text (Association for Computational Linguistics, Stroudsburg, PA), 316–321.Google Scholar
  • Zhang M, Tang J, Zhang X, Xue X (2014) Addressing cold start in recommender systems: A semi-supervised co-training algorithm. Proc. 37th Internat. ACM SIGIR Conf. Res. Development Inform. Retrieval (ACM, New York), 73–82.Google Scholar
  • Zhou D, Zhang X, Zhou Y, Zhao Q, Geng X (2016) Emotion distribution learning from texts. Proc. 2016 Conf. Empirical Methods in Natl. Language Processing (Association for Computational Linguistics, Stroudsburg, PA), 638–647.Google Scholar
INFORMS site uses cookies to store information on your computer. Some are essential to make our site work; Others help us improve the user experience. By using this site, you consent to the placement of these cookies. Please read our Privacy Statement to learn more.