Attending to Customer Attention: A Novel Deep Learning Method for Leveraging Multimodal Online Reviews to Enhance Sales Prediction

References

• Ahmed A, Low Y, Aly M, Josifovski V, Smola AJ (2011) Scalable distributed inference of dynamic user interests for behavioral targeting. Proc. 17th ACM SIGKDD Internat. Conf. on Knowledge Discovery and Data Mining (Association for Computing Machinery, New York), 114–122.Google Scholar
• Archak N, Ghose A, Ipeirotis PG (2011) Deriving the pricing power of product features by mining consumer reviews. Management Sci. 57(8):1485–1509.Link, Google Scholar
• Bahdanau D, Cho K, Bengio Y (2014) Neural machine translation by jointly learning to align and translate. Preprint, submitted September 1, https://arxiv.org/abs/1409.0473.Google Scholar
• Berger J, Sorensen AT, Rasmussen SJ (2010) Positive effects of negative publicity: When negative reviews increase sales. Marketing Sci. 29(5):815–827.Link, Google Scholar
• Buschken J, Allenby GM (2016) Sentence-based text analysis for customer reviews. Marketing Sci. 35(6):953–975.Link, Google Scholar
• Chaudhari S, Polatkan G, Ramanath R, Mithal V (2019) An attentive survey of attention models. Preprint, submitted April 5, https://arxiv.org/abs/1904.02874.Google Scholar
• Chen K, Luo P, Wang HQ (2017) An influence framework on product word-of-mouth (wom) measurement. Inform. Management 54(2):228–240.Crossref, Google Scholar
• Chen Y, Pavlov D, Canny JF (2009) Large-scale behavioral targeting. Proc. 15th ACM SIGKDD Internat. Conf. on Knowledge Discovery and Data Mining (Association for Computing Machinery, New York), 209–218.Google Scholar
• Chevalier JA, Mayzlin D (2006) The effect of word of mouth on sales: Online book reviews. J. Marketing Res. 43(3):345–354.Crossref, Google Scholar
• Cho K, Van Merriënboer B, Gulcehre C, Bahdanau D, Bougares F, Schwenk H, Bengio Y (2014) Learning phrase representations using rnn encoder-decoder for statistical machine translation. Preprint, submitted June 3, https://arxiv.org/abs/1406.1078.Google Scholar
• Chu CW, Zhang GP (2003) A comparative study of linear and nonlinear models for aggregate retail sales forecasting. Internat. J. Production Econom. 86(3):217–231.Crossref, Google Scholar
• Cook M, Lalljee MG (1972) Verbal substitutes for visual signals in interaction. Semiotica 6(3):212–221.Crossref, Google Scholar
• Devlin J, Chang M-W, Lee K, Toutanova K (2018) BERT: Pre-training of deep bidirectional transformers for language understanding. Preprint, submitted October 11, https://arxiv.org/abs/1810.04805.Google Scholar
• Doganis P, Alexandridis A, Patrinos P, Sarimveis H (2006) Time series sales forecasting for short shelf-life food products based on artificial neural networks and evolutionary computing. J. Food Engrg. 75(2):196–204.Crossref, Google Scholar
• Dwarampudi M, Reddy N (2019) Effects of padding on LSTMs and CNNs. Preprint, submitted March 18, https://arxiv.org/abs/1903.07288.Google Scholar
• Filieri R (2015) What makes online reviews helpful? A diagnosticity-adoption framework to explain informational and normative influences in e-wom. J. Bus. Res. 68(6):1261–1270.Crossref, Google Scholar
• Filieri R, McLeay F, Tsui B, Lin Z (2018) Consumer perceptions of information helpfulness and determinants of purchase intention in online consumer reviews of services. Inform. Management 55(8):956–970.Crossref, Google Scholar
• Fink L, Rosenfeld L, Ravid G (2018) Longer online reviews are not necessarily better. Internat. J. Inform. Management 39:30–37.Crossref, Google Scholar
• Forman C, Ghose A, Wiesenfeld B (2008) Examining the relationship between reviews and sales: The role of reviewer identity disclosure in electronic markets. Inform. Systems Res. 19(3):291–313.Link, Google Scholar
• Fu R, Zhang Z, Li L (2016) Using LSTM and GRU neural network methods for traffic flow prediction. Proc. 31st Youth Academic Annual Conf. of Chinese Assoc. of Automation (IEEE, New York), 324–328.Google Scholar
• Galassi A, Lippi M, Torroni P (2019) Attention, please! A critical review of neural attention models in natural language processing. Preprint, submitted February 4, https://arxiv.org/abs/1902.02181.Google Scholar
• Gang R, Taeho H (2019) Examining the relationship between specific negative emotions and the perceived helpfulness of online reviews. Inform. Processing Management 56(4):1425–1438.Crossref, Google Scholar
• Graves A, Wayne G, Danihelka I (2014) Neural turing machines. Preprint, submitted October 20, https://arxiv.org/abs/1410.5401.Google Scholar
• Gregor S, Hevner AR (2013) Positioning and presenting design science research for maximum impact. Manage. Inform. Systems Quart. 37(2):337–355.Crossref, Google Scholar
• Groves PM, Thompson RF (1970) Habituation: A dual-process theory. Psych. Rev. 77(5):419.Crossref, Google Scholar
• Hevner AR, March ST, Park J, Ram S (2004) Design science in information systems research. Management Inform. Systems Quart. 28(1):75–105.Crossref, Google Scholar
• Huang Z, Liu F, Wu X, Ge S, Wang H, Fan W, Zou Y (2021) Audio-oriented multimodal machine comprehension via dynamic inter-and intra-modality attention. Proc. AAAI Conf. on Artificial Intelligence (AAAI Press, Palo Alto, CA), 13098–13106.Google Scholar
• Jabr W, Zheng ZE (2014) Know yourself and know your enemy: An analysis of firm recommendations and consumer reviews in a competitive environment. Management Inform. Systems Quart. 38(3):635–654.Crossref, Google Scholar
• Kang Y, Zhou LN (2017) Rube: Rule-based methods for extracting product features from online consumer reviews. Inform. Management 54(2):166–176.Crossref, Google Scholar
• Karimi S, Wang F (2017) Online review helpfulness: Impact of reviewer profile image. Decision Support Systems 96:39–48.Crossref, Google Scholar
• Kuan KKY, Hui KL, Prasarnphanich P, Lai HY (2015) What makes a review voted? An empirical investigation of review voting in online review systems. J. Assoc. Inform. Systems 16(1):48–71.Google Scholar
• Lee J, Park DH, Han I (2008) The effect of negative online consumer reviews on product attitude: An information processing view. Electronic Commerce Res. Appl. 7(3):341–352.Crossref, Google Scholar
• Lee PJ, Hu YH, Lu KT (2018) Assessing the helpfulness of online hotel reviews: A classification-based approach. Telemation Inform. 35(2):436–445.Crossref, Google Scholar
• Lee S, Choeh JY (2020) Using the social influence of electronic word-of-mouth for predicting product sales: The moderating effect of review or reviewer helpfulness and product type. Sustainability 12(19):18.Crossref, Google Scholar
• Lei ZY, Yang YJ, Yang M (2018) Sentiment lexicon enhanced attention-based lstm for sentiment classification. Proc. 32nd AAAI Conf. on Artificial Intelligence, 8105–8106.Google Scholar
• Li X, Bing L, Li P, Lam W, Yang Z (2018) Aspect term extraction with history attention and selective transformation. Preprint, submitted May 2, https://arxiv.org/abs/1805.00760.Google Scholar
• Li XL, Wu CJ, Mai F (2019) The effect of online reviews on product sales: A joint sentiment-topic analysis. Inform. Management 56(2):172–184.Crossref, Google Scholar
• Li XX, Hitt LM (2008) Self-selection and information role of online product reviews. Inform. Systems Res. 19(4):456–474.Link, Google Scholar
• Li Y, Xie Y (2020) Is a picture worth a thousand words? An empirical study of image content and social media engagement. J. Marketing Res. 57(1):1–19.Crossref, Google Scholar
• Liu K, Li Y, Xu N, Natarajan P (2018) Learn to combine modalities in multimodal deep learning. Preprint, submitted May 29, https://arxiv.org/abs/1805.11730.Google Scholar
• Liu X, Lee D, Srinivasan K (2019) Large-scale cross-category analysis of consumer review content on sales conversion leveraging deep learning. J. Marketing Res. 56(6):918–943.Crossref, Google Scholar
• Liu X, Wang GA, Fan W, Zhang Z (2020) Finding useful solutions in online knowledge communities: A theory-driven design and multilevel analysis. Inform. Systems Res. 31(3):731–752.Link, Google Scholar
• Lu SY, Wu JN, Tseng SL (2018) How online reviews become helpful: A dynamic perspective. J. Interactive Marketing 44:17–28.Crossref, Google Scholar
• Luo C, Luo XR, Bose R (2018) Information usefulness in online third party forums. Comput. Human Behav. 85:61–73.Crossref, Google Scholar
• Luong M-T, Pham H, Manning CD (2015) Effective approaches to attention-based neural machine translation. Preprint, submitted August 17, https://arxiv.org/abs/1508.04025.Google Scholar
• Ma D, Li S, Zhang X, Wang H (2017) Interactive attention networks for aspect-level sentiment classification. Preprint, submitted September 4, https://arxiv.org/abs/1709.00893.Google Scholar
• Ma YF, Xiang Z, Du QZ, Fan WG (2018) Effects of user-provided photos on hotel review helpfulness: An analytical approach with deep leaning. Internat. J. Hospitality Managment 71:120–131.Crossref, Google Scholar
• McGuire WJ (1968) Personality and attitude change: An information-processing theory. Psych. Foundations Attitudes 171:196.Google Scholar
• Moe WW, Schweidel DA (2012) Online product opinions: Incidence, evaluation, and evolution. Marketing Sci. 31(3):372–386.Link, Google Scholar
• Mudambi SM, Schuff D (2010) What makes a helpful online review? A study of customer reviews on amazon.com. Management Inform. Systems Quart. 34(1):185–200.Crossref, Google Scholar
• Muller H, Michoux N, Bandon D, Geissbuhler A (2004) A review of content-based image retrieval systems in medical applications: Clinical benefits and future directions. Internat. J. Medical Inform. 73(1):1–23.Crossref, Google Scholar
• Ngiam J, Khosla A, Kim M, Nam J, Lee H, Ng AY (2011) Multimodal deep learning. Getoor L, Scheffer T, eds. Proc. 28th Internat. Conf. on Machine Learn., 689–696.Google Scholar
• O’Keefe DJ (2008) Elaboration likelihood model. Donsbach W, eds. The International Encyclopedia of Communication (John Wiley & Sons, Ltd, Hoboken, NJ), 1–7.Google Scholar
• Petty RE, Cacioppo JT (1986) The elaboration likelihood model of persuasion. Communication and Persuasion (Springer, Berlin), 1–24.Google Scholar
• Qahri-Saremi H, Montazemi AR (2019) Factors affecting the adoption of an electronic word of mouth message: A meta-analysis. J. Management Inform. Systems 36(3):969–1001.Crossref, Google Scholar
• Ramachandram D, Taylor GW (2017) Deep multimodal learning: A survey on recent advances and trends. IEEE Signal Processing Magazine 34(6):96–108.Crossref, Google Scholar
• Rastegar S, Soleymani M, Rabiee HR, Shojaee SM (2016) Mdl-cw: A multimodal deep learning framework with cross weights. Getoor L, Scheffer T, eds. Proc. IEEE Conf. on Computer Vision and Pattern Recognition (IEEE, Piscataway, NJ), 2601–2609.Google Scholar
• Riley MW (1954) Communication and persuasion: Psychological studies of opinion change. Amer. Sociol. Rev. 19(3):355–357.Crossref, Google Scholar
• Sahoo N, Dellarocas C, Srinivasan S (2018) The impact of online product reviews on product returns. Inform. Systems Res. 29(3):723–738.Link, Google Scholar
• Salehan M, Kim DJ (2016) Predicting the performance of online consumer reviews: A sentiment mining approach to big data analytics. Decision Support Systems 81:30–40.Crossref, Google Scholar
• Scholz M, Schnurbus J, Haupt H, Dorner V, Landherr A, Probst F (2018) Dynamic effects of user- and marketer-generated content on consumer purchase behavior: Modeling the hierarchical structure of social media websites. Decision Support Systems 113:43–55.Crossref, Google Scholar
• Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. Preprint, submitted September 4, https://arxiv.org/abs/1409.1556.Google Scholar
• Song KT, Wei XS, Shu XB, Song RJ, Lu JF (2020) Bi-modal progressive mask attention for fine-grained recognition. IEEE Trans. Image Processing 29:7006–7018.Crossref, Google Scholar
• Tian Y, Fan B, Wu F (2017) L2-net: Deep learning of discriminative patch descriptor in euclidean space. Proc. IEEE Conf. on Computer Vision and Pattern Recognition (IEEE, Piscataway, NJ), 661–669.Google Scholar
• Tsoumakas G (2019) A survey of machine learning techniques for food sales prediction. Artificial Intelligence Rev. 52(1):441–447.Crossref, Google Scholar
• van Nguyen T, Zhou L, Chong AYL, Li BY, Pu XD (2020) Predicting customer demand for remanufactured products: A data-mining approach. Eur. J. Oper. Res. 281(3):543–558.Crossref, Google Scholar
• Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser L, et al. (2017) Attention is all you need. Preprint, submitted June 12, https://arxiv.org/abs/1706.03762.Google Scholar
• Wang RY, Strong DM (1996) Beyond accuracy: What data quality means to data consumers. J. Management Inform. Systems 12(4):5–33.Crossref, Google Scholar
• Wang Y, Ramachandran V, Liu Sheng OR (2021) Do fit opinions matter? The impact of fit context on online product returns. Inform. Systems Res. 32(1):268–289.Link, Google Scholar
• Wang Y, Huang M, Zhu X, Zhao L (2016) Attention-based LSTM for aspect-level sentiment classification. Proc. Conf. on Empirical Methods in Natural Language Processing (Association for Computational Linguistics, Stroudsburg, PA), 606–615.Google Scholar
• Wang Y, Huang W, Sun F, Xu T, Rong Y, Huang J (2020) Deep multimodal fusion by channel exchanging. Larochelle H, Ranzato M, Hadsell R, Balcan MF, Lin H, eds. Adv. Neural Inform. Processing Systems, vol. 33 (Curran Associates Inc. Red Hook, NY), 4835–4845.Google Scholar
• Weathers D, Swain SD, Grover V (2015) Can online product reviews be more helpful? Examining characteristics of information content by product type. Decision Support Systems 79:12–23.Crossref, Google Scholar
• Wixted JT (2007) Dual-process theory and signal-detection theory of recognition memory. Psych. Rev. 114(1):152.Crossref, Google Scholar
• Wu L, Brynjolfsson E (2015) The future of prediction: How Google searches foreshadow housing prices and sales. Economic Analysis of the Digital Economy (University of Chicago Press, Chicago), 89–118.Crossref, Google Scholar
• Wu RJ, Wu HH, Wang CL (2021) Why is a picture ‘worth a thousand words’? Pictures as information in perceived helpfulness of online reviews. Internat. J. Consumer Stud. 45:364–378.Google Scholar
• Xu K, Ba J, Kiros R, Cho K, Courville A, Salakhudinov R, Zemel R, et al. (2015) Show, attend and tell: Neural image caption generation with visual attention. Proc. Internat. Conf. on Machine Learn. (PMLR, New York), 2048–2057.Google Scholar
• Yamak PT, Yujian L, Gadosey PK (2019) A comparison between arima, lstm, and gru for time series forecasting. Proc. 2nd Internat. Conf. on Algorithms, Comput. and Artificial Intelligence (Association for Computing Machinery, New York), 49–55.Google Scholar
• Yin D, Bond S, Zhang H (2021) Anger in consumer reviews: Unhelpful but persuasive? Management Inform. Systems Quart. 45(3):1059–1086.Crossref, Google Scholar
• Yin D, Bond SD, Zhang H (2014) Anxious or angry? Effects of discrete emotions on the perceived helpfulness of online reviews. Management Inform. Systems Quart. 38(2):539–560.Crossref, Google Scholar
• Yu X, Liu Y, Huang X, An A (2010) A quality-aware model for sales prediction using reviews. Proc. 19th Internat. Conf. on World Wide Web (Association for Computing Machinery, New York), 1217–1218.Google Scholar
• Yu XH, Liu Y, Huang JX, An AJ (2012) Mining online reviews for predicting sales performance: A case study in the movie domain. IEEE Trans. Knowledge Data Engrg. 24(4):720–734.Crossref, Google Scholar
• Zhang JJ, Mao Z (2012) Image of all hotel scales on travel blogs: Its impact on customer loyalty. J. Hospitality Marketing Management 21(2):113–131.Crossref, Google Scholar
• Zhao YB, Xu X, Wang MS (2019) Predicting overall customer satisfaction: Big data evidence from hotel online textual reviews. Internat. J. Hospitality Management 76:111–121.Crossref, Google Scholar
• Zhu F, Zhang X (2010) Impact of online consumer reviews on sales: The moderating role of product and consumer characteristics. J. Marketing 74(2):133–148.Crossref, Google Scholar