Eye-Tracking-Based Classification of Information Search Behavior Using Machine Learning: Evidence from Experiments in Physical Shops and Virtual Reality Shopping Environments

Published Online:https://doi.org/10.1287/isre.2019.0907

References

  • Aggarwal CC (2015) Data Mining (Springer International Publishing, Cham, Switzerland).Google Scholar
  • Ajanki A, Hardoon DR, Kaski S, Puolamäki K, Shawe-Taylor J (2009) Can eyes reveal interest? Implicit queries from gaze patterns. User Model. User-Adapted Interaction 19(4):307–339.CrossrefGoogle Scholar
  • Bednarik R, Vrzakova H, Hradis M (2012) What do you want to do next: A novel approach for intent prediction in gaze-based interaction. Spencer SN, ed. Proc. Sympos. Eye Tracking Res. Appl. (ACM, New York), 83–90.Google Scholar
  • Berg LP, Vance JM (2017) Industry use of virtual reality in product design and manufacturing: A survey. Virtual Reality 21(1):1–17.CrossrefGoogle Scholar
  • Bigné E, Llinares C, Torrecilla C (2016) Elapsed time on first buying triggers brand choices within a category: A virtual reality-based study. J. Bus. Res. 69(4):1423–1427.CrossrefGoogle Scholar
  • Blattgerste J, Renner P, Pfeiffer T (2018) Advantages of eye-gaze over head-gaze-based selection in virtual and augmented reality under varying field of views. Porto M, Majaranta P, eds. Proc. Workshop Comm. Gaze Interaction (ACM, New York), Article 4.Google Scholar
  • Bonetti F, Warnaby G, Quinn L (2018) Augmented reality and virtual reality in physical and online retailing: A review, synthesis and research agenda. Jung T, tom Dieck M, eds. Augmented Reality and Virtual Reality (Springer, Cham, Switzerland), 119–132.CrossrefGoogle Scholar
  • Bowman DA, McMahan RP (2007) Virtual reality: How much immersion is enough? Computer 40(7):36–43.CrossrefGoogle Scholar
  • Boyd DE, Koles B (2019) Virtual reality and its impact on B2B marketing: A value-in-use perspective. J. Bus. Res. 100(July):590–598.CrossrefGoogle Scholar
  • Breiman L (2001) Random forests. Machine Learn. 45(1):5–32.CrossrefGoogle Scholar
  • Burke RR (2018) Virtual reality for marketing research. Moutinho L, Sokele M, eds. Innovative Research Methodologies in Management—Volume II: Futures, Biometrics and Neuroscience Research (Springer, Cham, Switzerland), 63–82.CrossrefGoogle Scholar
  • Cacioppo JT, Petty RE, Feinstein JA, Jarvis WBG (1996) Dispositional differences in cognitive motivation: The life and times of individuals varying in need for cognition. Psych. Bull. 119(2):197–253.CrossrefGoogle Scholar
  • Chandon P, Hutchinson WJ, Bradlow ET, Young SH (2009) Does in-store marketing work? Effects of the number and position of shelf facings on brand attention and evaluation at the point of purchase. J. Marketing 73(6):1–17.CrossrefGoogle Scholar
  • Chiou JS, Ting CC (2011) Will you spend more money and time on internet shopping when the product and situation are right? Comput. Human Behav. 27(1):203–208.CrossrefGoogle Scholar
  • Cowan K, Ketron S (2019) A dual model of product involvement for effective virtual reality: The roles of imagination, co-creation, telepresence, and interactivity. J. Bus. Res. 100(July):483–492.CrossrefGoogle Scholar
  • Cruz-Neira C, Sandin DJ, DeFanti TA (1993) Surround-screen projection-based virtual reality: The design and implementation of the CAVE. Proc. 20th Annual Conf. Comput. Graphics Interactive Techniques (ACM, New York), 135–142.Google Scholar
  • David ME, Bearden WO, Haws KL (2017) Priced just for me: The role of interpersonal attachment style on consumer responses to customized pricing. J. Consumer Behav. 16(6):e26–e37.CrossrefGoogle Scholar
  • De Bruyn A, Liechty JC, Huizingh EK, Lilien GL (2008) Offering online recommendations with minimum customer input through conjoint-based decision aids. Marketing Sci. 27(3):443–460.LinkGoogle Scholar
  • De Melo EV, Nogueira EA, Guliato D (2015) Content-based filtering enhanced by human visual attention applied to clothing recommendation. 2015 IEEE 27th Internat. Conf. Tools Artificial Intelligence (IEEE Computer Society, Los Alamitos, CA), 644–651.Google Scholar
  • Diaz G, Cooper J, Rothkopf C, Hayhoe M (2013) Saccades to future ball location reveal memory-based prediction in a virtual-reality interception task. J. Vision 13(1):1–14.CrossrefGoogle Scholar
  • Dickinger A, Stangl B (2011) Online information search: Differences between goal-directed and experiential search. Inform. Tech. Tourism 13(3):239–257.CrossrefGoogle Scholar
  • Duchowski AT, Medlin E, Cournia N, Gramopadhye A, Melloy B, Nair S (2002a) 3D eye movement analysis for VR visual inspection training. Vertegaal R, Senders JW, eds. Proc. 2002 Sympos. Eye Tracking Res. Appl. (ACM, New York), 103–110.Google Scholar
  • Duchowski AT, Cournia N, Cumming B, McCallum D, Gramopadhye A, Greenstein J, Sadasivan S, Tyrrell RA (2004) Visual deictic reference in a collaborative virtual environment. Duchowski A, Vertegaal R, eds. Proc. 2004 Sympos. Eye Tracking Res. Appl. (ACM, New York), 35–40.Google Scholar
  • Duchowski AT, Medlin E, Cournia N, Murphy H, Gramopadhye A, Nair S, Vorah J, Melloy B (2002b) 3-D eye movement analysis. Behav. Res. Methods Instruments Comput. 34(4):573–591.CrossrefGoogle Scholar
  • Ehrenberg AS, Bound JA (1993) Predictability and prediction. J. Roy. Statist. Soc. Ser. A 156(2):167–206.CrossrefGoogle Scholar
  • Foulsham T, Walker E, Kingstone A (2011) The where, what and when of gaze allocation in the laboratory and the natural environment. Vision Res. 51(17):1920–1931.CrossrefGoogle Scholar
  • Glöckner A, Herbold AK (2011) An eye-tracking study on information processing in risky decisions: Evidence for compensatory strategies based on automatic processes. J. Behav. Decision Making 24(1):71–98.CrossrefGoogle Scholar
  • Godin G, Massicotte P, Borgeat L (2004) Foveated stereoscopic display for the visualization of detailed virtual environments. Coquillart S, Göbel M, eds. Proc. 10th Eurographics Conf. Virtual Environments (Eurographics Association, Aire-la-Ville, Switzerland), 7–16.Google Scholar
  • Guenter B, Finch M, Drucker S, Tan D, Snyder J (2012) Foveated 3D graphics. ACM Trans. Graphics 31(6):164:1–164:10.Google Scholar
  • Gutiérrez Alonso MA, Vexo F, Thalmann D (2008) Stepping into Virtual Reality (Springer, London).CrossrefGoogle Scholar
  • Guyon I, Elisseeff A (2003) An introduction to variable and feature selection. J. Machine Learn. Res. 3(March):1157–1182.Google Scholar
  • Hastie TJ, Tibshirani RJ, Friedman JH (2013) The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd ed., corr. 7th printing (Springer, New York).Google Scholar
  • Hevner AR, March ST, Park J, Ram S (2004) Design science in information systems research. MIS Quart. 28(1):75–105.CrossrefGoogle Scholar
  • Hirschman EC, Holbrook MB (1982) Hedonic consumption: Emerging concepts, methods and propositions. J. Marketing 46(3):92–101.CrossrefGoogle Scholar
  • Hoffman DL, Novak TP (1996) Marketing in hypermedia computer-mediated environments: Conceptual foundations. J. Marketing 60(3):50–68.CrossrefGoogle Scholar
  • Holmqvist K, Nyström M, Andersson R, Dewhurst R, Jarodzka H, Van de Weijer J (2011) Eye Tracking: A Comprehensive Guide to Methods and Measures (Oxford University Press, Oxford).Google Scholar
  • Hui SK, Fader PS, Bradlow ET (2009) Path data in marketing: An integrative framework and prospectus for model building. Marketing Sci. 28(2):320–335.LinkGoogle Scholar
  • Hyönä J, Radach R, Deubel H (2003) The Mind’s Eye: Cognitive and Applied Aspects of Eye Movement Research (North-Holland, Amsterdam).Google Scholar
  • Iacovou CL, Benbasat I, Dexter AS (1995) Electronic data interchange and small organizations: Adoption and impact of technology. MIS Quart. 19(4):465–485.CrossrefGoogle Scholar
  • Inman JJ, Nikolova H (2017) Shopper-facing retail technology: A retailer adoption decision framework incorporating shopper attitudes and privacy concerns. J. Retailing 93(1):7–28.CrossrefGoogle Scholar
  • James G, Witten D, Hastie TJ, Tibshirani RJ (2013) An Introduction to Statistical Learning: With Applications in R (Springer, New York).Google Scholar
  • Janiszewski C (1998) The influence of display characteristics on visual exploratory search behavior. J. Consumer Res. 25(3):290–301.CrossrefGoogle Scholar
  • Kahn BE (2017) Using visual design to improve customer perceptions of online assortments. J. Retailing 93(1):29–42.CrossrefGoogle Scholar
  • Kaltcheva VD, Weitz BA (2006) When should a retailer create an exciting store environment? J. Marketing 70(1):107–118.CrossrefGoogle Scholar
  • Kramida G (2016) Resolving the vergence-accommodation conflict in head-mounted displays. IEEE Trans. Visualization Comput. Graphics 22(7):1912–1931.CrossrefGoogle Scholar
  • Krol M, Krol M (2017) A novel approach to studying strategic decisions with eye-tracking and machine learning. Judgment Decision Making 12(6):596–609.Google Scholar
  • Kuhn M, Wing J, Weston S, Williams A, Keefer C, Engelhardt A, Cooper T, Mayer Z, Kenkel B, Benesty M, et al.. (2018) Caret: Classification and regression training. R package version 6.0-80. Accessed October 12, 2018, https://rdrr.io/cran/caret/.Google Scholar
  • Kuncheva LI (2004) Combining Pattern Classifiers: Methods and Algorithms (John Wiley & Sons, Hoboken, NJ).CrossrefGoogle Scholar
  • Lai M-L, Tsai M-J, Yang F-Y, Hsu C-Y, Liu T-C, Lee SW-Y, Lee M-H, Chiou G-L, Liang J-C, Tsai C-C (2013) A review of using eye-tracking technology in exploring learning from 2000 to 2012. Educational Res. Rev. 10(December):90–115.CrossrefGoogle Scholar
  • Lau KW, Lee PY (2019) Shopping in virtual reality: A study on consumers’ shopping experience in a stereoscopic virtual reality. Virtual Reality 23(3):255–268.CrossrefGoogle Scholar
  • Lee L, Inman JJ, Argo JJ, Böttger T, Dholakia U, Gilbride T, van Ittersum K, et al. (2018) From browsing to buying and beyond: The needs-adaptive shopper journey model. J. Assoc. Consumer Res. 3(3):277–293.CrossrefGoogle Scholar
  • Léger PM, Sénecal S, Courtemanche F, de Guinea AO, Titah R, Fredette M, Labonte-LeMoyne É (2014) Precision is in the eye of the beholder: Application of eye fixation-related potentials to information systems research. J. Assoc. Inform. Systems 15(10):651–678.Google Scholar
  • Loomis JM, Blascovich JJ, Beall AC (1999) Immersive virtual environment technology as a basic research tool in psychology. Behav. Res. Methods Instruments Comput. 31(4):557–564.CrossrefGoogle Scholar
  • MacLean KE (2008) Haptic interaction design for everyday interfaces. Rev. Human Factors Ergonomics 4(1):149–194.CrossrefGoogle Scholar
  • Mariscal G, Marban O, Fernandez C (2010) A survey of data mining and knowledge discovery process models and methodologies. Knowledge Engrg. Rev. 25(2):137–166.CrossrefGoogle Scholar
  • Meißner M, Musalem A, Huber J (2016) Eye tracking reveals processes that enable conjoint choices to become increasingly efficient with practice. J. Marketing Res. 53(1):1–17.CrossrefGoogle Scholar
  • Meißner M, Pfeiffer J, Pfeiffer T (2017) Combining virtual reality and mobile eye tracking to provide a naturalistic experimental environment for shopper research. J. Bus. Res. 100(July):445–458.Google Scholar
  • Meyer D, Dimitriadou E, Hornik K, Weingessel A, Leisch F (2017) e1071: Misc functions of the Department of Statistics, Probability Theory Group (formerly: E1071), TU Wien. R package version 1.6-8. Accessed October 12, 2018, https://CRAN.R-project.org/package=e1071.Google Scholar
  • Moe WW (2003) Buying, searching, or browsing: Differentiating between online shoppers using in-store navigational clickstream. J. Consumer Psych. 13(1–2):29–39.CrossrefGoogle Scholar
  • Moeslund TB, Granum E (2001) A survey of computer vision-based human motion capture. Comput. Vision Image Understanding 81(3):231–268.CrossrefGoogle Scholar
  • Opitz DW, Maclin R (1999) Popular ensemble methods: An empirical study. J. Artificial Intelligence Res. 11:169–198.CrossrefGoogle Scholar
  • Orquin JL, Mueller Loose S (2013) Attention and choice: A review on eye movements in decision making. Acta Psych. 144(1):190–206.CrossrefGoogle Scholar
  • Peffers K, Tuunanen T, Rothenberger MA, Chatterjee S (2007) A design science research methodology for information systems research. J. Management Inform. Systems 24(3):45–77.CrossrefGoogle Scholar
  • Peukert C, Pfeiffer J, Meißner M, Pfeiffer T, Weinhardt C (2019) Shopping in virtual reality stores: The influence of immersion on system adoption. J. Management Inform. Systems 36(3):755–788.CrossrefGoogle Scholar
  • Pfeiffer T, Feiner SK, Mayol-Cuevas WW (2016) Eyewear computing for skill augmentation and task guidance. Bulling A, Cakmakci O, Kunze K, Regh JM, eds. Eyewear Computing—Augmenting the Human with Head-Mounted Wearable Assistants, vol. 23 (Dagstuhl Publishing, Wadern, Germany), 199–203.Google Scholar
  • Pieters R, Warlop L (1999) Visual attention during brand choice: The impact of time pressure and task motivation. Internat. J. Res. Marketing 16(1):1–16.CrossrefGoogle Scholar
  • Rayner K (1998) Eye movements in reading and information processing: 20 years of research. Psych. Bull. 124(3):372–422.CrossrefGoogle Scholar
  • Russo EJ, Leclerc F (1994) An eye-fixation analysis of choice processes for consumer nondurables. J. Consumer Res. 21(2):274–290.CrossrefGoogle Scholar
  • Scholz M, Pfeiffer J, Rothlauf F (2017) Using PageRank for non-personalized default rankings in dynamic markets. Eur. J. Oper. Res. 260(1):388–401.CrossrefGoogle Scholar
  • Shi SW, Wedel M, Pieters FGM (2013) Information acquisition during online decision making: A model-based exploration using eye-tracking data. Management Sci. 59(5):1009–1026.LinkGoogle Scholar
  • Shimojo S, Simion C, Shimojo E, Scheier C (2003) Gaze bias both reflects and influences preference. Nature Neurosci. 6(12):1317–1322.CrossrefGoogle Scholar
  • Shmueli G (2010) To explain or to predict? Statist. Sci. 25(3):289–310.CrossrefGoogle Scholar
  • Shmueli G, Koppius OR (2011) Predictive analytics in information systems research. MIS Quart. 35(3):553–572.CrossrefGoogle Scholar
  • Slater M (2003) A note on presence terminology. Presence Connect 3(3):1–5.Google Scholar
  • Slater M, Usoh M, Steed A (1995) Taking steps: The influence of a walking technique on presence in virtual reality. ACM Trans. Comput.-Human Interaction 2(3):201–219.CrossrefGoogle Scholar
  • Speier C, Valacich JS, Vessey I (1999) The influence of task interruption on individual decision making: An information overload perspective. Decision Sci. 30(2):337–360.CrossrefGoogle Scholar
  • Steuer J (1992) Defining virtual reality: Dimensions determining telepresence. J. Comm. 42(4):73–93.CrossrefGoogle Scholar
  • Sutherland IE (1968) A head-mounted three dimensional display. Proc. Fall Joint Comput. Conf., Part I (ACM, New York), 757–764.Google Scholar
  • Tanriverdi V, Jacob RJK (2000) Interacting with eye movements in virtual environments. Turner T, Szwillus G, eds. Proc. CHI 2000 (ACM Press, New York), 265–272.Google Scholar
  • Tien T, Pucher PH, Sodergren MH, Sriskandarajah K, Yang GZ, Darzi A (2014) Eye tracking for skills assessment and training: A systematic review. J. Surgical Res. 191(1):169–178.CrossrefGoogle Scholar
  • van der Lans R, Pieters R, Wedel M (2008) Competitive brand salience. Marketing Sci. 27(5):922–931.LinkGoogle Scholar
  • van der Lans R, Wedel M, Pieters R (2011) Defining eye-fixation sequences across individuals and tasks: The binocular-individual threshold (bit) algorithm. Behav. Res. Methods 43(1):239–257.CrossrefGoogle Scholar
  • Van Nierop E, Bronnenberg B, Paap R, Wedel M, Franses PH (2010) Retrieving unobserved consideration sets from household panel data. J. Marketing Res. 47(1):63–74.CrossrefGoogle Scholar
  • Vidal M, Bulling A, Gellersen H (2013) Pursuits: Spontaneous interaction with displays based on smooth pursuit eye movement and moving targets. Canny JF, Langheinrich M, Rekimoto J, eds. Proc. 2013 ACM Internat. Joint Conf. Pervasive Ubiquitous Comput. (ACM Press, New York), 439–448.Google Scholar
  • Webster DM, Kruglanski AW (1994) Individual differences in need for cognitive closure. J. Personality Soc. Psych. 67(6):1049–1062.CrossrefGoogle Scholar
  • Wirth R, Hipp J (2000) CRISP-DM: Towards a standard process model for data mining. Proc. 4th Internat. Conf. Practical Appl. Knowledge Discovery Data Mining, Manchester, UK, (Practical Application Company, Blackpool, UK) 29–39.Google Scholar
  • Witten IH, Frank E, Hall MA, Pal CJ (2016) Data Mining: Practical Machine Learning Tools and Techniques (Morgan Kaufmann, Burlington, MA).Google Scholar
  • Wolfinbarger M, Gilly MC (2001) Shopping online for freedom, control, and fun. Calif. Management Rev. 43(2):34–55.CrossrefGoogle Scholar
  • Xiao B, Benbasat I (2007) E-commerce product recommendation agents: Use, characteristics, and impact. MIS Quart. 31(1):137–209.CrossrefGoogle Scholar
  • Xu S, Jiang H, Lau F (2008) Personalized online document, image and video recommendation via commodity eye-tracking. Proc. 2008 ACM Conf. Recommender Systems (ACM, New York), 83–90.Google Scholar
  • Zhu R, Zhou Z (2004) A real-time articulated human motion tracking using tri-axis inertial/magnetic sensors package. IEEE Trans. Neural Systems Rehabilitation Engrg. 12(2):295–302.CrossrefGoogle Scholar
INFORMS site uses cookies to store information on your computer. Some are essential to make our site work; Others help us improve the user experience. By using this site, you consent to the placement of these cookies. Please read our Privacy Statement to learn more.