Could Gamification Designs Enhance Online Learning Through Personalization? Lessons from a Field Experiment

References

• Alavi M, Leidner DE (2001) Technology-mediated learning—a call for greater depth and breadth of research. Inform. Systems Res. 12(1):1–10.Link, Google Scholar
• Almeda M (2018) Comparing the factors that predict completion and grades among for-credit and open/MOOC students in online learning. Online Learning 22(1):1–18.Crossref, Google Scholar
• Alraimi KM, Zo H, Ciganek AP (2015) Understanding the MOOCs continuance: The role of openness and reputation. Comput. Ed. 80:28–38.Crossref, Google Scholar
• Ames C (1992) Classrooms: Goals, structures, and student motivation. J. Ed. Psych. 84(3):261–271.Crossref, Google Scholar
• Ames C, Archer J (1988) Achievement goals in the classroom: Students’ learning strategies and motivation processes. J. Ed. Psych. 80(3):260–267.Crossref, Google Scholar
• Antin J, Churchill EF (2011) Badges in social media: A social psychological perspective. ACM CHI 2011 Gamification Workshop Proc. (Association for Computing Machinery, New York), 1–4.Google Scholar
• Antonaci A, Klemke R, Specht M (2019) The effects of gamification in online learning environments: A systematic literature review. Informatics 6(3):32.Crossref, Google Scholar
• Antonaci A, Klemke R, Stracke CM, Specht M (2017) Gamification in MOOCs to enhance users’ goal achievement. 2017 IEEE Global Engrg. Ed. Conf. EDUCON (IEEE, Piscataway, NJ), 1654–1662.Google Scholar
• Austin PC (2017) A tutorial on multilevel survival analysis: Methods, models and applications. Internat. Statist. Rev. 85(2):185–203.Crossref, Google Scholar
• Bandura A (1991) Social cognitive theory of self-regulation. Organ. Behav. Human Decision Processes 50(2):248–287.Crossref, Google Scholar
• Bapna R, Umyarov A (2015) Do your online friends make you pay? A randomized field experiment on peer influence in online social networks. Management Sci. 61(8):1902–1920.Link, Google Scholar
• Baron RM, Kenny DA (1986) The moderator–mediator variable distinction in social psychological research: Conceptual, strategic, and statistical considerations. J. Personality Soc. Psych. 51(6):1173–1182.Crossref, Google Scholar
• Becker J-M, Rai A, Ringle CM, Volckner F (2013) Discovering unobserved heterogeneity in structural equation models to avert validity threats. MIS Q. 37(3):665–694.Crossref, Google Scholar
• Bénabou R, Tirole J (2006) Incentives and prosocial behavior. Amer. Econom. Rev. 96(5):1652–1678.Crossref, Google Scholar
• Benbasat I, Zmud RW (2003) The identity crisis within the IS discipline: Defining and communicating the discipline’s core properties. MIS Quart. 27(2):183–194.Crossref, Google Scholar
• Bol L, Garner JK (2011) Challenges in supporting self-regulation in distance education environments. J. Comput. Higher Ed. 23(2):104–123.Crossref, Google Scholar
• Butler DL (2002) Individualizing instruction in self-regulated learning. Theory Practice 41(2):81–92.Crossref, Google Scholar
• Butler DL, Winne PH (1995) Feedback and self-regulated learning: A theoretical synthesis. Rev. Ed. Res. 65(3):245–281.Crossref, Google Scholar
• Chang C-C, Tseng K-H, Liang C, Liao Y-M (2013) Constructing and evaluating online goal-setting mechanisms in web-based portfolio assessment system for facilitating self-regulated learning. Comput. Ed. 69:237–249.Crossref, Google Scholar
• Cheng S-L, Xie K (2021) Why college students procrastinate in online courses: A self-regulated learning perspective. Internet Higher Ed. 50:100807.Crossref, Google Scholar
• Cheong C, Filippou J, Cheong F (2014) Toward the gamification of learning: Investigating student perceptions of game elements. J. Inform. Systems Ed. 25(3):233–244.Google Scholar
• Christy KR, Fox J (2014) Leaderboards in a virtual classroom: A test of stereotype threat and social comparison explanations for women’s math performance. Comput. Educ. 78:66–77.Crossref, Google Scholar
• Cleary TJ, Zimmerman BJ (2012) A cyclical self-regulatory account of student engagement: Theoretical foundations and applications. Christenson SL, Reschly AL, Wylie C, eds. Handbook of Research on Student Engagement (Springer US, Boston), 237–257.Crossref, Google Scholar
• Cook DA, Levinson AJ, Garside S (2010) Time and learning efficiency in Internet-based learning: A systematic review and meta-analysis. Adv. Health Sci. Ed. 15(5):755–770.Crossref, Google Scholar
• Darnon C, Harackiewicz JM, Butera F, Mugny G, Quiamzade A (2007) Performance-approach and performance-avoidance goals: When uncertainty makes a difference. Perspect. Soc. Psych. Bull. 33(6):813–827.Crossref, Google Scholar
• Dehejia RH, Wahba S (2002) Propensity score-matching methods for nonexperimental causal studies. Rev. Econom. Statist. 84(1):151–161.Crossref, Google Scholar
• Dicheva D, Dichev C, Agre G, Angelova G (2015) Gamification in education: A systematic mapping study. J. Ed. Tech. Soc. 18(3):75–88.Google Scholar
• Ding L, Kim C, Orey M (2017) Studies of student engagement in gamified online discussions. Comput. Ed. 115:126–142.Crossref, Google Scholar
• Domínguez A, Saenz-de-Navarrete J, de-Marcos L, Fernández-Sanz L, Pagés C, Martínez-Herráiz J-J (2013) Gamifying learning experiences: Practical implications and outcomes. Comput. Ed. 63:380–392.Crossref, Google Scholar
• Dweck CS, Leggett EL (1988) A social-cognitive approach to motivation and personality. Psych. Rev. 95(2):256–273.Crossref, Google Scholar
• Elliot AJ (1999) Approach and avoidance motivation and achievement goals. Ed. Psych. 34(3):169–189.Crossref, Google Scholar
• Elliot AJ, Church MA (1997) A hierarchical model of approach and avoidance achievement motivation. J. Personality Soc. Psych. 72(1):218–232.Crossref, Google Scholar
• Elliot AJ, Harackiewicz JM (1996) Approach and avoidance achievement goals and intrinsic motivation: A mediational analysis. J. Personality Soc. Psych. 70(3):461–475.Crossref, Google Scholar
• Elliot AJ, McGregor HA, Thrash TM (2002) The need for competence. Deci EL, Ryan RM, eds. Handbook of Self-Determination Research (University of Rochester Press, Rochester, NY), 361–387.Google Scholar
• Eom S (2015) The effects of student motivation and self-regulated learning strategies on student’s perceived e-learning outcomes and satisfaction. Proc. Assoc. Inform. Systems Special Interest Group Ed. AIS SIGED IAIM Conf., (Association for Information Systems, Atlanta), 1–15.Google Scholar
• George JF (2014) The future of higher education in the U.S.: MOOCs, a case in point. Accessed December 1, 2021, https://aisel.aisnet.org/success_strategies/8/.Google Scholar
• Gravill J, Compeau D (2008) Self-regulated learning strategies and software training. Inform. Management 45(5):288–296.Crossref, Google Scholar
• Gupta S, Bostrom RP (2009) Technology-mediated learning: A comprehensive theoretical model. J. Assoc. Inform. Systems 10(9):686–714.Google Scholar
• Hakulinen L, Auvinen T (2014) The effect of gamification on students with different achievement goal orientations. 2014 Internat. Conf. Teaching Learning Comput. Engrg. (IEEE, Piscataway, NJ), 9–16.Google Scholar
• Hamari J, Koivisto J, Sarsa H (2014) Does gamification work? A literature review of empirical studies on gamification. 2014 47th Hawaii Internat. Conf. System Sci. (IEEE, Piscataway, NJ), 3025–3034.Google Scholar
• Hanus MD, Fox J (2015) Assessing the effects of gamification in the classroom: A longitudinal study on intrinsic motivation, social comparison, satisfaction, effort, and academic performance. Comput. Ed. 80:152–161.Crossref, Google Scholar
• Henderikx MA, Kreijns K, Kalz M (2017) Refining success and dropout in massive open online courses based on the intention–behavior gap. Distance Ed. 38(3):353–368.Crossref, Google Scholar
• Henderlong J, Lepper MR (2002) The effects of praise on children’s intrinsic motivation: A review and synthesis. Psych. Bull. 128(5):774–795.Crossref, Google Scholar
• Ho SY, Bodoff D (2014) The effects of web personalization on user attitude and behavior: An integration of the elaboration likelihood model and consumer search theory. MIS Quart. 38(2):497–520.Crossref, Google Scholar
• Ho SY, Bodoff D, Tam KY (2011) Timing of adaptive web personalization and its effects on online consumer behavior. Inform. Systems Res. 22(3):660–679.Link, Google Scholar
• Hsieh P-AJ, Cho V (2011) Comparing e-learning tools’ success: The case of instructor–student interactive vs. self-paced tools. Comput. Ed. 57(3):2025–2038.Crossref, Google Scholar
• Hu H, Gramling J (2009) Learning strategies for success in a web-based course: A descriptive exploration. Quart. Rev. Distance Ed. 10(2):123–134.Google Scholar
• Huang N, Zhang J, Burtch G, Li X, Chen P (2021) Combating procrastination on massive online open courses via optimal calls to action. Inform. Systems Res. 32(2):301–317.Link, Google Scholar
• Jansen RS, van Leeuwen A, Janssen J, Conijn R, Kester L (2020) Supporting learners’ self-regulated learning in massive open online courses. Comput. Ed. 146:1–17.Google Scholar
• Järvelä S, Järvenoja H, Malmberg J, Isohätälä J, Sobocinski M (2016) How do types of interaction and phases of self-regulated learning set a stage for collaborative engagement? Learning Instruction 43:39–51.Crossref, Google Scholar
• Kennedy J (2014) Characteristics of massive open online courses (MOOCs): A research review, 2009-2012. J. Interactive Online Learning 13(1):1–16.Google Scholar
• Khan AA, Madden J (2016) Speed learning: Maximizing student learning and engagement in a limited amount of time. Internat. J. Modern Ed. Comput. Sci. 8(7):22–30.Crossref, Google Scholar
• Kim D, Yoon M, Jo I-H, Branch RM (2018) Learning analytics to support self-regulated learning in asynchronous online courses: A case study at a women’s university in South Korea. Comput. Ed. 127:233–251.Crossref, Google Scholar
• Kizilcec RF, Pérez-Sanagustín M, Maldonado JJ (2017) Self-regulated learning strategies predict learner behavior and goal attainment in massive open online courses. Comput. Ed. 104:18–33.Crossref, Google Scholar
• Koivisto J, Hamari J (2019) The rise of motivational information systems: A review of gamification research. Internat. J. Inform. Management 45:191–210.Crossref, Google Scholar
• Kolfschoten G, Lukosch S, Verbraeck A, Valentin E, de Vreede G-J (2010) Cognitive learning efficiency through the use of design patterns in teaching. Comput. Ed. 54(3):652–660.Crossref, Google Scholar
• Krishnamurthy P, Carter P, Blair E (2001) Attribute framing and goal framing effects in health decisions. Organ. Behav. Human Decision Processes 85(2):382–399.Crossref, Google Scholar
• Kuo Y-C, Walker AE, Schroder KEE, Belland BR (2014) Interaction, Internet self-efficacy, and self-regulated learning as predictors of student satisfaction in online education courses. Internet Higher Ed. 20:35–50.Crossref, Google Scholar
• Kyewski E, Krämer NC (2018) To gamify or not to gamify? An experimental field study of the influence of badges on motivation, activity, and performance in an online learning course. Comput. Ed. 118:25–37.Crossref, Google Scholar
• Landers RN, Bauer KN, Callan RC (2017) Gamification of task performance with leaderboards: A goal setting experiment. Comput. Human Behav. 71:508–515.Crossref, Google Scholar
• Landers RN, Bauer KN, Callan RC, Armstrong MB (2015) Psychological theory and the gamification of learning. Reiners T, Wood CL, eds. Gamification in Education and Business (Springer International Publishing, Cham, Switzerland), 165–186.Crossref, Google Scholar
• Lee FK, Sheldon KM, Turban DB (2003) Personality and the goal-striving process: The influence of achievement goal patterns, goal level, and mental focus on performance and enjoyment. J. Appl. Psych. 88(2):256–265.Crossref, Google Scholar
• Lepper MR, Greene D (2015) Overjustification research and beyond: Toward a means-ends analysis of intrinsic and extrinsic motivation. Lepper MR, Greene D, eds. The Hidden Costs of Reward: New Perspectives on the Psychology of Human Motivation (Psychology Press, London), 109–148.Crossref, Google Scholar
• Levin IP, Schneider SL, Gaeth GJ (1998) All frames are not created equal: A typology and critical analysis of framing effects. Organ. Behav. Human Decision Processes 76(2):149–188.Crossref, Google Scholar
• Lim M, Yang Y (2015) Effects of users’ envy and shame on social comparison that occurs on social network services. Comput. Human Behav. 51:300–311.Crossref, Google Scholar
• Lindenberg S, Steg L (2013) Goal-framing theory and norm-guided environmental behavior. Van Trijp HCM, ed. Encouraging Sustainable Behavior (Psychology Press, New York), 37–54.Google Scholar
• Littenberg-Tobias J, Reich J (2020) Evaluating access, quality, and equity in online learning: A case study of a MOOC-based blended professional degree program. Internet Higher Ed. 47(100759):1–11.Google Scholar
• Liu D, Santhanam R, Webster J (2017) Toward meaningful engagement: A framework for design and research of gamified information systems. MIS Quart. 41(4):1011–1034.Crossref, Google Scholar
• MacCallum RC, Zhang S, Preacher KJ, Rucker DD (2002) On the practice of dichotomization of quantitative variables. Psych. Methods 7(1):19–40.Crossref, Google Scholar
• Maddox WT (2018) Why enterprise gamification is broken (the psychological science of motivation and effort). Amalgam Insights (March 1), https://amalgaminsights.com/2018/03/01/why-enterprise-gamification-is-broken-the-psychological-science-of-motivation-and-effort/#more-895.Google Scholar
• Maehr ML, Zusho A (2009) Achievement goal theory. Wentzel KR, Miele DB, eds. Handbook of Motivation at School (Routledge, New York), 77–104.Google Scholar
• Majuri J, Koivisto J, Hamari J (2018) Gamification of education and learning: A review of empirical literature. Proc. 2nd Internat. GamiFIN Conf. GamiFIN 2018 (CEUR-WS.org), 11–19.Google Scholar
• Maxwell SE, Delaney HD (1993) Bivariate median splits and spurious statistical significance. Psych. Bull. 113(1):181–190.Crossref, Google Scholar
• Mekler ED, Brühlmann F, Tuch AN, Opwis K (2017) Toward understanding the effects of individual gamification elements on intrinsic motivation and performance. Comput. Human Behav. 71:525–534.Crossref, Google Scholar
• Midgley C, Kaplan A, Middleton M (2001) Performance-approach goals: Good for what, for whom, under what circumstances, and at what cost? J. Ed. Psych. 93(1):77–86.Crossref, Google Scholar
• Midgley C, Maehr ML, Hruda LZ, Anderman E, Anderman L, Freeman KE, Urdan T (2000) Manual for the patterns of adaptive learning scales. Working paper, University of Michigan, Ann Arbor.Google Scholar
• Mithas S, Almirall D, Krishnan MS (2014) A potential outcomes approach to assess causality in information systems research. Kauffman RJ, Tallon PP, eds. Economics, Information Systems, and Electronic Commerce: Empirical Research (Routledge Taylor & Francis Group, London and New York), 63–86.Google Scholar
• Mok HN (2014) Teaching tip: The flipped classroom. J. Inform. Systems Ed. 25(1):7–11.Google Scholar
• Mory EH (2004) Feedback research revisited. Jonassen DH, ed. Handbook of Research on Educational Communications and Technology (Lawrence Erlbaum Associates Publishers, Mahwah, NJ), 745–783.Google Scholar
• Narciss S, Proske A, Koerndle H (2007) Promoting self-regulated learning in web-based learning environments. Comput. Human Behav. 23(3):1126–1144.Crossref, Google Scholar
• Pajares F (2002) Gender and perceived self-efficacy in self-regulated learning. Theory Practice 41(2):116–125.Crossref, Google Scholar
• Panigrahi R, Srivastava PR, Sharma D (2018) Online learning: Adoption, continuance, and learning outcome—a review of literature. Internat. J. Inform. Management 43:1–14.Crossref, Google Scholar
• Pardo A, Han F, Ellis RA (2017) Combining university student self-regulated learning indicators and engagement with online learning events to predict academic performance. IEEE Trans. Learning Tech. 10(1):82–92.Crossref, Google Scholar
• Park J, Liu D, Yi MY, Santhanam R (2019) GAMESIT: A gamified system for information technology training. Comput. Ed. 142:103643.Crossref, Google Scholar
• Piccoli G, Rodriguez J, Palese B, Bartosiak ML (2020) Feedback at scale: Designing for accurate and timely practical digital skills evaluation. Eur. J. Inform. Systems 29(2):114–133.Crossref, Google Scholar
• Pintrich PR (2000) The role of goal orientation in self-regulated learning. Boekaerts M, Pintrich PR, Zeidner M, eds. Handbook of Self-Regulation (Academic Press, San Diego), 451–502.Crossref, Google Scholar
• Preacher KJ, Hayes AF (2008) Asymptotic and resampling strategies for assessing and comparing indirect effects in multiple mediator models. Behav. Res. Methods 40(3):879–891.Crossref, Google Scholar
• Raj D, Khamis SH (1958) Some remarks on sampling with replacement. Ann. Math. Statist. 29(2):550–557.Crossref, Google Scholar
• Reich J, Ruipérez-Valiente JA (2019) The MOOC pivot. Science 363(6423):130–131.Crossref, Google Scholar
• Roney CJR, Lehman DR (2008) Self-regulation in goal striving: Individual differences and situational moderators of the goal-framing/performance link. J. Appl. Soc. Psych. 38(11):2691–2709.Crossref, Google Scholar
• Ryan AM, Pintrich PR, Midgley C (2001) Avoiding seeking help in the classroom: Who and why? Ed. Psych. Rev. 13(2):93–114.Crossref, Google Scholar
• Sagiv L, Schwartz SH (2000) Value priorities and subjective well-being: Direct relations and congruity effects. Eur. J. Soc. Psych. 30(2):177–198.Crossref, Google Scholar
• Sailer M, Homner L (2019) The gamification of learning: A meta-analysis. Ed. Psych. Rev. 32:77–112.Crossref, Google Scholar
• Santhanam R, Liu D, Shen W-CM (2016) Gamification of technology-mediated training: Not all competitions are the same. Inform. Systems Res. 27(2):453–465.Link, Google Scholar
• Santhanam R, Sasidharan S, Webster J (2008) Using self-regulatory learning to enhance e-learning-based information technology training. Inform. Systems Res. 19(1):26–47.Link, Google Scholar
• Sarker S, Chatterjee S, Xiao X, Elbanna A (2019) The sociotechnical axis of cohesion for the is discipline: Its historical legacy and its continued relevance. MIS Quart. 43(3):695–720.Crossref, Google Scholar
• Schmidt-Kraepelin M, Thiebes S, Tran MC, Sunyaev A (2018) What’s in the game? Developing a taxonomy of gamification concepts for health apps. Proc. 51st Hawaii Internat. Conf. System Sci. (IEEE, Piscataway, NJ), 1217–1226.Google Scholar
• Schöbel S, Söllner M, Mishra AN (2017) Does the winner take it all? Toward an understanding of why there might be no one-size-fits-all gamification design. Eur. Conf. Inform. Systems (Association for Information Systems, Atlanta), 1–14.Google Scholar
• Schunk DH, Zimmerman BJ (2012) Motivation and Self-Regulated Learning: Theory, Research, and Applications (Routledge, New York).Crossref, Google Scholar
• Seaborn K, Fels DI (2015) Gamification in theory and action: A survey. Internat. J. Human Comput. Stud. 74:14–31.Crossref, Google Scholar
• Senko C, Miles KM (2008) Pursuing their own learning agenda: How mastery-oriented students jeopardize their class performance. Contemporary Ed. Psych. 33(4):561–583.Crossref, Google Scholar
• Shah D (2019) Year of MOOC-based degrees: A review of MOOC stats and trends in 2018. Rep. Class Central (January 6), https://www.classcentral.com/report/moocs-stats-and-trends-2018/.Google Scholar
• Tiwana A, Konsynski B, Bush AA (2010) Platform evolution: Coevolution of platform architecture, governance, and environmental dynamics. Inform. Systems Res. 21(4):675–687.Link, Google Scholar
• Van de Velde L, Verbeke W, Popp M, Van Huylenbroeck G (2010) The importance of message framing for providing information about sustainability and environmental aspects of energy. Energy Policy 38(10):5541–5549.Crossref, Google Scholar
• van Roy R, Zaman B (2018) Need-supporting gamification in education: An assessment of motivational effects over time. Comput. Ed. 127:283–297.Crossref, Google Scholar
• VandeWalle D, Cummings LL (1997) A test of the influence of goal orientation on the feedback-seeking process. J. Appl. Psych. 82(3):390–400.Crossref, Google Scholar
• Veronneau M-H, Hiatt Racer K, Fosco GM, Dishion TJ (2014) The contribution of adolescent effortful control to early adult educational attainment. J. Ed. Psych. 106(3):730–743.Crossref, Google Scholar
• Wan Z, Compeau D, Haggerty N (2012) The effects of self-regulated learning processes on e-learning outcomes in organizational settings. J. Management Inform. Systems 29(1):307–340.Crossref, Google Scholar
• Winne PH (2019) Paradigmatic dimensions of instrumentation and analytic methods in research on self-regulated learning. Comput. Human Behav. 96:285–289.Crossref, Google Scholar
• Wolters CA (2003) Understanding procrastination from a self-regulated learning perspective. J. Ed. Psych. 95(1):179–187.Crossref, Google Scholar
• Wong J, Baars M, Davis D, Van Der Zee T, Houben G-J, Paas F (2019) Supporting self-regulated learning in online learning environments and MOOCs: A systematic review. Internat. J. Human Comput. Interaction 35(4-5):356–373.Crossref, Google Scholar
• Yi MY, Davis FD (2003) Developing and validating an observational learning model of computer software training and skill acquisition. Inform. Systems Res. 14(2):146–169.Link, Google Scholar
• Yi MY, Hwang Y (2003) Predicting the use of web-based information systems: Self-efficacy, enjoyment, learning goal orientation, and the technology acceptance model. Internat. J. Human Comput. Stud. 59(4):431–449.Crossref, Google Scholar
• Zhang T, Agarwal R, Lucas HC (2011) The value of IT-enabled retailer learning: Personalized product recommendations and customer store loyalty in electronic markets. MIS Quart. 35(4):859–881.Crossref, Google Scholar
• Zhou X, Tang J, Zhao Y, Wang T (2020) Effects of feedback design and dispositional goal orientations on volunteer performance in citizen science projects. Comput. Human Behav. 107:106266.Crossref, Google Scholar
• Zimmerman BJ (1990) Self-regulated learning and academic achievement: An overview. Ed. Psych. 25(1):3–17.Crossref, Google Scholar
• Zimmerman BJ (2000) Attaining self-regulation: A social cognitive perspective. Boekaerts M, Pintrich PR, Zeidner M, eds. Handbook of Self-Regulation (Academic Press, San Diego), 13–39.Crossref, Google Scholar
• Zimmerman BJ, Schunk DH (2008) An Essential Dimension of Self-Regulated Learning (Lawrence Erlbaum Associates, New York).Google Scholar
• Zimmerman BJ, Schunk DH (2013) Reflections on theories of self-regulated learning and academic achievement. Zimmerman BJ, Schunk DH, eds. Self-Regulated Learning and Academic Achievement: Theoretical Perspectives (Routledge, London), 282–301.Crossref, Google Scholar
• Zweig D, Webster J (2004) What are we measuring? An examination of the relationships between the big-five personality traits, goal orientation, and performance intentions. Personality Individual Differences 36(7):1693–1708.Crossref, Google Scholar