The Impact of Situational Achievement Goals on Online Learning Behavior: Results from Field Experiments

References

• Adamson J, Cockayne S, Puffer S, Torgerson DJ (2006) Review of randomised trials using the post-randomised consent (Zelen’s) design. Contemporary Clinical Trials 27(4):305–319.Crossref, Google Scholar
• Adesope OO, Zhou M, Nesbit JC (2015) Achievement goal orientations and self-reported study strategies as predictors of online studying activities. J. Ed. Comput. Res. 53(3):436–458.Crossref, Google Scholar
• Ames C (1992) Classrooms: Goals, structures, and student motivation. J. Ed. Psych. 84(3):261–271.Crossref, Google Scholar
• Ames C, Ames R (1984) Systems of student and teacher motivation: Toward a qualitative definition. J. Ed. Psych. 76(4):535–556.Crossref, Google Scholar
• Ames C, Archer J (1988) Achievement goals in the classroom: Students’ learning strategies and motivation processes. J. Ed. Psych. 80(3):260.Crossref, Google Scholar
• Andrews I, Stock JH, Sun L (2019) Weak instruments in instrumental variables regression: Theory and practice. Annu. Rev. Econom. 11(1):727–753.Crossref, Google Scholar
• Angrist JD (2006) Instrumental variables methods in experimental criminological research: What, why and how. J. Experiment. Criminology 2(1):23–44.Crossref, Google Scholar
• Angrist JD, Pischke JS (2009) Mostly Harmless Econometrics: An Empiricist’s Companion (Princeton University Press, Princeton, NJ).Crossref, Google Scholar
• Angrist JD, Imbens GW, Rubin DB (1996) Identification of causal effects using instrumental variables. J. Amer. Statist. Assoc. 91(434):444–455.Crossref, Google Scholar
• Armstrong PW, Watts DG (1981) Clinical trials: Randomization before consent. Biomedicine 34(2):65–66.Google Scholar
• Bardach L, Oczlon S, Pietschnig J, Lüftenegger M (2020) Has achievement goal theory been right? A meta-analysis of the relation between goal structures and personal achievement goals. J. Ed. Psych. 112(6):1197–1220.Crossref, Google Scholar
• Bieleke M, Gogol K, Goetz T, Daniels L, Pekrun R (2021) The AEQ-S: A short version of the Achievement Emotions Questionnaire. Contemporary Ed. Psych. 65:101940.Crossref, Google Scholar
• Bijwaard GE, Ridder G (2005) Correcting for selective compliance in a re-employment bonus experiment. J. Econometrics 125(1–2):77–111.Crossref, Google Scholar
• Bloom HS (1984) Accounting for no-shows in experimental evaluation designs. Evaluation Rev. 8(2):225–246.Crossref, Google Scholar
• Bouchard G, Guillemette A, Landry-Léger N (2004) Situational and dispositional coping: An examination of their relation to personality, cognitive appraisals, and psychological distress. Eur. J. Personality 18(3):221–238.Crossref, Google Scholar
• Brett JF, VandeWalle D (1999) Goal orientation and goal content as predictors of performance in a training program. J. Appl. Psych. 84(6):863–873.Crossref, Google Scholar
• Brophy J (2005) Goal theorists should move on from performance goals. Ed. Psychologist 40(3):167–176.Crossref, Google Scholar
• Church MA, Elliot AJ, Gable SL (2001) Perceptions of classroom environment, achievement goals, and achievement outcomes. J. Ed. Psych. 93(1):43–54.Crossref, Google Scholar
• Cohrs JC, Abele AE, Dette DE (2006) Integrating situational and dispositional determinants of job satisfaction: Findings from three samples of professionals. J. Psych. 140(4):363–395.Crossref, Google Scholar
• Connell JP, Wellborn JG (1991) Competence, autonomy, and relatedness: A motivational analysis of self-system processes. Gunnar MR, Sroufe LA, eds. Self Processes and Development (Lawrence Erlbaum Associates, Inc., Hillsdale, NJ), 43–77.Google Scholar
• Cox DR (1958) Planning of Experiments (Wiley, Oxford, UK).Google Scholar
• Darnon C, Butera F, Harackiewicz JM (2007) Achievement goals in social interactions: Learning with mastery vs. performance goals. Motivation Emotions 31(1):61–70.Crossref, Google Scholar
• Darnon C, Dompnier B, Marijn Poortvliet P (2012) Achievement goals in educational contexts: A social psychology perspective. Soc. Personality Psych. Compass 6(10):760–771.Crossref, Google Scholar
• Denison-Day J, Muir S, Newell C, Appleton KM (2019) A web-based intervention (MotivATE) to increase attendance at an eating disorder service assessment appointment: Zelen randomized controlled trial. J. Medical Internet Res. 21(2):e11874.Crossref, Google Scholar
• Diaz-Infante N, Lazar M, Ram S, Ray A (2022) Growth in online education. Are providers ready? Accessed June 7, 2023, https://www.mckinsey.com/industries/education/our-insights/demand-for-online-education-is-growing-are-providers-ready.Google Scholar
• Dragoni L (2005) Understanding the emergence of state goal orientation in organizational work groups: The role of leadership and multilevel climate perceptions. J. Appl. Psych. 90(6):1084–1095.Crossref, Google Scholar
• Dweck CS (1986) Motivational processes affecting learning. Amer. Psych. 41(10):1040–1048.Crossref, Google Scholar
• Dweck CS, Leggett EL (1988) A social-cognitive approach to motivation and personality. Psych. Rev. 95(2):256–273.Crossref, Google Scholar
• Elliot AJ, Harackiewicz JM (1996) Approach and avoidance achievement goals and intrinsic motivation: A mediational analysis. J. Personality Soc. Psych. 70(3):461–475.Crossref, Google Scholar
• Elliot AJ, Dweck CS, Yeager DS (2017) Handbook of Competence and Motivation: Theory and Application (Guilford Publications, New York).Google Scholar
• Ford JK, Smith EM, Weissbein DA, Gully SM, Salas E (1998) Relationships of goal orientation, metacognitive activity, and practice strategies with learning outcomes and transfer. J. Appl. Psych. 83(2):218–233.Crossref, Google Scholar
• Fridhandler BM (1986) Conceptual note on state, trait, and the state-trait distinction. J. Personality Soc. Psych. 50(1):169–174.Crossref, Google Scholar
• Gabbard J, Pajewski NM, Callahan KE, Dharod A, Foley KL, Ferris K, Moses A, et al. (2021) Effectiveness of a nurse-led multidisciplinary intervention vs usual care on advance care planning for vulnerable older adults in an accountable care organization: A randomized clinical trial. JAMA Internal Medicine 181(3):361–369.Crossref, Google Scholar
• Geffner H, Dechter R, Halpern JY, eds. (2022) Probabilistic and Causal Inference: The Works of Judea Pearl, 1st ed. (ACM, New York).Crossref, Google Scholar
• Global Market Insight (2023) E-learning market trends 2023–2032, global report. Accessed June 7, 2023, https://www.gminsights.com/industry-analysis/elearning-market-size.Google Scholar
• Grant H, Dweck CS (2003) Clarifying achievement goals and their impact. J. Personality Soc. Psych. 85(3):541–553.Crossref, Google Scholar
• Guo Y, Liu Z, Meng X, Yin H (2023) Unravelling the relationship between student engagement and learning outcomes in emergency online learning: A synthesis of quantitative and qualitative results. Assessment Evaluation Higher Ed. 48(8):1–14.Google Scholar
• Gupta SK (2011) Intention-to-treat concept: A review. Perspectives Clinical Res. 2(3):109–112.Crossref, Google Scholar
• Halvari H, Skjesol K, Bagøien TE (2011) Motivational climates, achievement goals, and physical education outcomes: A longitudinal test of achievement goal theory. Scandinavian J. Ed. Res. 55(1):79–104.Crossref, Google Scholar
• Hamilton I, Beagle V (2024) By the numbers: The rise of online learning in the U.S. Accessed April 17, 2024, https://www.forbes.com/advisor/education/online-colleges/online-learning-stats/.Google Scholar
• Hartnett M (2016) Motivation in Online Education (Springer, Berlin).Crossref, Google Scholar
• Hirano K, Imbens GW, Rubin DB, Zhou XH (2000) Assessing the effect of an influenza vaccine in an encouragement design. Biostatistics 1(1):69–88.Crossref, Google Scholar
• Hirt CN, Karlen Y, Merki KM, Suter F (2021) What makes high achievers different from low achievers? Self-regulated learners in the context of a high-stakes academic long-term task. Learning Individual Differences 92:102085.Crossref, Google Scholar
• Hoewe J (2017) Manipulation check. The International Encyclopedia of Communication Research Methods (John Wiley and Sons, Hoboken, NJ), 1–5.Crossref, Google Scholar
• Hofstede G, Hofstede GJ, Minkov M (2010) Cultures and Organizations: Software of the Mind (McGraw Hill, New York).Google Scholar
• Huang N, Wang L, Hong Y, Lin L, Guo X, Chen G (2023) When the clock strikes: A multimethod investigation of on-the-hour effects in online learning. Inform. Systems. Res. 35(2).Google Scholar
• Hulleman CS, Schrager SM, Bodmann SM, Harackiewicz JM (2010) A meta-analytic review of achievement goal measures: Different labels for the same constructs or different constructs with similar labels? Psych. Bull. 136(3):422–449.Crossref, Google Scholar
• Imbens GW, Angrist JD (1994) Identification and estimation of local average treatment effects. Econometrica 62(2):467–475.Crossref, Google Scholar
• Imbens GW, Rubin DB (1997) Bayesian inference for causal effects in randomized experiments with noncompliance. Ann. Statist. 25(1):305–327.Crossref, Google Scholar
• Jaakkola T, Ntoumanis N, Liukkonen J (2016) Motivational climate, goal orientation, perceived sport ability, and enjoyment within Finnish junior ice hockey players. Scandinavian J. Medical Sci. Sports 26(1):109–115.Crossref, Google Scholar
• Jo B (2008) Causal inference in randomized experiments with mediational processes. Psych. Methods 13(4):314–336.Crossref, Google Scholar
• Kanfer R (1990) Motivation theory and industrial and organizational psychology. Handbook Industrial Organ. Psych. 1(2):75–130.Google Scholar
• Karabenick SA (2004) Perceived achievement goal structure and college student help seeking. J. Ed. Psych. 96(3):569–581.Crossref, Google Scholar
• Kleibergen F, Paap R (2006) Generalized reduced rank tests using the singular value decomposition. J. Econometrics 133(1):97–126.Crossref, Google Scholar
• Lau S, Nie Y (2008) Interplay between personal goals and classroom goal structures in predicting student outcomes: A multilevel analysis of person-context interactions. J. Ed. Psych. 100(1):15–29.Crossref, Google Scholar
• Legrain S, Tubach F, Bonnet-Zamponi D, Lemaire A, Aquino JP, Paillaud E, Taillandier-Heriche E, et al. (2011) A new multimodal geriatric discharge-planning intervention to prevent emergency visits and rehospitalizations of older adults: The optimization of medication in AGEd multicenter randomized controlled trial. J. Amer. Geriatrics Soc. 59(11):2017–2028.Crossref, Google Scholar
• Leung ACM, Santhanam R, Kwok RCW, Yue WT (2022) Could gamification designs enhance online learning through personalization? Lessons from a field experiment. Inform. Systems Res. 34(1):27–49.Google Scholar
• Lim JY, Lim KY (2020) Co-regulation in collaborative learning: Grounded in achievement goal theory. Internat. J. Ed. Res. 103:101621.Crossref, Google Scholar
• Linnenbrink EA (2005) The dilemma of performance-approach goals: The use of multiple goal contexts to promote students’ motivation and learning. J. Ed. Psych. 97(2):197–213.Crossref, Google Scholar
• Linnenbrink-Garcia L, Tyson DF, Patall EA (2008) When are achievement goal orientations beneficial for academic achievement? A closer look at main effects and moderating factors. Rev. Internat. Psych. Soc. 21(1):19–70.Google Scholar
• Little RJ, Long Q, Lin X (2009) A comparison of methods for estimating the causal effect of a treatment in randomized clinical trials subject to noncompliance. Biometrics 65(2):640–649.Crossref, Google Scholar
• Liu B (2020) Sentiment Analysis: Mining Opinions, Sentiments, and Emotions (Cambridge University Press, Cambridge, UK).Crossref, Google Scholar
• Liu Z, Zhang N, Peng X, Liu S, Yang Z, Peng J, Su Z, et al. (2022) Exploring the relationship between social interaction, cognitive processing and learning achievements in a MOOC Discussion Forum. J. Ed. Comput. Res. 60(1):132–169.Crossref, Google Scholar
• Locke E (2000) Motivation, cognition, and action: An analysis of studies of task goals and knowledge. Appl. Psych. 49(3):408–429.Crossref, Google Scholar
• Locke EA, Latham GP (2013) New Developments in Goal Setting and Task Performance (Routledge, New York).Crossref, Google Scholar
• Lu J, Bradlow ET, Hutchinson JW (2022) Testing theories of goal progress in online learning. J. Marketing Res. 59(1):35–60.Crossref, Google Scholar
• Martens R, Kirschner PA (2004) Predicting Intrinsic Motivation (Association for Educational Communications and Technology, Washington, DC).Google Scholar
• Meece JL, Anderman EM, Anderman LH (2006) Classroom goal structure, student motivation, and academic achievement. Annu. Rev. Psych. 57(1):487–503.Crossref, Google Scholar
• Mohammad SM, Turney PD (2013) Crowdsourcing a word-emotion association lexicon. Comput. Intelligence 29(3):436–465.Crossref, Google Scholar
• Neroni J, Meijs C, Leontjevas R, Kirschner PA, De Groot RH (2018) Goal orientation and academic performance in adult distance education. Internat. Rev. Res. Open Distributed Learn. 19(2):192–208.Crossref, Google Scholar
• O’Keefe PA, Ben-Eliyahu A, Linnenbrink-Garcia L (2013) Shaping achievement goal orientations in a mastery-structured environment and concomitant changes in related contingencies of self-worth. Motivation Emotion 37(1):50–64.Crossref, Google Scholar
• Pekrun R (2006) The control-value theory of achievement emotions: Assumptions, corollaries, and implications for educational research and practice. Ed. Psych. Rev. 18(4):315–341.Crossref, Google Scholar
• Pekrun R (2017) Achievement emotions. Elliot AJ, Dweck CS, Yeager DS, eds. Handbook of Competence and Motivation: Theory and Application, 2nd ed. (The Guilford Press, New York), 251–271.Google Scholar
• Pekrun R, Stephens EJ (2009) Goals, emotions, and emotion regulation: Perspectives of the control-value theory. Human Development 52(6):357–365.Crossref, Google Scholar
• Pekrun R, Stephens EJ (2010) Achievement emotions: A control-value approach. Soc. Personality Psych. Compass 4(4):238–255.Crossref, Google Scholar
• Pekrun R, Elliot AJ, Maier MA (2006) Achievement goals and discrete achievement emotions: A theoretical model and prospective test. J. Ed. Psych. 98(3):583–597.Crossref, Google Scholar
• Pekrun R, Goetz T, Perry RP (2005) Achievement emotions questionnaire (AEQ). User’s manual. Unpublished manuscript, University of Munich, Munich, Germany.Google Scholar
• Pekrun R, Marsh HW, Elliot AJ, Stockinger K, Perry RP, Vogl E, Goetz T, et al. (2023) A three-dimensional taxonomy of achievement emotions. J. Personality Soc. Psych. 124(1):145.Crossref, Google Scholar
• Pennebaker JW, Boyd RL, Jordan K, Blackburn K (2015) The development and psychometric properties of LIWC2015. Technical report, University of Texas at Austin, Austin.Google Scholar
• Pickard L, Ma R, Mendez MC (2023) Massive list of MOOC platforms around the world in 2024. Accessed April 17, 2024, https://www.classcentral.com/report/mooc-platforms/.Google Scholar
• Pintrich PR (2000a) Multiple goals, multiple pathways: The role of goal orientation in learning and achievement. J. Ed. Psych. 92(3):544–555.Crossref, Google Scholar
• Pintrich PR (2000b) The role of goal orientation in self-regulated learning. Handbook of Self-Regulation (Elsevier, New York), 451–502.Crossref, Google Scholar
• Polso KM, Tuominen H, Hellas A, Ihantola P (2020) Achievement goal orientation profiles and performance in a programming MOOC. Proc. ACM Conf. Innovation Tech. Comput. Sci. Ed. (Association for Computing Machinery, New York), 411–417.Google Scholar
• Richiardi L, Bellocco R, Zugna D (2013) Mediation analysis in epidemiology: Methods, interpretation and bias. Internat. J. Epidemiology 42(5):1511–1519.Crossref, Google Scholar
• Robins JM, Greenland S (1992) Identifiability and exchangeability for direct and indirect effects. Epidemiology 3(2):143–155.Crossref, Google Scholar
• Rogers T, Milkman KL (2016) Reminders through association. Psych. Sci. 27(7):973–986.Crossref, Google Scholar
• Ross L, Nisbett RE (2011) The Person and the Situation: Perspectives of Social Psychology (Pinter and Martin Publishers, London).Google Scholar
• Rubin DB (1980) Randomization analysis of experimental data: The Fisher randomization test comment. J. Amer. Statist. Assoc. 75(371):591–593.Google Scholar
• Ryan RM, Deci EL (2000) Intrinsic and extrinsic motivations: Classic definitions and new directions. Contemporary Ed. Psych. 25(1):54–67.Crossref, Google Scholar
• Sagarin BJ, West SG, Ratnikov A, Homan WK, Ritchie TD, Hansen EJ (2014) Treatment noncompliance in randomized experiments: Statistical approaches and design issues. Psych. Methods 19(3):317–333.Crossref, Google Scholar
• Santhanam R, Sasidharan S, Webster J (2008) Using self-regulatory learning to enhance e-learning-based information technology training. Inform. Systems Res. 19(1):26–47.Link, Google Scholar
• Schunk DH, Zimmerman BJ (2006) Competence and control beliefs: Distinguishing the means and ends. Alexander PA, Winne PH, eds. Handbook of Educational Psychology (Lawrence Erlbaum Associates Publishers, Mahwah, NJ), 349–367.Google Scholar
• Simon GE, Shortreed SM, DeBar LL (2021) Zelen design clinical trials: Why, when, and how. Trials 22(1):541.Crossref, Google Scholar
• Simon GE, Beck A, Rossom R, Richards J, Kirlin B, King D, Shulman L, et al. (2016) Population-based outreach vs. care as usual to prevent suicide attempt: Study protocol for a randomized controlled trial. Trials 17(1):452.Crossref, Google Scholar
• Skaalvik EM, Skaalvik S (2013) School goal structure: Associations with students’ perceptions of their teachers as emotionally supportive, academic self-concept, intrinsic motivation, effort, and help seeking behavior. Internat. J. Ed. Res. 61(1):5–14.Crossref, Google Scholar
• Smith M, Firth J (2018) Psychology in the Classroom: A Teacher’s Guide to What Works (Routledge, New York).Crossref, Google Scholar
• Solmon MA (1996) Impact of motivational climate on students’ behaviors and perceptions in a physical education setting. J. Ed. Psych. 88(4):731–738.Crossref, Google Scholar
• Sonntag A, Zizzo DJ (2015) On reminder effects, drop-outs and dominance: Evidence from an online experiment on charitable giving. PLoS One 10(8):1–17.Crossref, Google Scholar
• Stock JH, Yogo M (2005) Asymptotic Distributions of Instrumental Variables Statistics with Many Instruments, vol. 6 (Cambridge University Press, New York).Crossref, Google Scholar
• Ten Have TR, Normand SLT, Marcus SM, Brown CH, Lavori P, Duan N (2008) Intent-to-treat vs. non-intent-to-treat analyses under treatment non-adherence in mental health randomized trials. Psychiatry Ann. 38(12):772–783.Crossref, Google Scholar
• Turner JC, Midgley C, Meyer DK, Gheen M, Anderman EM, Kang Y, Patrick H (2002) The classroom environment and students’ reports of avoidance strategies in mathematics: A multimethod study. J. Ed. Psych. 94(1):88–106.Crossref, Google Scholar
• Urdan T, Kaplan A (2020) The origins, evolution, and future directions of achievement goal theory. Contemporary Ed. Psych. 61:101862.Crossref, Google Scholar
• Van Hooft EA, Noordzij G (2009) The effects of goal orientation on job search and reemployment: A field experiment among unemployed job seekers. J. Appl. Psych. 94(6):1581.Crossref, Google Scholar
• VandeWalle D (1997) Development and validation of a work domain goal orientation instrument. Ed. Psych. Measures 57(6):995–1015.Crossref, Google Scholar
• VandeWalle D, Cummings LL (1997) A test of the influence of goal orientation on the feedback-seeking process. J. Appl. Psych. 82(3):390–400.Crossref, Google Scholar
• VandeWalle D, Nerstad CG, Dysvik A (2019) Goal orientation: A review of the miles traveled and the miles to go. Annu. Rev. Organ. Psych. Organ. Behav. 6:115–144.Crossref, Google Scholar
• Vann JCJ, Jacobson RM, Coyne-Beasley T, Asafu-Adjei JK, Szilagyi PG (2018) Patient reminder and recall interventions to improve immunization rates. Cochrane Database Systematic Rev. 2018(1):CD003941.Google Scholar
• Wang Y, Baker R (2018) Grit and intention: Why do learners complete MOOCs? Internat. Rev. Res. Open Distributed Learn. 19(3):20–42.Crossref, Google Scholar
• Won S, Anderman EM, Zimmerman RS (2020) Longitudinal relations of classroom goal structures to students’ motivation and learning outcomes in health education. J. Ed. Psych. 112(5):1003–1019.Crossref, Google Scholar
• Wong J, Baars M, Davis D, Van Der Zee T, Houben GJ, Paas F (2019) Supporting self-regulated learning in online learning environments and MOOCs: A systematic review. Internat. J. Human Comput. Interactions 35(4):356–373.Crossref, Google Scholar
• Wu R, Yu Z (2022) Exploring the effects of achievement emotions on online learning outcomes: A systematic review. Frontiers Psych. 13:977931.Crossref, Google Scholar
• Zelen M (1979) A new design for randomized clinical trials. New England J. Medicine 300(22):1242–1245.Crossref, Google Scholar
• Zhang DJ, Allon G, Van Mieghem JA (2017) Does social interaction improve learning outcomes? Evidence from field experiments on massive open online courses. Manufacturing Service Oper. Management 19(3):347–367.Link, Google Scholar
• Zhao X, Selman RL, Haste H (2015) Academic stress in Chinese schools and a proposed preventive intervention program. Cogent Ed. 2(1):1000477.Crossref, Google Scholar
• Zhou Y, Wang J (2019) Goal orientation, learning strategies, and academic performance in adult distance learning. Soc. Behav. Personality 47(7):1–20.Crossref, Google Scholar