Which Data Sets Are Preferred by University Students in Learning Analytics Dashboards? A Situated Learning Theory Perspective

References

• Aguilar SJ, Karabenick SA, Teasley SD, Baek C (2021) Associations between learning analytics dashboard exposure and motivation and self-regulated learning. Comput. Ed. 162:104085.Crossref, Google Scholar
• Aljohani NR, Daud A, Abbasi RA, Alowibdi JS, Basheri M, Aslam MA (2019) An integrated framework for course adapted student learning analytics dashboard. Comput. Human Behav. 92:679–690.Crossref, Google Scholar
• Alvarez CP, Martinez-Maldonado R, Shum SB (2020) LA-DECK: A card-based learning analytics co-design tool. Proc. 10th Internat. Conf. Learn. Anal. Knowledge, 63–72.Google Scholar
• Avella JT, Kebritchi M, Nunn SG, Kanai T (2016) Learning analytics methods, benefits, and challenges in higher education: A systematic literature review. Online Learn. 20(2):13–29.Google Scholar
• Banihashem SK, Aliabadi K, Ardakani SP, Delaver A, Ahmadabadi MN (2018) Learning analytics: A systematic literature review. Interdisciplinary J. Virtual Learn. Medical Sci. 9(2):e63024.Google Scholar
• Bayne S, Gallagher MS, Lamb J (2014) Being ‘at’ university: The social topologies of distance students. Higher Ed. 67(5):569–583.Crossref, Google Scholar
• Bennett L (2018) Students’ learning responses to receiving dashboard data, Research report, SRHE, London.Google Scholar
• Bodily R, Verbert K (2017) Trends and issues in student-facing learning analytics reporting systems research. Proc. 7th Internat. Learn. Anal. Knowledge Conf., 309–318.Google Scholar
• Bodily R, Ikahihifo TK, Mackley B, Graham CR (2018) The design, development, and implementation of student-facing learning analytics dashboards. J. Comput. Higher Ed. 30(3):572–598.Crossref, Google Scholar
• Bos N, Brand-Gruwel S (2016) Student differences in regulation strategies and their use of learning resources: implications for educational design. Proc. 6th Internat. Conf. Learning Analytics Knowledge, 344–353.Google Scholar
• British Educational Research Association (2018) Ethical Guidelines for Educational Research, 4th ed. (BERA, London).Google Scholar
• Broughan C, Prinsloo P (2020) (Re) centering students in learning analytics: In conversation with Paulo Freire. Assessment Evaluation Higher Ed. 45(4):617–628.Crossref, Google Scholar
• Carter AS, Hundhausen CD (2016) With a little help from my friends: An empirical study of the interplay of students’ social activities, programming activities, and course success. Proc. 2016 ACM Conf. Internat. Comput. Ed. Res., 201–209.Google Scholar
• Chen B, Chang YH, Ouyang F, Zhou W (2018) Fostering student engagement in online discussion through social learning analytics. Internet Higher Ed. 37:21–30.Crossref, Google Scholar
• Chigne HS, Gayo JEL, Alvaobeso ME, de Pablos PO, Lovelle JMC (2016) Toward the implementation of the learning analytics in the social learning environments for the technology-enhanced assessment in computer engineering education. Internat. J. Engrg. Ed. 32(4):1637–1646.Google Scholar
• Clarke V, Braun V, Hayfield N (2015) Thematic analysis. Smith JA, ed. Qualitative Psychology: A Practical Guide to Research Methods (Sage, London), 222–248.Google Scholar
• Creswell JW, Clark VLP (2017) Designing and Conducting Mixed Methods Research, 3rd ed. (Sage, London).Google Scholar
• Creswell JW, Creswell JD (2018) Research Design: Qualitative, Quantitative, and Mixed Methods Approaches (Sage, London).Google Scholar
• de Laat M, Prinsen FR (2014) Social learning analytics: Navigating the changing settings of higher education. Res. Practice Assessment 9:51–60.Google Scholar
• de Quincey E, Briggs C, Kyriacou T, Waller R (2019) Student centered design of a learning analytics system. Proc. 9th Internat. Conf. Learn. Anal. Knowledge, 353–362.Google Scholar
• Echeverria V, Martinez-Maldonado R, Shum SB, Chiluiza K, Granda R, Conati C (2018) Exploratory vs. explanatory visual learning analytics: Driving teachers’ attention through educational data storytelling. J. Learn. Anal. 5(3):72–97.Google Scholar
• El Alfy S, Gómez JM, Dani A (2019) Exploring the benefits and challenges of learning analytics in higher education institutions: A systematic literature review. Inform. Discovery Delivery 47(1):25–34.Crossref, Google Scholar
• Ez-Zaouia M, Tabard A, Lavoué E (2020) EMODASH: A dashboard supporting retrospective awareness of emotions in online learning. Internat. J. Human Comput. Stud. 139:102411.Crossref, Google Scholar
• Ferguson R (2012) Learning analytics: Drivers, developments and challenges. Internat. J. Tech. Enhanced Learn. 4(5/6):304–317.Crossref, Google Scholar
• Few S (2013) Information Dashboard Design: Displaying Data for at-a-Glance Monitoring (Analytics Press, Burlingame, CA).Google Scholar
• Fincher S, Tenenberg J (2005) Making sense of card sorting data. Expert Systems 22(3):89–93.Crossref, Google Scholar
• Gašević D, Dawson S, Siemens G (2015) Let’s not forget: Learning analytics are about learning. TechTrends 59:64–71.Crossref, Google Scholar
• Giannakos MN, Sharma K, Papavlasopoulou S, Pappas IO, Kostakos V (2020) Fitbit for learning: Towards capturing the learning experience using wearable sensing. Internat. J. Human-Comput. Stud. 136:102384.Google Scholar
• Gillespie-Lynch K, Bublitz D, Donachie A, Wong V, Brooks PJ, D’Onofrio J (2017) For a long time our voices have been hushed: Using student perspectives to develop supports for neuro-diverse college students. Frontiers Psych. 8:544.Google Scholar
• Guzmán-Valenzuela C, Gómez-González C, Rojas-Murphy TA, Lorca-Vyhmeister A (2021) Learning analytics in higher education: A preponderance of analytics but very little learning? Internat. J. Ed. Tech. Higher Ed. 18(1):1–19.Google Scholar
• Hernández-García Á, González-González I, Jiménez-Zarco AI, Chaparro-Peláez J (2015) Applying social learning analytics to message boards in online distance learning: A case study. Comput. Human Behav. 47:68–80.Crossref, Google Scholar
• Herodotou C, Rienties B, Verdin B, Boroowa A (2019) Predictive learning analytics at scale: Guidelines to successful implementation in higher education. J. Learn. Anal. 6(1):85–95.Google Scholar
• Hoefel B, Gildner J (2019) Visual analytics to identify the differences and similarities between neurotypical and neurodivergent college students. Poster. Accessed December 10, 2022, https://cedar.wwu.edu/scholwk/2019/2019_poster_presentations/88/.Google Scholar
• Holtzblatt K, Beyer HR (2012) Contextual design. The Encyclopedia of Human-Computer Interaction, 2nd ed. Accessed December 10, 2022, https://www.interaction-design.org/literature/book/the-encyclopedia-of-human-computer-interaction-2nd-ed/contextual-design.Google Scholar
• Jaffrey A (2019) How a predictive model enhanced Ulster University’s approach to student retention. Blackboard (March 26). Accessed December 10, 2022, https://blog.blackboard.com/how-a-predictive-model-enhanced-ulster-universitys-approach-to-student-retention/.Google Scholar
• Jahrami H, Marnoch G, Gray AM (2009) Use of card sort methodology in the testing of a clinical leadership competencies model. Health Services Management Res. 22(4):176–183.Crossref, Google Scholar
• Jivet I, Scheffel M, Specht M, Drachsler H (2018) License to evaluate: Preparing learning analytics dashboards for educational practice. Proc. Eighth Internat. Conf. Learn. Anal. Knowledge, 31–40.Google Scholar
• Joksimović S, Gašević D, Kovanović V, Riecke BE, Hatala M (2015) Social presence in online discussions as a process predictor of academic performance. J. Comput. Assisted Learn. 31(6):638–654.Crossref, Google Scholar
• Joseph-Richard P, Uhomoibhi J (2021) Ethics in predictive learning analytics: An empirical case study on students perceptions in a Northern Irish University. Azevedo A, Uhomoibhi J, Ossiannilsson E, eds. Advancing the Power of Learning Analytics and Big Data in Education (IGI Global, Hershey, PA), 86–107.Crossref, Google Scholar
• Joseph-Richard P, Uhomoibhi J, Jaffrey A (2021) Predictive learning analytics and the creation of emotionally adaptive learning environments in higher education institutions: A study of students’ affect responses. Internat. J. Inform. Learn. Tech. 38(2):243–257.Crossref, Google Scholar
• Jovanović J, Gašević D, Dawson S, Pardo A, Mirriahi N (2017) Learning analytics to unveil learning strategies in a flipped classroom. Internet Higher Ed. 33(4):74–85.Google Scholar
• Junco R, Clem C (2015) Predicting course outcomes with digital textbook usage data. Internet Higher Ed. 27:54–63.Google Scholar
• Kaliisa R, Mørch AI, Kluge A (2019) Exploring social learning analytics to support teaching and learning decisions in online learning environments. Eur. Conf. Tech. Enhanced Learn., 187–198.Google Scholar
• Kim J, Jo IH, Park Y (2016) Effects of learning analytics dashboard: Analysing the relations among dashboard utilization, satisfaction, and learning achievement. Asia Pacific Ed. Rev. 17(1):13–24.Crossref, Google Scholar
• Kitto K, Lupton M, Davis K, Waters Z (2017) Designing for student-facing learning analytics. Australasian J. Ed. Tech. 33(5).Google Scholar
• Lave JW, Wenger E (1990) Situated Learning. Legitimate Peripheral Participation (Cambridge University Press, London).Google Scholar
• Lee LK, Cheung SK, Kwok LF (2020) Learning analytics: Current trends and innovative practices. J. Comput. Ed. 7(1):1–6.Crossref, Google Scholar
• Leitner P, Ebner M (2017) Development of a dashboard for learning analytics in higher education. Internat. Conf. Learn. Collaboration Tech. (Springer, Cham, Switzerland), 293–301.Google Scholar
• Lim L, Dawson S, Joksimovic S, Gašević D (2019) Exploring students’ sense-making of learning analytics dashboards: Does frame of reference make a difference? Proc. 9th Internat. Conf. Learn. Anal. Knowledge (ACM), 250–259.Google Scholar
• Matcha W, Gašević D, Pardo A (2019) A systematic review of empirical studies on learning analytics dashboards: A self-regulated learning perspective. IEEE Trans. Learn. Tech. 13(2):226–245.Crossref, Google Scholar
• Maxwell J (2012) Qualitative Research Design: An Interactive Approach (Sage, London).Google Scholar
• McNaughton M, Rao L, Mansingh G (2017) An agile approach for academic analytics: A case study. J. Enterprise Inform. Management 30(5):701–722.Crossref, Google Scholar
• Moldoveanu M, Narayandas D (2019) The future of leadership development. Harvard Bus. Rev. 97(2):40–48.Google Scholar
• Molenaar I, Horvers A, Dijkstra R, Baker RS (2020) Personalized visualitions to promote young learners’ SRL: The learning path app. Proc. 10th Internat. Conf. Learn. Anal. Knowledge, 330–339.Google Scholar
• Morgan DL (2019) Basic and Advanced Focus Groups (Sage, London).Crossref, Google Scholar
• Nawaz A (2012) A comparison of card-sorting analysis methods. 10th Asia Pacific Conf. Comput. Human Interaction.Google Scholar
• Park Y, Jo IH (2019) Factors that affect the success of learning analytics dashboards. Ed. Tech. Res. Development 67(6):1547–1571.Crossref, Google Scholar
• Pedro SM, Gobert J, Dickler R. (2019) Can an alerting teacher dashboard improve how teachers help their students learn science inquiry practices? Grantee Submission. Paper Presented Annual Meeting of the American Educational Research Association, Toronto, Canada.Google Scholar
• Popescu E, Leon F (2018) Predicting academic performance based on learner traces in a social learning environment. IEEE Access 6:72774–72785.Crossref, Google Scholar
• Rets I, Herodotou C, Bayer V, Hlosta M, Rienties B (2021) Exploring critical factors of the perceived usefulness of a learning analytics dashboard for distance university students. Internat. J. Ed. Tech. Higher Ed. 18(1):1–23.Google Scholar
• Rienties B, Cross S, Zdrahal Z (2017) Implementing a learning analytics intervention and evaluation framework: What works? Daniel, BK, ed. Big Data and Learning Analytics in Higher Education (Springer, Cham, Switzerland), 147–166.Crossref, Google Scholar
• Rienties B, Toetenel L, Bryan A (2015) “Scaling up” learning design: Impact of learning design activities on LMS behavior and performance. Proc. Fifth Internat. Conf. Learn. Anal. Knowledge, 315–319.Google Scholar
• Roberts LD, Howell JA, Seaman K (2017) Give me a customizable dashboard: Personalized learning analytics dashboards in higher education. Tech. Knowledge Learn. 22(3):317–333.Crossref, Google Scholar
• Roberts LD, Howell JA, Seaman K, Gibson DC (2016) Student attitudes toward learning analytics in higher education: “The Fitbit version of the learning world.” Frontiers Psych. 7:1959.Google Scholar
• Rogers T, Gaševic D, Dawson S (2016) Learning analytics and the imperative for theory driven research. Haythornthwaite C, Andrews R, Fransman J, Meyers EM, eds. The SAGE Handbook of E-Learning Research (SAGE, Thousand Oaks, CA), 232–250.Google Scholar
• Rosenhaus C (2020) The global learner survey. Teaching & learning in COVID-19 times study. Accessed March 24, 2023, https://omeka.cloud.unimelb.edu.au/teaching-and-learning-in-a-pandemic/items/show/148.Google Scholar
• Rugg G, McGeorge P (2005) The sorting techniques: A tutorial paper on card sorts, picture sorts and item sorts. Expert Systems 22(3):94–107.Crossref, Google Scholar
• Sarmiento JP, Campos F, Wise A (2020) Engaging students as co-designers of learning analytics. Companion Proc. 10th Internat. Learn. Anal. Knowledge Conf., 29–32.Google Scholar
• Schumacher C, Ifenthaler D (2018) Features students really expect from learning analytics. Comput. Human Behav. 78:397–407.Crossref, Google Scholar
• Schwendimann BA, Rodriguez-Triana MJ, Vozniuk A, Prieto LP, Boroujeni MS, Holzer A, Gillet D, Dillenbourg P (2016) Perceiving learning at a glance: A systematic literature review of learning dashboard research. IEEE Trans. Learn. Tech. 10(1):30–41.Crossref, Google Scholar
• Sclater N (2016) Developing a code of practice for learning analytics. J. Learn. Anal. 3(1):16–42.Google Scholar
• Sclater N, Peasgood A, Mullan J (2017) Learning Analytics in Higher Education: A Review of UK and International Practice (JISC, London).Google Scholar
• Sedrakyan G, Snoeck M, De Weerdt J (2014) Process mining analysis of conceptual modeling behavior of novices—Empirical study using JMermaid modeling and experimental logging environment. Comput. Human Behav. 41:486–503.Crossref, Google Scholar
• Sedrakyan G, Malmberg J, Verbert K, Järvelä S, Kirschner PA (2018) Linking learning behavior analytics and learning science concepts: Designing a learning analytics dashboard for feedback to support learning regulation. Comput. Human Behav. 107:105512.Crossref, Google Scholar
• Selwyn N (2019) What’s the problem with learning analytics? J. Learn. Anal. 6(3):11–19.Google Scholar
• Shum SB, Ferguson R (2012) Social learning analytics. J. Ed. Tech. Soc. 15(3):3–26.Google Scholar
• Siemens G, Long P (2011) Penetrating the fog: Analytics in learning and education. EDUCAUSE Rev. 46(5):30–40.Google Scholar
• Silvermann D (2020) Interpretative Qualitative Data, 6th ed. (Sage, London).Google Scholar
• Tabuenca B, Kalz M, Drachsler H, Specht M (2015) Time will tell: The role of mobile learning analytics in self-regulated learning. Comput. Ed. 89:53–74.Google Scholar
• Teasley SD (2017) Student facing dashboards: One size fits all? Tech. Knowledge Learn. 22(3):377–384.Crossref, Google Scholar
• Upchurch L, Rugg G, Kitchenham B (2001) Using card sorts to elicit web page quality attributes. IEEE Software 18(4):84–89.Crossref, Google Scholar
• Valle N, Antonenko P, Dawson K, Huggins‐Manley AC (2021) Staying on target: A systematic literature review on learner‐facing learning analytics dashboards. British J. Ed. Tech. 52(4):1724–1748.Crossref, Google Scholar
• Vaterlaus JM, Barnett K, Roche C, Young JA (2016) Snapchat is more personal: An exploratory study on Snapchat behaviors and young adult interpersonal relationships. Comput. Human Behav. 1(62):594–601.Google Scholar
• Verbert K, Ochoa X, De Croon R, Dourado RA, De Laet T (2020) Learning analytics dashboards: The past, the present and the future. Proc. 10th Internat. Conf. Learn. Anal. Knowledge, 35–40.Google Scholar
• Verbert K, Govaerts S, Duval E, Santos JL, Assche F, Parra G, Klerkx J (2014) Learning dashboards: An overview and future research opportunities. Personal Ubiquitous Comput. 18(6):1499–1514.Google Scholar
• Vezzoli Y, Mavrikis M, Vasalou A (2020) Inspiration cards workshops with primary teachers in the early co-design stages of learning analytics. Proc. 10th Internat. Conf. Learn. Anal. Knowledge, 73–82.Google Scholar
• Viberg O, Hatakka M, Bälter O, Mavroudi A (2018) The current landscape of learning analytics in higher education. Comput. Human Behav. 89:98–110.Crossref, Google Scholar
• Waheed H, Hassan SU, Aljohani NR, Wasif M (2018) A bibliometric perspective of learning analytics research landscape. Behav. Inform. Tech. 37(10–11):941–957.Crossref, Google Scholar
• Wang Y, Paquette L, Baker R (2014) A longitudinal study on learner career advancement in MOOCs. J. Learn. Analytics 1(3):203–206.Google Scholar
• Wenger E (1999) Communities of Practice: Learning, Meaning, and Identity (Cambridge University Press, London).Google Scholar
• West D, Luzeckyj A, Toohey D, Vanderlelie J, Searle B (2020) Do academics and university administrators really know better? The ethics of positioning student perspectives in learning analytics. Australasian J. Ed. Tech. 36(2):60–70.Google Scholar
• Wilson AD, Onwuegbuzie AJ, Manning LP (2016) Using paired depth interviews to collect qualitative data. Qualitative Rep. 21(9):1549–1573.Google Scholar
• Wodzicki K, Schwämmlein E, Moskaliuk J (2012) “Actually, I Wanted to Learn”: Study-related knowledge exchange on social networking sites. Internet Higher Ed. 15(1):9–14.Crossref, Google Scholar
• Wong J, Baars M, de Koning BB, van der Zee T, Davis D, Khalil M, Houben G-J, Paas F (2019) Educational theories and learning analytics: From data to knowledge. Ifenthaler D, Mah DK, Yau JY-K, eds. Utilizing Learning Analytics to Support Study Success (Springer, Cham, Switzerland), 3–25.Crossref, Google Scholar
• Wood JR, Wood LE (2008) Card sorting: Current practices and beyond. J. Usability Stud. 4(1):1–6.Google Scholar
• You JW (2016) Identifying significant indicators using LMS data to predict course achievement in online learning. Internet Higher Ed. 29:23–30.Crossref, Google Scholar