Chapter 1: Theory and Learning Analytics

Total Page:16

File Type:pdf, Size:1020Kb

Chapter 1: Theory and Learning Analytics Chapter 1: Theory and Learning Analytics Simon Knight, Simon Buckingham Shum Connected Intelligence Centre, University of Technology Sydney, Australia DOI: 10.18608/hla17.001 ABSTRACT 7KHFKDOOHQJHRIXQGHUVWDQGLQJKRZWKHRU\DQGDQDO\WLFVUHODWHLVWRPRYHÜIURPFOLFNVWR FRQVWUXFWVÝLQDSULQFLSOHGZD\/HDUQLQJDQDO\WLFVDUHDVSHFLāFLQFDUQDWLRQRIWKHELJJHU shift to an algorithmically pervaded society, and their wider impact on education needs careful consideration. In this chapter, we argue that by design — or else by accident — the use of a learning analytics tool is always aligned with assessment regimes, which are in turn grounded in epistemological assumptions and pedagogical practices. Fundamentally WKHQZHDUJXHWKDWGHSOR\LQJDJLYHQOHDUQLQJDQDO\WLFVWRROH[SUHVVHVDFRPPLWPHQWWR a particular educational worldview, designed to nurture particular kinds of learners. We outline some key provocations in the development of learning analytic techniques, key questions to draw out the purpose and assumptions built into learning analytics. We suggest WKDWXVLQJÜFODLPVDQDO\VLVÝØDQDO\VLVRIWKHLPSOLFLWRUH[SOLFLWVWDQFHVWDNHQLQWKHGHVLJQ and deploying of technologies — is a productive human-centred method to address these NH\TXHVWLRQVDQGZHRIIHUVRPHH[DPSOHVRIWKHPHWKRGDSSOLHGWRWKRVHSURYRFDWLRQV Keywords: Theory, assessment regime, claims analysis In what has become a well-cited, popular article in ZLOODOZD\VEHVLJQLāFDQW">â@,QVXPZKHQ Wired PDJD]LQHLQWKHQHZHUDRISHWDE\WHVFDOH working with big data, theory is actually more data and analytics, Anderson (2008) envisaged the important, not less, in interpreting results and GHDWKRIWKHRU\PRGHOVDQGWKHVFLHQWLāFPHWKRG1R identifying meaningful, actionable results. longer do we need to create theories about how the )RUWKLVUHDVRQZHKDYHRIIHUHG'DWD*HRORJ\ world works, because the data will tell us directly as 6KDIIHU$UDVWRRSRXUHWDO DQG'DWD we discern, in almost real time, the impacts of probes Archeology (Wise, 2014) as more appropriate and changes we make. PHWDSKRUVWKDQ'DWD0LQLQJIRUWKLQNLQJ 7KLVKLJKSURāOHDUWLFOHDQGVRPHZKDWH[WUHPHFRQFOX - about how we sift through the new masses of VLRQDORQJZLWKRWKHUV VHHIRUH[DPSOH0D\HU6FK·Q - data while attending to underlying conceptual berger & Cukier, 2013), has, not surprisingly, attracted UHODWLRQVKLSVDQGWKHVLWXDWLRQDOFRQWH[W FULWLFLVP ER\G &UDZIRUG3LHWVFK 'DWDLQWHQVLYHPHWKRGVDUHKDYLQJDQGZLOOFRQWLQXH Educational researchers are one community interested WRKDYHDWUDQVIRUPDWLYHLPSDFWRQVFLHQWLāFLQTXLU\ LQWKHDSSOLFDWLRQRIÜELJGDWDÝDSSURDFKHVLQWKHIRUP +H\7DQVOH\ 7ROOH ZLWKIDPLOLDUÜELJVFLHQFHÝ RIOHDUQLQJDQDO\WLFV$FULWLFDOTXHVWLRQWXUQVRQH[ - H[DPSOHVLQFOXGLQJJHQHWLFVDVWURQRP\DQGKLJK BRCA2 gene Red Dwarf actly how theory could, or should shape research in energy physics. The , stars, Higgs bosun this new paradigm. Equally, a critical view is needed and the do not hold strong views on being on how the new tools of the trade enhance/constrain computationally modelled, or who does what with the people WKHRUL]LQJE\YLUWXHRIZKDWWKH\GUDZDWWHQWLRQWR results. However, when become aware that and what they ignore or downplay. Returning to our their behaviour is under surveillance, with potentially opening provocation from Anderson, the opposite important consequences, they may choose to adapt FRQFOXVLRQLVGUDZQE\:LVHDQG6KDIIHU S RUGLVWRUWWKHLUEHKDYLRXUWRFDPRXĂDJHDFWLYLW\RU to game the system. Learning analytics researchers :KDWFRXQWVDVDPHDQLQJIXOāQGLQJZKHQWKH aiming to study learning using such tools must do so number of data points is so large that something aware that they have adopted a particular set of lenses CHAPTER 1 THEORY AND LEARNING ANALYTICS PG 17 RQÜOHDUQLQJÝWKDWDPSOLI\DQGGLVWRUWLQSDUWLFXODU dence, at scale, the kinds of process-intensive learning ways, and that may unintentionally change the system that educators have long argued for, but have to date being tracked. Researchers should stay alert to the SURYHQLPSUDFWLFDO"([DFWO\ZKDWRQHVHHNVWRGRZLWK emerging critical discourse around big data in soci- analytics is at the heart of this chapter. ety, data-intensive science broadly, as well as within To design analytics-based lenses — with our eyes wide education where the debate is at a nascent stage. RSHQWRWKHULVNVRIGLVWRUWLQJRXUGHāQLWLRQRIÜOHDUQLQJÝ Let us turn now to educators and learners . The potential in our desire to track it computationally — we must RIOHDUQLQJDQDO\WLFVLVDUJXDEO\IDUPRUHVLJQLāFDQW XQSLFNZKDWLVDWVWDNHZKHQFODVVLāFDWLRQVFKHPHV than as an enabler of data-intensive educational machine learning, recommendation algorithms, and UHVHDUFKH[FLWLQJDVWKLVLV7KHQHZSRVVLELOLW\LV YLVXDOL]DWLRQVPHGLDWHWKHUHODWLRQVKLSVEHWZHHQ that educators and learners — the stakeholders who educators, learners, policymakers, and researchers. constitute the learning system studied for so long by The challenge of understanding how theory and an- UHVHDUFKHUVØDUHIRUWKHāUVWWLPHDEOHWRVHHWKHLU DO\WLFVUHODWHLVWRPRYHÜIURPFOLFNVWRFRQVWUXFWVÝ own processes and progress rendered in ways that in a principled way. until now were the preserve of researchers outside the /HDUQLQJDQDO\WLFVDUHDVSHFLāFLQFDUQDWLRQRIWKH V\VWHP'DWDJDWKHULQJDQDO\VLVLQWHUSUHWDWLRQDQG bigger shift to an algorithmically pervaded society. The even intervention (in the case of adaptive software) is frame we place around the relationship of theory to no longer the preserve of the researcher, but shifts to learning analytics must therefore be enlarged beyond embedded sociotechnical educational infrastructure. FRQVLGHUDWLRQVRIZKDWLVQRUPDOO\FRQVLGHUHGÜHGX - educators and learners So, for , the interest turns on FDWLRQDOWKHRU\ÝWRHQJDJHZLWKWKHFULWLFDOGLVFRXUVH the ability to gain insight in a timely manner that could around how sociotechnical infrastructures deliver improve outcomes. computational intelligence in society. Thus, with people in the analytic loop, the system The remainder of the chapter argues that by design EHFRPHVUHĂH[LYH SHRSOHFKDQJHLQUHVSRQVHWRWKH — or else by accident — the use of a learning analytics DFWRIREVHUYDWLRQDQGH[SOLFLWIHHGEDFNORRSV DQG tool is always aligned with assessment regimes , which ZHFRQIURQWQHZHWKLFDOGLOHPPDV 3DUGR 6LHPHQV are in turn grounded in epistemological assumptions 3ULQVORR 6ODGH 7KHGHVLJQFKDOOHQJH and pedagogical practices 0RUHRYHUDVZHVKDOOH[ - moves from that of modelling closed, deterministic plain, a long history of design thinking demonstrates V\VWHPVLQWRWKHVSDFHRIÜZLFNHGSUREOHPVÝ 5LWWHO that designed artifacts unavoidably embody implicit DQGFRPSOH[DGDSWLYHV\VWHPV 'HDNLQ&ULFN values and claims. Fundamentally then, we argue that 0DFIDG\HQ'DZVRQ3DUGR *DÇHYLİ $V GHSOR\LQJDJLYHQOHDUQLQJDQDO\WLFVWRROH[SUHVVHVD we hope to clarify, for someone trying to get a robust commitment to a particular educational worldview, PHDVXUHRIÜOHDUQLQJÝIURPGDWDWUDFHVVXFKUHĂH[LYLW\ designed to nurture particular kinds of learners. will be either a curse or a blessing, depending on how important learner agency and creativity are deemed THEORY INTO PRACTICE WREHKRZā[HGWKHLQWHQGHGOHDUQLQJRXWFRPHVDUH whether analytical feedback loops are designed as interventions to shape learner cognition/interaction, In an earlier paper (Knight, Buckingham Shum, & Lit- and so forth. tleton, 2014) we put forward a triadic depiction of the relationship between elements of theory and practice Our view is that it is indeed likely that education, as in the development of learning analytic techniques, ERWKDUHVHDUFKāHOGDQGDVDSURIHVVLRQDOSUDFWLFH as depicted in Figure 1.1 (we refer the reader to this is on the threshold of a data-intensive revolution paper for further discussion of the depicted relation- DQDORJRXVWRWKDWH[SHULHQFHGE\RWKHUāHOGV$VWKH ships). Our intention was to illustrate the tensions and site of political and commercial interests, education inter-relations among the more or less theoretically LVGULYHQE\SROLF\LPSHUDWLYHVIRUÜLPSDFWHYLGHQFHÝ grounded stances we take through our pedagogic and and software products shipping with analytics dash- assessment practices and policies, and their underlying boards. While such drivers are typically viewed with epistemological implications and assumptions. suspicion by educational practitioners and researchers, the opportunity is to be welcomed if we can learn how The use of a triangle highlights these tensions: that to harness and drive the new horsepower offered by assessment can be the driving force in how we un- analytics engines, in order to accelerate innovation and GHUVWDQGZKDWÜNQRZOHGJHÝLVWKDWDVVXPSWLRQVDERXW improve evidence-based decision-making. Systemic SHGDJRJ\ IRUH[DPSOHDNLQGRIIRONSV\FKRORJ\2OVRQ educational shifts are of course tough to effect, but %UXQHU LQĂXHQFHZKRZHDVVHVVDQGKRZWKDW could it be that analytics tools offer new ways to evi- assessment and pedagogy are sometimes in tension, where the desire for summative assessment overrides PG 18 HANDBOOK OF LEARNING ANALYTICS pedagogically motivated formative feedback; and that centred on the triad of epistemology, pedagogy, and drawing alignment between one’s epistemological assessment. view (of the nature of knowledge) and assessment We use these provocations to illustrate how the im- or pedagogy practices is challenging — relationships SOLFLWÜFODLPVÝPDGHE\DOHDUQLQJDQDO\WLFVWRROFDQ between the three may be implied, but they are not EHGHFRQVWUXFWHG7KHDSSURDFKLQYLWHVUHĂHFWLRQ entailed 'DYLV :LOOLDPV 2IFRXUVHRWKHU on the affordances of the tool’s design at different YLVXDOL]DWLRQVPLJKWEHLPDJLQHGDQGWKHWKHRUHWLFDO OHYHOV LQFOXGLQJGDWDPRGHOOHDUQHUH[SHULHQFHDQG and practical purposes for which such heuristics are OHDUQLQJDQDO\WLFVYLVXDOL]DWLRQ GHYLVHGLVLPSRUWDQWWRFRQVLGHU7RJLYHWZRH[DP
Recommended publications
  • Learning Analytics: Learning to Think and Make Decisions
    LEARNING ANALYTICS: LEARNING TO THINK AND MAKE DECISIONS Airina Volungevičienė, Vytautas Magnus University Josep Maria Duart, Universitat Oberta de Catalunya Justina Naujokaitienė, Vytautas Magnus University Giedrė Tamoliūnė, Vytautas Magnus University Rita Misiulienė, Vytautas Magnus University ABSTRACT The research aims at a specific analysis of how learning analytics as a metacognitive tool can be used as a method by teachers as reflective professionals and how it can help teachers learn to think and come down to decisions about learning design and curriculum, learning and teaching process, and its success. Not only does it build on previous research results by interpreting the description of learning analytics as a metacognitive tool for teachers as reflective professionals, but also lays out new prospects for investigation into the process of learning analytics application in open and online learning and teaching. The research leads to the use of learning analytics data for the implementation of teacher inquiry cycle and reflections on open and online teaching, eventually aiming at an improvement of curriculum and learning design. The results of the research demonstrate how learning analytics method can support teachers as reflective professionals, to help understand different learning habits of their students, recognize learners’ behavior, assess their thinking capacities, willingness to engage in the course and, based on the information, make real time adjustments to their course curriculum. Key words: learning analytics, metacognition, reflective professionals INTRODUCTION education with the prospect of reconsidering how Learning analytics can be defined as the learning analytics may contribute to better teaching measurement and collection of extensive data and learning and address, in particular, issues in about learners with the aim of understanding higher education (Zilvinskis & Borden, 2017) and and optimizing the learning process and the massive open and online learning.
    [Show full text]
  • New Potentials for Data-Driven Intelligent Tutoring System Development and Optimization
    New Potentials for Data-Driven Intelligent Tutoring System Development and Optimization Short title: Data-Driven Improvement of Intelligent Tutors Authors: Kenneth R. Koedinger, Emma Brunskill, Ryan S.J.d. Baker, Elizabeth A. McLaughlin, and John Stamper Keywords: educational data mining, learning analytics, artificial intelligence in education, machine learning for student modeling Abstract Increasing widespread use of educational technologies is producing vast amounts of data. Such data can be used to help advance our understanding of student learning and enable more intelligent, interactive, engaging, and effective education. In this paper, we discuss the status and prospects of this new and powerful opportunity for data-driven development and optimization of educational technologies, focusing on Intelligent Tutoring Systems. We provide examples of use of a variety of techniques to develop or optimize the select, evaluate, suggest, and update functions of intelligent tutors, including probabilistic grammar learning, rule induction, Markov decision process, classification, and integrations of symbolic search and statistical inference. 1. Introduction Technologies to support learning and education, such as Intelligent Tutoring Systems (ITS), have a long history in artificial intelligence. AI methods have advanced considerably since those early days, and so have intelligent tutoring systems. Today, Intelligent Tutoring Systems are in widespread use in K12 schools and colleges and are enhancing the student learning experience (e.g., Graesser et al. 2005; Mitrovic 2003; Van Lehn 2006). As a specific example, Cognitive Tutor mathematics courses are in regular use, about two-days a week, by 600,000 students a year in 2600 middle or high schools, and full- year evaluation studies of Cognitive Tutor Algebra have demonstrated better student learning compared to traditional algebra courses (Ritter et al.
    [Show full text]
  • Downloads/D4.1.Pdf B
    Becheru et al. Smart Learning Environments (2018) 5:18 Smart Learning Environments https://doi.org/10.1186/s40561-018-0063-0 RESEARCH Open Access Analyzing students’ collaboration patterns in a social learning environment using StudentViz platform Alex Becheru, Andreea Calota and Elvira Popescu* * Correspondence: popescu_elvira@ software.ucv.ro; elvira.popescu@ Abstract gmail.com ’ This is a substantially extended and Understanding students collaboration patterns is an important goal for teachers, revised version of the paper: Alex who can thus obtain an insight into the collaborative learning process. Social Becheru, Andreea Calota, Elvira network analysis and network visualizations are commonly used for exploring social Popescu, StudentViz: A Tool for Visualizing Students’ Collaborations interactions between learners. However, most existing network visualization in a Social Learning Environment, platforms are deemed too complex by the teachers, who do not possess social Challenges and Solutions in Smart network analysis expertise. Therefore, we propose an easy to use platform for Learning, Lecture Notes in ’ Educational Technology, Springer, visualizing students collaboration patterns, called StudentViz. An overview of the pp. 77–86, 2018. tool, including a description of its implementation and functionalities, is provided in Computers and Information the paper. An illustration of how the tool can be used in practice, for investigating Technology Department, University ’ of Craiova, Bvd. Decebal, nr. 107, students collaboration patterns in a social learning environment, is also included. 200440 Craiova, Romania Keywords: Collaboration patterns, Collaborative learning, Social learning environments, Learning analytics, Network visualization, Social networks analysis Introduction Information visualization relies on the remarkable visual perception abilities of humans for pattern discovery (Yi et al., 2008).
    [Show full text]
  • Using Social Learning Analytics to Observe New Media Literacy Skills
    What Can We Learn from Facebook Activity? Using Social Learning Analytics to Observe New Media Literacy Skills June Ahn University of Maryland, College Park College of Information Studies and College of Education 2117J Hornbake Building, South Wing, College Park, MD, USA [email protected] st ABSTRACT 21 century skills is not new, but the nature of these skills is Social media platforms such as Facebook are now a ubiquitous profoundly different in media-rich environments. For example, part of everyday life for many people. New media scholars posit collaboration is an enduring human skill, but individuals must that the participatory culture encouraged by social media gives now be able to collaborate in environments that are mediated by rise to new forms of literacy skills that are vital to learning. technology, across distances, with mass numbers of users, and However, there have been few attempts to use analytics to with easy access to information. understand the new media literacy skills that may be embedded in Literacy scholars also contribute to this dialogue by elaborating an individual’s participation in social media. In this paper, I particular skills that are important when individuals interact with collect raw activity data that was shared by an exploratory sample new media. For example, Jenkins [19] observes that the rise of of Facebook users. I then utilize factor analysis and regression online communities such as Facebook facilitates a participatory models to show how (a) Facebook members’ online activity culture where individuals must develop literacies such as coalesce into distinct categories of social media behavior and (b) networking, information appropriation, remix, judgment, and how these participatory behaviors correlate with and predict collective intelligence.
    [Show full text]
  • Stupid Tutoring Systems, Intelligent Humans Ryan S. Baker
    Stupid Tutoring Systems, Intelligent Humans Ryan S. Baker Abstract The initial vision for intelligent tutoring systems involved powerful, multi-faceted systems that would leverage rich models of students and pedagogies to create complex learning interactions. But the intelligent tutoring systems used at scale today are much simpler. In this article, I present hypotheses on the factors underlying this development, and discuss the potential of educational data mining driving human decision-making as an alternate paradigm for online learning, focusing on intelligence amplification rather than artificial intelligence. The Initial Vision of Intelligent Tutoring Systems One of the initial visions for intelligent tutoring systems was a vision of systems that were as perceptive as a human teacher (see discussion in Self, 1990) and as thoughtful as an expert tutor (see discussion in Shute, 1990), using some of the same pedagogical and tutorial strategies as used by expert human tutors (Merrill, Reiser, Ranney, & Trafton, 1992; Lepper et al., 1993; McArthur, Stasz, & Zmuidzinas, 1990). These systems would explicitly incorporate knowledge about the domain and about pedagogy (see discussion in Wenger, 1987), as part of engaging students in complex and effective mixed-initiative learning dialogues (Carbonell, 1970). Student models would infer what a student knew (Goldstein, 1979), and the student’s motivation (Del Soldato & du Boulay, 1995), and would use this knowledge in making decisions that improved student outcomes along multiple dimensions. An intelligent tutoring system would not just be capable of supporting learning. An intelligent tutoring system would behave as if it genuinely cared about the student’s success (Self, 1998).1 This is not to say that such a system would actually simulate the process of caring and being satisfied by a student’s success, but the system would behave identically to a system that did, meeting the student’s needs in a comprehensive fashion.
    [Show full text]
  • Contextualizable Learning Analytics Design: a Generic Model and Writing Analytics Evaluations
    Contextualizable Learning Analytics Design: A Generic Model and Writing Analytics Evaluations Antonette Shibani† Simon Knight Simon Buckingham Shum University of Technology Sydney University of Technology Sydney University of Technology Sydney Sydney NSW Australia Sydney NSW Australia Sydney NSW Australia [email protected] [email protected] [email protected] ABSTRACT 1 Introduction A major promise of learning analytics is that through the collection of large amounts of data we can derive insights from With the growing quantity of data generated from the Internet of authentic learning environments, and impact many learners at Things (IoT) and digitization, there is increasing interest in scale. However, the context in which the learning occurs is analytics and big data. In education, high profile initiatives like important for educational innovations to impact student learning. massive online courses (MOOCS), online video-based learning, In particular, for student-facing learning analytics systems like educational apps, and personal and portable computing devices, feedback tools to work effectively, they have to beintegrated with have provided access to increased quantities of learner data [25]. pedagogical approaches and the learning design. This paper Thus, analytics and big data in education holds the potential to proposes a conceptual model to strike a balance between the develop scalable methods that can be employed widely across concepts of generalizable scalable support and contextualized specific support
    [Show full text]
  • A Bibliometric Study on Learning Analytics
    Long Island University Digital Commons @ LIU Selected Full Text Dissertations, 2011- LIU Post 2019 A Bibliometric Study on Learning Analytics Bertha Abby Adeniji Follow this and additional works at: https://digitalcommons.liu.edu/post_fultext_dis A Bibliometric Study on Learning Analytics A Dissertation Submitted to the Faculty of The Palmer School of Library and Information Science at Long Island University by Bertha (Abby) Adeniji Advisor: Professor Qiping Zhang May 3, 2019 i Table of Contents List of Figures .................................................................................................................... iv List of Tables ...................................................................................................................... v Dedication ......................................................................................................................... vii Acknowledgment ............................................................................................................. viii Abstract .............................................................................................................................. ix Chapter 1: Introduction ..................................................................................................... 10 1.1 Theoretical Positioning of Learning Analytics (LA) ........................................... 10 1.2 Motivation and Objective............................................................................................... 12 1.3 Significance .........................................................................................................................
    [Show full text]
  • Exploring Social Network Analysis in Blended Learning Teacher Training Programs
    WLC 2016 : World LUMEN Congress. Logos Universality Mentality Education Novelty 2016 | LUMEN 15th Anniversary Edition Exploring Social Network Analysis in Blended Learning Teacher Training Programs Mihai Bîzoia*, Ana-Maria Suducb, Gabriel Gorghiuc * Corresponding author: Mihai Bîzoi, [email protected] aFaculty of Electrical Engineering, Electronics and Information Technology, Valahia University Targoviste, Romania, [email protected] bFaculty of Electrical Engineering, Electronics and Information Technology, Valahia University Targoviste, Romania, [email protected] cTeacher Training Department, Valahia University Targoviste, Romania, [email protected] Abstract http://dx.doi.org/10.15405/epsbs.2016.09.15 Learning Analytics is an educational application of web analytics and it is used to analyze the learners’ activities on educational platforms, in order to predict their behaviour. Learning Analytics reflects a field at the intersection of numerous academic disciplines and is using different methods like: statistics, visualizations, data/web mining, and social network analysis. Social network analysis aim is to discover patterns in individual interactions. Network analysis is based on the intuitive notion that these patterns are important attributes of the individuals’ lives. The social network analysis can be made with different software applications and it’s very important to support networked learning. Learning Analytics tools for social network analysis are providing a framework for interpreting and developing an understanding of the observed patterns of exchanges that occur between social actors. The on-line / blended educational programs from the last decades have collected an enormous quantity of data. These data include initial evaluation information, data from the training process and results of the training program. These data can be used to validate the learning analytics theory.
    [Show full text]
  • Recommendations for Network Research in Learning Analytics: to Open a Conversation
    Recommendations for Network Research in Learning Analytics: To Open a Conversation 1 2 3 Oleksandra Poquet , Mohammed Saqr , Bodong Chen 1 Centre for Change and Complexity in Learning (C3L), University of South Australia, Australia 2 University of Eastern Finland, Finland 3 University of Minnesota, USA Abstract Network science methods are widely adopted in learning analytics, an applied research area that focuses on the analysis of learning data to understand and improve learning. The workshop, taking place at the 11th International Learning Analytics and Knowledge conference, focused on the applications of network science in learning analytics. The workshop attracted over twenty researchers and practitioners working with network analysis and educational data. The workshop included work-in-progress and group-wide conversations about enhancing the quality of network research in learning analytics. The conversations were driven by concerns around reproducibility and interpretability currently discussed across research communities. This paper presents a snapshot of the workshop discussions beyond its work-in-progress papers. To this end, we summarize a literature review presented to the workshop participants, with the focus on the elements related to the reproducibility and interpretability of network research in education settings. We also provide a summary of the workshop discussions and conclude with suggested guidelines for the reporting of network methods to improve generalizability and reproducibility. Keywords 1 Network science, education, learning analytics, learning sciences, recommendations 1. Introduction Learning analytics (LA) aims to use “measurement, collection, analysis and reporting of data about learners and their contexts, for purposes of understanding and optimizing learning and the environments in which it occurs” [1, p.1382].
    [Show full text]
  • Analytics for Education
    Analytics for Education JIME http://jime.open.ac.uk/2014/07 Sheila MacNeill [email protected] Lorna M. Campbell [email protected] Martin Hawksey [email protected] Centre for Interoperability Standards (CETIS), UK Abstract: This article presents an overview of the development and use of analytics in the context of education. Using Buckingham Shum's three levels of analytics, the authors present a critical analysis of current developments in the domain of learning analytics, and contrast the potential value of analytics research and development with real world educational implementation and practice. The article also focuses on the development of education content analytics and considers the legal and ethical implications of collecting and analysing educational data. Looking to the future, the authors also highlight new developments including exploration of data from massive open online courses (MOOCs). Keywords: Analytics, learning analytics, educational data mining, big data, paradata, educational data, learning technology Over the past five years a number of factors, not least the changing economic climate and its impact on the educational sector, have led to increased awareness of the need for greater research, analysis and understanding of all aspects of data relating to education. Researchers in the emerging fields ofeducational data mining (EDM) and learning analytics have been active in exploring the potential of data created through the processes of teaching and learning. In parallel with these developments, interest has also increased in the potential of "big data" and the application of business intelligence approaches to the educational sector. For example, can the recommendation systems commonly used by companies such as Amazon and Netflix be employed in educational contexts? The emergence of MOOCs (massive open online courses) can be seen as a key area where big data approaches can be applied to learning data sets due to the massive scale of participation.
    [Show full text]
  • Learning Analytics in Higher Education a Review of UK and International Practice Full Report
    Learning Analytics in Higher Education A review of UK and international practice Full report April 2016 Authors Niall Sclater Alice Peasgood Joel Mullan “Learning Analytics in Higher Education: A review of UK and international practice” © Jisc Published under the CC BY 4.0 licence creativecommons.org/licenses/by/4.0/ Contents Executive summary 4 Use and impact of learning analytics: lessons from the case studies 8 Analytics have been perceived positively by students 10 Conclusions 11 1. Introduction 12 Motivations for use of student data 12 Benefits for learners 13 Developments in the UK 13 2. Learning analytics: a new and rapidly developing field 15 Defining learning analytics 15 Can analytics predict academic success? 15 3. How learning analytics works 17 Data sources 17 Technical infrastructure 18 4 Findings and impact – lessons from the case studies 21 What impact has student data analytics had? 22 Predictive learning analytics models – are they accurate? 23 Alternatives to predictive models 24 How have analytics been used? 25 Student perceptions 26 5. Case Study Summaries 27 A. Traffic lights and interventions: Signals at Purdue University 27 B. Analysing use of the VLE at the University of Maryland, Baltimore County 28 C. Identifying at-risk students at New York Institute of Technology 29 D. Fine-grained analysis of student data at California State University 30 E. Transferring predictive models to other institutions from Marist College 31 F. Enhancing retention at Edith Cowan University 32 G. Early Alert at the University of New England 33 H. Developing an ‘analytics mind-set’ at the Open University 34 I.
    [Show full text]
  • Data Mining and Learning Analytics Wiley Series on Methods and Applications in Data Mining
    DATA MINING AND LEARNING ANALYTICS WILEY SERIES ON METHODS AND APPLICATIONS IN DATA MINING Series Editor: Daniel T. Larose • Discovering Knowledge in Data: An Introduction to Data Mining, Second Edition Daniel T. Larose and Chantal D. Larose • Data Mining for Genomics and Proteomics: Analysis of Gene and Protein Expression Darius M. Dziuda • Knowledge Discovery with Support Vector Machines Lutz Hamel • Data Mining on the Web: Uncovering Patterns in Web Content, Structure, and Usage Zdravko Markov and Daniel T. Larose • Data Mining Methods and Models Daniel T. Larose • Practical Text Mining with Perl Roger Bilisoly • Data Mining and Predictive Analytics Daniel T. Larose and Chantal D. Larose DATA MINING AND LEARNING ANALYTICS Applications in Educational Research Edited by SAMIRA ELATIA DONALD IPPERCIEL OSMAR R. ZAÏANE Copyright © 2016 by John Wiley & Sons, Inc. All rights reserved Published by John Wiley & Sons, Inc., Hoboken, New Jersey Published simultaneously in Canada No part of this publication may be reproduced, stored in a retrieval system, or transmitted in any form or by any means, electronic, mechanical, photocopying, recording, scanning, or otherwise, except as permitted under Section 107 or 108 of the 1976 United States Copyright Act, without either the prior written permission of the Publisher, or authorization through payment of the appropriate per‐copy fee to the Copyright Clearance Center, Inc., 222 Rosewood Drive, Danvers, MA 01923, (978) 750‐8400, fax (978) 750‐4470, or on the web at www.copyright.com. Requests to the Publisher for permission should be addressed to the Permissions Department, John Wiley & Sons, Inc., 111 River Street, Hoboken, NJ 07030, (201) 748‐6011, fax (201) 748‐6008, or online at http://www.wiley.com/go/permissions.
    [Show full text]