Numbers Are Not Enough. Why e-Learning Analytics Failed to Inform an Institutional Strategic Plan
ARTICLE
Leah P. Macfadyen, Shane Dawson
Journal of Educational Technology & Society Volume 15, Number 3, ISSN 1176-3647 e-ISSN 1176-3647
Abstract
Learning analytics offers higher education valuable insights that can inform strategic decision-making regarding resource allocation for educational excellence. Research demonstrates that learning management systems (LMSs) can increase student sense of community, support learning communities and enhance student engagement and success, and LMSs have therefore become core enterprise component in many universities. We were invited to undertake a current state analysis of enterprise LMS use in a large research-intensive university, to provide data to inform and guide an LMS review and strategic planning process. Using a new e-learning analytics platform, combined with data visualization and participant observation, we prepared a detailed snapshot of current LMS use patterns and trends and their relationship to student learning outcomes. This paper presents selected data from this "current state analysis" and comments on what it reveals about the comparative effectiveness of this institution's LMS integration in the service of learning and teaching. More critically, it discusses the reality that the institutional planning process was nonetheless dominated by technical concerns, and made little use of the intelligence revealed by the analytics process. To explain this phenomenon we consider theories of change management and resistance to innovation, and argue that to have meaningful impact, learning analytics proponents must also delve into the socio-technical sphere to ensure that learning analytics data are presented to those involved in strategic institutional planning in ways that have the power to motivate organizational adoption and cultural change. (Contains 2 tables and 4 figures.)
Citation
Macfadyen, L.P. & Dawson, S. (2012). Numbers Are Not Enough. Why e-Learning Analytics Failed to Inform an Institutional Strategic Plan. Journal of Educational Technology & Society, 15(3), 149-163. Retrieved April 22, 2021 from https://www.learntechlib.org/p/74968/.

ERIC is sponsored by the Institute of Education Sciences (IES) of the U.S. Department of Education.
Copyright for this record is held by the content creator. For more details see ERIC's copyright policy.
Keywords
- case studies
- College Administration
- Computer Managed Instruction
- Computer System Design
- Computer Uses in Education
- Data
- Data Analysis
- decision making
- Educational Change
- educational innovation
- electronic learning
- Foreign Countries
- Influence of Technology
- information retrieval
- Integrated Learning Systems
- online courses
- organizational change
- Organizational Culture
- Organizational Theories
- Outcomes of Education
- Participant Observation
- Program Evaluation
- Research Universities
- Resistance to change
- Resource Allocation
- Strategic Planning
- Use Studies
Cited By
View References & Citations Map-
Learning Analytics: Readiness and Rewards
Norm Friesen
Canadian Journal of Learning and Technology / La revue canadienne de l’apprentissage et de la technologie Vol. 39, No. 4 (Dec 21, 2013)
-
Tracking e-learning through published papers: A systematic review
Helena Rodrigues, Filomena Almeida, Vanessa Figueiredo & Sara L. Lopes, Instituto Universitário de Lisboa (ISCTE-IUL), Portugal
Computers & Education Vol. 136, No. 1 (July 2019) pp. 87–98
-
Correlation between Grades Earned and Time in Online Courses
Lin Carver, Keya Muhkerjee & Robert Lucio
Online Learning Journal Vol. 21, No. 4 (Dec 01, 2017)
-
Analytics to literacies: The development of a learning analytics framework for multiliteracies assessment
Shane Dawson, University of South Australia; George Siemens, University of Texas, Arlington
The International Review of Research in Open and Distributed Learning Vol. 15, No. 4 (Aug 15, 2014)
-
eLearning Analytics Governance Modeling
Noureddine Elouazizi, Simon Fraser University and CGAC, Canada
E-Learn: World Conference on E-Learning in Corporate, Government, Healthcare, and Higher Education 2013 (Oct 21, 2013) pp. 1641–1646
-
Learning Analytics: Readiness and Rewards / L’analyse de l’apprentissage : état de préparation et récompenses
Norm Friesen, Thompson Rivers
Canadian Journal of Learning and Technology / La revue canadienne de l’apprentissage et de la technologie Vol. 39, No. 4 (Dec 21, 2013)
These links are based on references which have been extracted automatically and may have some errors. If you see a mistake, please contact info@learntechlib.org.