In Search of Quality: Using Quality Matters to Analyze the Quality of Massive, Open, Online Courses (MOOCs)
ARTICLE
Patrick Lowenthal, Boise State University ; Charles Hodges, Georgia Southern University
IRRODL Volume 16, Number 5, ISSN 1492-3831 Publisher: Athabasca University Press
Abstract
The concept of the massive, open, online course (MOOC) is not new, but high-profile initiatives have moved MOOCs into the forefront of higher education news over the past few years. Members of institutions of higher education have mixed feelings about MOOCs, ranging from those who want to offer college credit for the successful completion of MOOCs to those who fear MOOCs are the end of the university as we know it. We set forth to investigate the quality of MOOCs by using the Quality Matters quality control framework. In this article, we present the results of our inquiry, with a specific focus on the implications the results have on day-to-day practice of designing online courses.
Citation
Lowenthal, P. & Hodges, C. (2015). In Search of Quality: Using Quality Matters to Analyze the Quality of Massive, Open, Online Courses (MOOCs). The International Review of Research in Open and Distributed Learning, 16(5),. Athabasca University Press. Retrieved March 28, 2024 from https://www.learntechlib.org/p/152347/.
Keywords
References
View References & Citations Map- Adair, D., Alman, S.W., Budzick, D., Grishman, L.M., Mancini, M.E., & Thackaberry, S. (2014). Many shades of MOOCs. Internet Learning, 3(1), 53-72.
- Allen, I.E., Seaman, J., Lederman, D., & Jaschik, S. (2012). Conflicted: Faculty and online education. Inside Higher Ed, Babson Survey Research Group, and Quahog Research Group. Retrieved from http://www.insidehighered.com/sites/default/server_files/files/IHE-BSRG-Conflict.pdf
- Allen, M.W. (2003). Michael Allen's guide to e-learning: Building interactive, fun, and effective learning programs for any company. Hoboken, NJ: John Wiley& Sons.
- Anderson, T. (2013). Promise and/or peril: MOOCs and open and distance education. Commonwealth of Learning. Retrieved from http://www.ethicalforum.be/sites/default/files/MOOCsPromisePeril.pdf
- Batchelder, L. (2009, October). Do learners really need learning objectives? Retrieved from http://www.bottomlineperformance.com/do-learners-really-need-learning-objectives/
- Bean, C. (2009, July). Our objection to learning objectives. Retrieved from http://www.kineo.com/us/resources/top-tips/learning-strategy-and-design/ourobjection-to-learning-objectives
- Bejerano, A.R. (2008). Face-to-face or online instruction? Face-to-face is better. Communications Current, 3(3). Retrieved from https://www.natcom.org/CommCurrentsArticle.aspx?id=884
- Bernard, R.M., Abrami, P.C., Lou, Y., Borokhovski, E., Wade, A., Wozney, L., Wallet, P.A., Fiset, M., & Huang, B. (2004). How does distance education compare with classroom instruction? A meta-analysis of the empirical literature. Review of educational research, 74(3), 379-439.
- Bidwell, A. (2013, September). Employers, students remain skeptical of online education. US News. Retrieved from http://www.usnews.com/news/articles/2013/09/20/employersstudents-remain-skeptical-of-online-education
- California State Faculty Association. (2013, May). Massive virtual fires engulf San Jose State University. Retrieved from http://chronicle.com/article/Document-San-JoseStateUs/139139/
- Carey, D. (2013, December). Pay no attention to supposed low MOOC completion rates. New America: EdCentral. Retrieved from http://www.edcentral.org/pay-attentionsupposedly-low-mooc-completion-rates/
- Carr, N. (2012, September). The crisis in higher education. MIT Technology Review. Retrieved from http://www.technologyreview.com/featuredstory/429376/the-crisis-in-highereducation/
- Conole, G. (2013). MOOCs as disruptive technologies: Strategies for enhancing the learner experience and quality MOOCs. Revista de Educación a Distancia, 39. Retrieved from http://www.um.es/ead/red/39/conole.pdf
- Coursera. (2013, February 7). Five courses receive college credit recommendations. Retrieved from http://blog.coursera.org/post/42486198362/five-courses-receive-college-creditrecommendations
- DeBoer, J., Ho, A.D., Stump, G.S., & Breslow, L. (2014). Changing “course”: Reconceptualizing educational variables for massive open online courses. Educational Researcher, 43(2), 74-84.
- Delbanco, A. (2013, March). MOOCs of hazard. New Republic. Retrieved from http://www.newrepublic.com/article/112731/moocs-will-online-education-ruinuniversity-experience
- Downes, S. (2011, January). ‘Connectivism’ and connective knowledge. Huffington Post. Retrieved from http://www.huffingtonpost.com/stephen-downes/connectivism-andconnecti_b_804653.html
- Duffy, T.M., & Kirkley, J.R. (Eds.) (2004). Learners-centered theory and practice in distance education: Cases from higher education. Mahwah, NJ: Lawrence Erlbaum.
- Edmundson, M. (2012, July). The trouble with online education. New York Times. Retrieved from http://www.nytimes.com/2012/07/20/opinion/the-trouble-with-online-education.html
- EDUCAUSE. (2012). What campus leaders need to know about MOOCs: An EDUCAUSE executive briefing. Retrieved from http://net.educause.edu/ir/library/pdf/PUB4005.pdf
- Ertmer, P.A., & Newby, T.J. (1993). Behaviorism, cognitivism, constructivism: Comparing critical features from an instructional design perspective. Performance Improvement Quarterly, 6(4), 50-72.
- Fain, P. (2013, January). As California goes? Inside Higher Ed. Retrieved from http://www.insidehighered.com/news/2013/01/16/california-looks-moocs-online-push
- Gabriel, T. (2011, April). More pupils are learning online, fueling debate on quality. The New York Times. Retrieved from http://www.nytimes.com/2011/04/06/education/06online.html
- Glass, G.V., & Smith, M.L. (1979). Meta-analysis of research on class size and achievement. Educational Evaluation and Policy Analysis, 1(1), 2-16.
- Inglis, A. (2005). Quality improvement, quality assurance, and benchmarking: comparing two frameworks for managing quality processes in open and distance learning. The International Review of Research in Open and Distributed Learning, 6(1). Retrieved from http://www.irrodl.org/index.php/irrodl/article/view/221/304
- Jaggars, S.S. (2011). Online learning: Does it help low-income and underprepared students? (CCRC Working Paper No. 26, Assessment of Evidence Series). New York, NY: Columbia University, Teachers College, Community College Research Center.
- Jaggars, S., & Bailey, T.R. (2010). Effectiveness of fully online courses for college students: Response to a Department of Education meta-analysis. Retrieved from http://academiccommons.columbia.edu/download/fedora_content/download/ac:172121/CONTENT/effectiveness-online-response-meta-analysis.pdf
- Jaggars, S.S., & Xu, D. (2010). Online learning in the Virginia Community College system. New York, NY: Columbia University, Teachers College, Community College Research Center. 96 In Search of Quality: Using Quality Matters to Analyze the Quality of Massive, Open, Online Courses (MOOCs) Lowenthal and Hodges
- Jaschik, S., & Lederman, D. (2014). The 2014 Inside Higher Ed Survey of Faculty Attitudes on Technology: A study by Gallup and Inside Higher Ed. Inside Higher Ed. Retrieved from http://www.insidehighered.com/download/form.php?width=500 & Height=550 & Iframe=t
- Kilgore, W., & Lowenthal, P.R. (2015). The Human Element MOOC: An experiment in social presence. In R.D. Wright (Ed.), Student-teacher interaction in online learning environments (pp. 389-407). Hershey, PA: IGI Global.
- Kolowich, S. (2013, February). American council on higher education recommends 5 MOOCs for credit. The Chronicle of Higher Education. Retrieved from http://chronicle.com/article/American-Council-on-Education/137155/
- Kroll, K. (2013). Where have all the faculty gone? Inside HigherEd. Retrieved from https://www.insidehighered.com/views/2013/05/09/faculty-who-teach-online-areinvisible-campuses-essay
- Leddy, T. (2013, June). Are MOOCs good for students? Boston Review. Retrieved from http://bostonreview.net/us/are-moocs-good-students
- Lederman, D., & Barwick, D.W. (2007). Does class size matter? Inside HigherEd. Retrieved from https://www.insidehighered.com/views/2007/12/06/barwick
- Lockee, B.B., Moore, M., & Burton, J. (2001). Old concerns with new distance education research. EDUCAUSE Quarterly, 2, 60-62.
- Lytle, R. (2012, July). College professors fearful of online education growth. US News& World Reports. Retrieved from http://www.usnews.com/education/onlineeducation/articles/2012/07/06/college-professors-fearful-of-online-education-growth
- Markoff, J. (2011). Virtual and artificial, but 58,000 want course. The New York Times. Retrieved from http://www.nytimes.com/2011/08/16/science/16stanford.html
- Margaryan, A., Bianco, M., & Littlejohn, A. (2015). Instructional quality of Massive Open Online Courses (MOOCs). Computers& Education, 80, 77-83.
- Mazoue, J. (2013, October). Five myths about MOOCs. EDUCAUSE Review Online. Retrieved from http://www.educause.edu/ero/article/five-myths-about-moocs
- McDonald, J. (2002). “As good as face-to-face” as good as it gets? Journal of Asynchronous Learning Networks, 6(2). 10-23.
- Means, B., Toyama, Y., Murphy, R., Bakia, M., & Jones, K. (2009). Evaluation of evidence-based practices in online learning: A meta-analysis and review of online learning studies. US Department of Education.
- Meyer, K.A. (2002). Quality in distance education: Focus on on-line learning (ASHE-ERIC Higher Education Report). San Francisco, CA: Jossey-Bass.
- Meyer, K.A. (2004). Putting the distance learning comparison study in perspective: Its role as personal journey research. Online Journal of Distance Learning Administration, 7(1). Retrieved from http://www.westga.edu/~distance/ojdla/spring71/meyer71.pdf
- Miyazoe, T., & Anderson, T. (2013). Interaction Equivalency in an OER, MOOCS and Informal Learning Era. Journal of Interactive Media in Education, 2013(2). Retrieved from http://jime.open.ac.uk/articles//
- Moore, C. (2007, December). Makeover: Turn objectives into motivators [Weblog post]. Retrieved from http://blog.cathy-moore.com/2007/12/makeover-turn-objectives-intomotivators/
- Mulryan-Kyne, C. (2010). Teaching large classes at college and university level: Challenges and opportunities. Teaching in Higher Education, 15(2), 175-185.
- Palloff, R.M., & Pratt, K. (1999). Building learning communities in cyberspace. San Francisco, CA: Jossey-Bass.
- Pappano, L. (2012, November). The year of the MOOC. The New York Times. Retrieved from http://www.nytimes.com/2012/11/04/education/edlife/massive-open-online-coursesare-multiplying-at-a-rapid-pace.html
- Parker, K., Lenhart, A., & Moore, K. (2011). The digital revolution and higher education: College presidents, public differ on value of online learning. Pew Internet& American Life Project. Retrieved from http://www.pewsocialtrends.org/files/2011/08/onlinelearning.pdf
- Phipps, R., & Merisotis, J. (1999). What's the difference? A review of contemporary research on effectiveness of distance learning in higher education. Washington, DC: Institute for Higher Education. 98 In Search of Quality: Using Quality Matters to Analyze the Quality of Massive, Open, Online Courses (MOOCs) Lowenthal and Hodges
- Pretz, K. (2014). Low completion rates for MOOCs. IEEE Roundup. Retrieved from http://theinstitute.ieee.org/ieee-roundup/opinions/ieee-roundup/low-completion-ratesfor-moocs
- Public Agenda. (2013, September) Not yet sold: What employers and community college students think about online education: A report by Public Agenda. Retrieved from http://www.publicagenda.org/files/NotYetSold_PublicAgenda_2013.pdf
- Quality Matters. (2013). Higher Ed Program Rubric. Retrieved from https://www.qualitymatters.org/rubric
- Quality Matters. (2014). Introduction to the Quality Matters Program. Retrieved from https://www.qualitymatters.org/sites/default/files/Introduction%20to%20the%20Quality%20Matters%20Program%20HyperlinkedFinal2014.pdf
- Ralston-Berg, P. (2014). Surveying student perspectives of quality: Value of QM rubric items. Internet Learning, 3(1), 117-126.
- Rees, J. (2013, July). The MOOC racket. Slate. Retrieved from http://www.slate.com/articles/technology/future_tense/2013/07/moocs_could_be_disastrous_for_students_and_professors.html
- Reich, J. (2014). MOOC completion and retention in the context of student intent. EDUCAUSE Review Online. Retrieved from http://www.educause.edu/ero/article/mooc-completionand-retention-context-student-intent
- Rosen, R.J. (2012, July). Overblown-claims-of-failure watch: How not to gauge the success of online courses. The Atlantic. Retrieved from http://www.theatlantic.com/technology/archive/2012/07/overblown-claims-of-failurewatch-how-not-to-gauge-the-success-of-online-courses/260159/
- Rushkoff, D. (2013, January). Online courses need human element to educate. CNN. Retrieved from http://www.cnn.com/2013/01/15/opinion/rushkoff-moocs/index.html
- Russell, T.L. (1999). The "no significant difference" phenomenon. Raleigh: North Carolina University.
- Salmon, G. (2000). E-moderating: The key to teaching and learning online. London: Kogan Page.
- Samuels, B. (2013). Being present. Inside Higher Ed. Retrieved from https://www.insidehighered.com/views/2013/01/24/essay-flaws-distance-education
- Sharma, G. (2013, July). A MOOC delusion: Why visions to educate the world are absurd. The Chronicle of Higher Education. Retrieved from http://chronicle.com/blogs/worldwise/amooc-delusion-why-visions-to-educate-the-world-are-absurd/32599
- Shattuck, K. (2007). Quality Matters: Collaborative program planning at a state level. Online Journal of Distance Learning Administration, 10(3).
- Shattuck, K. (2012, May). What we’re learning from Quality Matters-focused research: Research, practice, continuous improvement. Quality Matters. Retrieved from https://www.qualitymatters.org/what-were-learning-paperfinalmay-182012dec2012kspdf/download/What%20we're%20learning%20paper_FINAL_May%201
- Wiley, D. (2002). The Disney debacle: Online instruction versus face-to-face instruction. TechTrends, 46(6), 72.
- Wilson, B.G., & Christopher, L. (2008). Hyper versus reality on campus: Why e-learning isn’t likely to replace a professor anytime soon. In S. Carliner& P. Shank (Eds.), The elearning handbook: Past promises, present challenges (pp. 55-76). San Francisco, CA:
- Yang, D., Sinha, T., Adamson, D., & Rose, C.P. (2013, December). “Turn on, tune in, dropout”: Anticipating student dropouts in massive open online courses. Proceedings from the 2013 NIPS Data-Driven Education Workshop, Lake Tahoe, NV. Retrieved from http://lytics.stanford.edu/datadriveneducation/papers/yangetal.pdf
- You, J., Hochlberg, S.A., Ballard, P., Xiao, M., & Walters, A. (2014). Measuring online course design: A comparative analysis. Internet Learning, 3(1), 35-52.
These references have been extracted automatically and may have some errors. Signed in users can suggest corrections to these mistakes.
Suggest Corrections to ReferencesCited By
View References & Citations Map-
“The fun they had” or about the quality of MOOC
Patrizia Ghislandi
Journal of e-Learning and Knowledge Society Vol. 12, No. 3 (Jun 22, 2016)
-
Teacher Professional Development in the Digital Age: Design Considerations for MOOCs for Teachers
Charles Hodges, Georgia Southern University, United States; Patrick Lowenthal, Boise State University, United States; Michael Grant, University of South Carolina - Columbia, United States
Society for Information Technology & Teacher Education International Conference 2016 (Mar 21, 2016) pp. 2075–2081
-
In Search of Quality: Using Quality Matters to Analyze the Quality of Massive, Open, Online Courses (MOOCs)
Patrick Lowenthal, Boise State University; Charles Hodges, Georgia Southern University
The International Review of Research in Open and Distributed Learning Vol. 16, No. 5 (Sep 29, 2015)
These links are based on references which have been extracted automatically and may have some errors. If you see a mistake, please contact info@learntechlib.org.