A Guide for MOOC Course Developers and Facilitators: “The MOOC Case Book”

Following is a review of “The MOOC Case Book: Case Studies in MOOC Design, Development and Implementation” the second-place winner of the Association for Educational Communications and Technology (AECT)’s Division of Distance Learning (DDL) Book Award, 2016.

“The MOOC Case Book”, Linus Learning (2015)

The “MOOC Case Book” is a collection of case studies written by (mostly) educators sharing their experiences developing, delivering, and supporting a Massive Open Online Course (MOOC) from the perspective of one of eight dimensions of Khan’s e-learning framework. Khan’s Framework provides structure to the daunting task of developing a MOOC. Not only from a course design perspective but by providing strategies for the host of factors that impact the success of a MOOC. Factors associated with the Technological dimension for instance that involve the MOOC’s platform features, and the Institutional dimension that encompasses student services such as academic advising or institution policies. There’s also the dimension of Resource Support which addresses support for faculty in course design and technical online support for students. Details of Khan’s Framework are covered in chapter two; the image below provides a snapshot.

The book is geared to readers involved in developing or facilitating a MOOC. It provides guidance and knowledge; readers can learn from the experiences of chapter-authors who have ‘been-there-and-done-that’—who have invested the time and energy needed to pull a MOOC together.  Included in the studies are two written from the student perspective, providing further depth to the stories shared. Readers interested in learning how institutions and educators are using digital platforms to deliver online learning—the methods, challenges and barriers faced, will find the studies within instructive, even entertaining.

Following is an overview of Khan’s Framework and highlights of a handful of the case studies. One disclaimer, I wrote one of the case studies—chapter #3 “Pedagogy and MOOCs: Practical Applications of Khan’s E-Learning Framework”. The chapter, as the title suggests, focuses on the Pedagogical dimension of the Framework.

About Khan’s Framework
As an instructional designer I’ve often heard from faculty and design teams the drawbacks of using a model (instructional design models such as ADDIE or the Dick, Carey & Carey model) for the instructional design process. Drawbacks mentioned include words such as, ‘cumbersome’, ‘too linear’, rigid’, and ‘inhibits creativity’. Khan’s Framework is different from traditional design models; it’s holistic. Not only does it address the design phase, but goes beyond by including elements critical to a MOOC’s success and sustainability. It expands to delivering and assessing the MOOC and supporting MOOC stakeholders. These elements, delivery and sustainability in particular are critical. More so when MOOCS are developed and implemented by higher education institutions; there are a host of issues  administrators need to know and make decisions on.

Khan’s E-Learning Framework

How the Book is Structured
There are eleven sections—one dedicated to each of the eight dimensions of the Framework. There are twenty-three case studies, with a great diversity in the institutions represented—Ivy league and public institutions, as well as  small private schools. The MOOCs cover topics ranging from remedial college-prep courses, English composition, poetry, statistics, global health and more. The courses are delivered on platforms readers will recognize, Coursera and EdX, and some specific to an institution; authors share the challenges, barriers and lessons learned when working with the features inherent to each.

Application
Badrul Khan’s Framework preceded the MOOC phenomenon yet its applicability to the MOOC scenarios is impressive and telling. Chapter-authors describe the factors they dealt with in detail in light of one of the eight dimensions (chapters 3 – 25). Chapter 1 gives the reader a solid overview of the factors associated with each dimension, giving context to each case study. Table #3, “Issues for Addressing MOOC Learning Environments” is especially helpful with its list of questions specific to each dimension; course development teams will find these helpful during the design phase and after the course is launched. Below are select questions specific to the Pedagogical dimension (p. 11):

• How well does the MOOC course plan align with the course goals and outcomes?
• Does the course provide a clear description of what learners should be able to do at every stage of the course?
• How well is the instructional strategy being used to target each objective?
• How good is the content? How well do learners interact with it?
• How well does the course design contribute to an interactive and flexible learning environment?

Case Study Highlights
In respect of time I’ll highlight just a few case studies to provide a glimpse into what the book provides. Chapter 5 focuses on the Technological dimension. The author shares how digital tools, e.g. Social media and online surveys, as well as MOOC platform features were used to deliver differentiated learning for students (pp. 63 – 79). In chapter 11 the reader is given a behind-the-scenes glimpse into the development of a MOOC, “Statistics One”, offered on the Coursera platform by Princeton University. The lead author also instructor of the MOOC, analyzes the course through the lens of the Evaluation dimension. He shares the challenges of assessing student learning, specifically creating and implementing assignments, primarily a result of the features inherent to the MOOC platform (pp. 136 – 162).

The key factors associated with the Management dimension of Khan’s framework is described in chapter 13 where the chapter-author from Penn State University highlights the school’s experience delivering the MOOC “Epidemic: infectious Disease and Dynamics”, deemed by Penn State as a great success. Success defined by Penn State as adhering to a detailed project management timetable which delivered the MOOC on time and in the highest quality possible. Success also includes the fact that Penn’s MOOC achieved a higher than average completion rate (compared to average completion rates of MOOCs on Coursera) at 14%, and a rating of number one science course as ranked by Coursetalk (p. 183).

Closing
There are many applications for The MOOC Case Book; it can be a useful tool for MOOC course design teams, students of instructional design and educational technology, and for higher education institution leaders involved in MOOCs. As Curtis Bonk writes in the book’s Forward, though MOOCs are not and can never be a solution to the challenges facing education, they can expand our thinking and perspectives on the future of education that lends hope to better educational world (p. xvii).

• “BADRULKHAN.COM.” BADRULKHAN.COM. n.d. Web. 25 Jan. 2017.
• Corbeil, Joseph Rene, Maria Elena Corbeil, and Badrul H. Khan. The MOOC Case Book: Case Studies in MOOC Design, Development and Implementation. Ronkonkoma, NY: Linus Learning, 2015. Print.

 

Need-to-Know MOOC News: New Business Model for Corporate Learning, Human Graders and Self-Paced Formats

1. MOOCs Scale Up with New Model
The search for a business model may soon be over for major MOOC players such as Coursera and Udacity. Udacity was the first to create partnerships between (mostly tech) companies to cover some of their course development costs. They’ve since moved to offering micro-credentials where students pay for Nanodegrees—focused skill training with a certificate-type credential upon successful completion. Students can also opt to pay even more for personalized services with Nanodegree Plus which includes career support and mock interviews. Coursera has something similar, minus the personalized services, with its ‘Specializations‘. But recently Coursera made another significant move—targeting the corporate sector. Smart. The learning and development market in the United States is vast; according to the 2015 Training Report there was a 14.2% increase in corporate training expenditures bringing the total budget for US companies to 17.6 billion. That’s big. Coursera is aiming to get part of the pie and fill the employee learning gap with “Coursera for Business”.

Screenshot of “Coursera for Business” home page at coursera.org/enterprise

Today, we are taking yet another important step in our effort to expand the Coursera learner community. I am excited to announce Coursera for Business, our enterprise platform for workforce development at scale. We see Coursera for Business as a natural extension of our vision, and as a powerful way to help leading companies around the world address the rapidly evolving training and development needs of their employees. (Levine, 2016)

Insight:  Given the size of the corporate employee learning and development market and the need for Coursera to generate revenue, it’s a logical move. More so given a recent study by McKinsey which suggested that companies are struggling to deliver relevant, just-in-time skill-training that fits in with the drive for productivity and need for employee-directed learning. Over 40% of companies surveyed indicated their current capabilities of meeting employee skill gaps are ineffective (Bensen-Armer et al). Coursera is on to something. MOOCs are not ‘free’ to produce or sustain;  partnering with corporations is a win-win for everyone.

• Coursera for Business, Coursera Blog, Rick Levine
• Udacity’s Nanodegrees

2. MOOCs with Human Graders
When students sign up for the edX MOOC, “Introduction to Philosophy: God, Knowledge and Consciousness”, they’ll have the option to have their essays graded by a real person. This was unheard of when MOOCs first came on higher education’s radar in 2012. MOOC critics took issue with the automated and peer-review grading process—this undermined the learning process, comprised student learning according to the most vocal critics. This Fall MIT is experimenting with a new model for MOOCs with this particular course where essays are graded by a graduate assistant of MIT.

….the model is still a work in progress, and that details may change. This time around, MIT is paying one of its philosophy graduate student to serve as a course facilitator. The facilitator will effectively run the MOOC, moderating the discussion forum and grading papers. Hare declined to say how much the facilitator is paid, but added that it is a flat fee and more than what an adjunct instructor is paid to teach a residential course at MIT. (Straumsheim, 2016)

The cost for this MOOC that includes a Verified Certificate and personalized grading is $300, about $200 more than a Verified Certificate for other MOOCs in the same category (Philosophy & Ethics).

Insight: This story is yet another example how MOOCs are bringing awareness to online education, yet this recent development highlights how the MOOC label is misleading and needs to change. Lines are blurring between the many versions of online courses:  1. open and free courses, 2. online courses with a cost and no-credit (as the one in this article), 3. online courses for credit with a fee, and 4. online courses for a fee with conditional credit  (students need to apply to institution to receive MOOC credit upon completion). Students need to be clear on the conditions when signing up for an online course, just as institutions need to be clear on what they are offering.

• Humans, the latest MOOC feature, Inside Higher Ed, Carl Straumsheim

3. Self-Paced MOOCs on the Rise
September is a big month for MOOCs and September 2016 is shaping up to be the biggest yet; at least since 2013 according to Class Central (Shah, 2016). But the big shift in MOOCs is the self-paced format which allows students to participate in MOOCs on-demand. Yet something is lost—the synergy of students working through the concepts at the same time (synchronous format) leading to discussion forums that fall flat.

Table (above) from “MOOCs no longer massive, still attract millions” (Shah, 2016)

Coursera has a workaround though, offering MOOCs within a cohort system, with courses that start back-to-back (see screenshot below) which allows students to transfer into the next class keeping their course-work intact.

Screenshot showing Courera’s new MOOC format that offers cohort-MOOCs more frequently meeting students’ needs for self-paced format

Closing Thoughts
The MOOC concept is transforming online education, yet the new formats are a far cry from the MOOC of 2012 which were Massive Open Online Courses.

References

•  2015 training industry report. (2015, November/December). Training Magazine, 20-33. Retrieved from https://trainingmag.com/trgmag-article/2o15-training-industry-report
• Bensen-Armer, R., Gast, A., & Van dam, N. (2016, May). Learning at the speed of business. Retrieved from http://www.mckinsey.com/business-functions/organization/our-insights/learning-at-the-speed-of-business
• Shah, D. (2016, September 5). MOOCs no longer massive, still attract millions. Retrieved from http://venturebeat.com/2016/09/05/moocs-no-longer-massive-still-attract-millions/
• Straumsheim, C. (2016, September 2). Massachusetts Institute of Technology experiments with instructor grading in massive open online course. Retrieved from https://www.insidehighered.com/news/2016/09/02/massachusetts-institute-technology-experiments-instructor-grading-massive-open

 

 

 

Need-to-Know News: Chatbots – the New Online Teaching Assistant and Credit-worthy MOOCs Go Global

1. The Chatbot Teaching Assistant
Colorado State University (CSU) plans to use ‘Intelligent Tutoring’ in two online undergraduate courses this Fall. The goal is to improve learning outcomes, increase instructors’ productivity and enable high-quality personalized education by using  chatbot technology. A chatbot is a computer program designed to simulate conversation with human users on a web-based platform. You may have engaged with chatbot without knowing; they’re embedded in banking platforms, retailers sites and others. Companies use chatbot software to respond to customer requests for basic and frequently asked questions. There are benefits—cost effectiveness for the company and improved service levels for customers by reducing wait times for answers and the frustration of automated phone systems. But can learners benefit?

A professor of an online Computer Science course at Georgia Tech thought so. He created a chatbot teaching assistant, Jill Watson. According to Goel his students didn’t even notice:

Jill came to be after Goel decided he and his teaching assistants were being spread thin. Goel’s class was a popular online course, and his teaching team receives over 10,000 online questions per semester. Jill was trained by reading questions and answers from previous semesters, and was set to only respond to new ones if it was 97 percent confident in its answer or higher. — TNW

Insight: The education sector is sensitive to robot technology as a replacement for teacher interaction as we’ve seen with automated essay grading software (Larson, 2013). Yet with the expansion of online learning and it’s potential to reach more students, technology like chatbots and grading software will be the norm. This technology is critical for achieving scale and can be effective for some instructional tasks, while not taking away from value of faculty and instructor expertise.

More on Chatbots:

• What happened when a professor built a chatbot to be his teaching assistant, The Washington Post
• CSU Online brings artificial intelligence-powered learning tools to courses, Source
• Facebook is Teaching Chatbots to Talk with Help From Facebook, Wired Magazine

2. MOOCs become Credit-Worthy, Globally
MOOCs are disrupting higher education if you consider degree-granting institutions awarding college credit for MOOCs disruptive. Over the last year  institutions around the world are moving to integrate MOOC coursework into traditional degree programs. Partnerships between MOOC providers (FutureLearn, edX and Cousera) and higher-ed institutions are allowing students to obtain college-credits easily and affordably. In the UK, Leeds and Open University are granting credit to students who complete certain MOOCs and earn a certificate through the platform. In the US the Global Freshman academy and American Public University offer similar programs.

In the United State the American Council on Education’s (ACE)  ‘Alternative Credit Project’ aims to support students complete an undergraduate degree by using MOOCs as credit.

The Alternative Credit Project features 47 partner universities that accept MOOC certificates to degree programs http://www.alternativecreditproject.com/

In India, Bennett University partners with Georgia Tech to support students working through Georgia Tech’s Online Master of Science in Computer Science (OMSCS), an entire degree program based on the MOOC-format. The total cost for the program is under $7,000 (US funds). Bennett University provides students based in India, ground support for while they are working through the MOOC degree program.

Governments are also getting involved in the MOOC movement as in South Korea where the Ministry of Education encourages universities to grant credit for MOOC study.  South Korea is a leader in online education, and is actively promoting MOOC study for credit along with its other initiatives, such as the Cyber-University program launched in 2001.

Insight:  Despite what MOOC critics have suggested over the last three years—that MOOCs are not disruptive, they are. The reach of MOOCs, or variations of the MOOC format, is far and wide—bringing education to learners who can not, for a variety of reasons, attend a brick-and-mortar institution. Institutions and governments are seeing the value of the MOOC format; it’s a win-win.

More:

• Students can earn credit from K-MOOC lectures, The Korea Times
• Georgia Tech’s Online Masters in Computer Science to enter India, The Economic Times
• MOOCs: Leeds and Open University offering course credit towards degrees for first time, The Independent
• MOOCs for Credit, Class-Central

For more need-to-know news, you can follow Online Learning Insights on Twitter @OnlineLearningI

 

Facebook for MOOCs: A Bridge for Student Learning

I’ve long believed that Facebook is one of the most effective platforms for student discussion and collaboration within Massive Open Online Courses (MOOCs) and other online course formats. Facebook is a virtual meeting place that encourages authentic interaction, sharing and collaboration. I’ve found that closed Facebook groups, created for a specific course, generate more discussion, exchanges and sharing among a greater number of students than any forum within a MOOC platform.

A recent study, The Role of Social Media in MOOCs presented at the annual ACM Conference on Learning at Scale, validates Facebook’s effectiveness for student engagement. Researchers conducted a study using three MOOCs on Coursera’s platform comparing students use of Facebook groups to discussion forums within the Coursera site (Zheng et al. 2016). They found that students were more engaged in Facebook groups than within the MOOC discussion forums (see figure 1 below), and engaged for longer periods on the Facebook site, even after the course ended. Students also admitted they preferred interacting on social media due to its immediacy—the quicker response times to questions and posts, as well as the less chaotic environment. Quite compelling is the fact that students stated Facebook gave them a “sense of community” (pg. 423).

“The Role of Social Media In MOOCs: How to Use Social Media to Enhance Retention”.  Proceeding of the Third (2016) ACM Conference on Learning @ Scale, pages 419-428.

Why is this so? I suggest two reasons. First, because Facebook is the most used social networking site globally, for a variety of reasons—its low barrier to participation, and ease of use (Pew Research, 2014). Given the numbers of people who use Facebook across nations, more students are familiar with Facebook than any other tool or feature within the MOOC platform, so it’s no wonder they are more likely and willing to engage with their peers. Below are some telling comments from students of the study that indicate why Facebook preferred over the MOOC platform.

“Sometimes, I actually want to reply or make some updates

on Coursera, but when I think I need to login on my

computer, I postponed doing it and then I forgot to do it later.”

“I frequently forget my password or account name. I know this is stupid, but it happens frequently not just on me but on many of my friends!”

Second,  Facebook creates a sense of community. Learners are able to establish a sense of presence, they have a sense of being there and being together. Students can see who they are interacting with—a real person. Facebook is transparent, unlike MOOC platforms where students can sign up and create any user name not linked to their identify and post in forums anonymously.  Interaction within MOOC platforms feels like one is communicating in a vacuum.  This transparency fosters a sense of presence and trust, aligning with the Community of Inquiry (CoI) model. The CoI model is a theoretical framework that outlines a process for creating deep and meaningful online learning experiences. It’s based on three interdependent dimensions of presence–social, cognitive and teaching presence (Garrison Anderson & Archer, 2000).

Social presence is the ability of participants to identify within a community, in order to communicate in a trusted environment, where learners can develop personal relationships by projecting their individual personalities (Rourke et al., 2001). With its transparency, ease of use, and low barriers to participation, Facebook embodies this concept of social presence, enables students to engage socially leading to dialogue and collaboration.

Community of Inquiry Model, Garrison, D. R., Anderson, T., & Archer, W. (2000)

How It Works
Facebook groups can be created by the instructor or institution administrators as a closed group where students request to join. Though in MOOCs, students often take the initiative and create a group for course participants, opening up the group well before the course begins. Frequently participants will create smaller groups for those interested in specific course-related topic areas; they find one another via the interaction and dialogue. For further info see Group Basics on Facebook.

Conclusion
The study’s findings have tremendous implications for online educators and institutions. If students in online learning environments are more likely to engage with class peers on social platforms, like Facebook, it’s well worth our time to examine further how we can thoughtfully integrate social media to engage students and deepen their learning experience.

References

• Garrison, D. R., Anderson, T., & Archer, W. (2000). Critical inquiry in a text-based environment: Computer conferencing in higher education model. The Internet and Higher Education, 2(2-3), 87-105.
• Pew Research Centers Global Attitudes Project RSS (Rep.). (2014, February 13). http://www.pewglobal.org/2014/02/13/appendix-4/
• Rourke, L., Anderson, T. Garrison, D. R., & Archer, W. (2001). Assessing social presence in asynchronous, text-based computer conferencing. Journal of Distance Education, 14(3), 51-70.
• Saijing Zheng, Kyungsik Han, Mary Beth Rosson, and John M. Carroll. 2016. The Role of Social Media in MOOCs: How to Use Social Media to Enhance Student Retention. In Proceedings of the Third (2016) ACM Conference on Learning @ Scale (L@S ’16). ACM, New York, NY, USA, 419-428. DOI=http://dx.doi.org/10.1145/2876034.2876047

Pew Research Reveals Three Barriers to Lifelong Learning

Pew Research Center’s recent report, “Lifelong Learning and Technology” gives insight into how Americans perceive and engage in lifelong learning (Horrigan, 2016). It’s a worthy read. It contains valuable data and insights for stakeholders involved in education planning and decision-making. Yet I’ve identified three themes I consider most instructive and compelling; three significant barriers that the education sector as a whole needs to acknowledge and address in order to improve and move online education programs forward.

Three Barriers
1) Limited Access: online education has not, up to this point, democratized education—adult learners with limited education do not engage, for various reasons, in learning aided by technology, 2) Lack of familiarity with online learning options persists among all adult learning groups; for instance only 14% are “very familiar” with even the concept of distance learning, and MOOCs—only 5% are “very familiar”, and 3)  Learning gap: there’s a significant gap between how some adults view learning in general and their actual lifelong learning behaviours—the majority of Americans (87%) believe learning new things is “very important” yet only 73% of adults consider themselves lifelong learners.

1. Online Education Fails to Democratize
We’ve long heard how digital education platforms such as Coursera and edX will democratize education by overcoming barriers associated with higher education by lowering costs and reaching populations with limited education. Yet Pew’s findings suggest otherwise. It reveals that these same groups, those with low levels of education and household income, are less likely to engage in any form of online learning. One finding is particularly telling—less than half of respondents with a high school education or less have used the internet for personal (43%) or job-related learning (49%) (Horrigan, pg. 7). This suggests that education providers need to determine how to leverage and implement technology as a learning tool to serve the groups that need education most.

2. Limited Awareness of Digital Platforms for Learning
Quite surprising is the fact that the majority of adult learners are not familiar with digital learning options. While most readers of this blog are likely (very) familiar with MOOCs and for-credit online courses, it’s startling to consider that most adults, even those with higher education levels are not (see screenshot below for details). This phenomenon has implications for educators and institutions; the most pressing is the need to inform the general population about digital learning options. Going further, there’s also a need to educate adults how to learn effectively in a digital world. Accomplishing this will require a strategic and concerted effort by education institutions involving a multi-pronged approach, utilizing multiple communication channels to promote learning options. Other alternatives may require forming partnerships with unrelated institutions as Khan Academy did with Bank of America for their Better Money Habits® program. There is much work to be done.

Lifelong Learning and Technology, John Horrigan. Pew Research Center (section 5).

3. The Learning Gap
According to the report Americans value learning greatly. It indicates that 87% of adults state that it’s “very important that people make an effort to learn new things about their jobs”. Yet the same survey finds that 73% of adults agree that “I think of myself as a lifelong learner” applies “very well”. The numbers suggest there’s a segment of the population who view learning as very important, yet they don’t engage in lifelong learning activities for their own personal or professional growth. Why? It’s worth further examination. There is an opportunity to reach a group of adults who value learning greatly but don’t engage for whatever reason. The report does identify factors that play a role in lifelong learning activities, e.g. household income, education attainment, etc (section 2). One avenue to consider is the role educators could play in closing the gap.  Possibly by instilling skills and modeling behaviors associated with lifelong learning in elementary and/or high school, granted the logistics of ‘how’ is a barrier in itself.

There is no easy solution to closing the gap, and it is closely linked barriers one and two.  Yet this gap deserves special consideration—further discussion among educators involved in all levels of education. How can we as educators encourage and develop skills and behaviors in students, young and old where learning is self-directed and lifelong—where students forge their own learning path based upon their, interests needs, and passions?

Closing
The Pew Report yields important and helpful insights that can drive meaningful dialogue about education: professional, elementary and higher education. Also the role of technology in education, it’s reach, and shortcomings. The report hopefully will serve as a catalyst for action, action by education institutions and individuals to advance and improve institutions and platforms reach and impact, to build and grow engaged communities of lifelong learners.

• Horrigan, J. B. (2016, March 22). Lifelong learning and technology. Retrieved from http://www.pewinternet.org/2016/03/22/the-internet-plays-less-of-a-role-in-lifelong-learning-for-those-with-lower-levels-of-education-and-income/

 

MOOCs Desperately Seeking Quality

MOOCs, despite what the critics say have transformed higher education. They have spawned new vehicles for online learning, reaching new groups of learners who want and need an alternate form of traditional education. Thanks to the MOOC format learners now have numerous pathways to furthering their education. Granted, not all MOOC programs meet the definition of open, but as programs expand as we’ve seen with certificate-granting MOOCs, MOOCs for college credit, professional development MOOCs, and others, there is a pressing need for benchmarks of quality.

This need is more apparent after the recent publication of two reports: Babson’s thirteenth annual “Online Report Card” and “In search of quality: Using Quality Matters to analyze the quality of Massive, Open, Online Courses (MOOCs)”, (Allen, Seaman, Poulin & Straut, 2016; Lowenthal & Hodges, 2015).

The Babson report devotes (only) two of its sixty-plus pages to MOOCs, yet what’s most telling is the fact that the report is in its final year of publication. Though there are a variety of contributing factors, a compelling one as described in the report’s introduction, “distance education is clearly becoming mainstream” (pg. 3). In other words online education is growing up. ‘Online learning’ is simply becoming ‘learning’. The report outlines the number of organizations dedicated to online education, who report on and address issues specific to online learning. Many do address quality standards as it relates to developing and delivering online programs, as is the case with Quality Matters rubric, Online Learning Consortium’s (OLC) Five Pillars, and California State University Chico’s rubric for online instruction, yet all fall short in specifying standards for MOOCs.

This void is a concern given the number of students engaged in learning using the MOOC format which is significant. Estimates are in the range of millions—one source states there were 35 million enrollment in 2015 (“MOOC Enrolment”, 2016). Given these numbers the question is—how will MOOC learning be advanced and improved if MOOC quality isn’t addressed by organizations involved in online education? Researchers Lowenthal and Hodges bring some of these issues forward in their paper, “In search of Quality”.  They apply the Quality Matters™ rubric to six MOOCs, offered by three providers, Coursera, edX and Udacity:

The six identified MOOCs were analyzed using the Quality Matters Rubric Standards with Assigned Point Values, which involves a type of content analysis by three different reviewers using a standard coding scheme. [Quality Matters] QM has a rubric for Continuing and Professional Development that would be appropriate to use on MOOCs (Adair et al., 2014). However, we intentionally chose to use QM’s higher education rubric rather than the continuing and professional development focused rubric because of the increased initiatives about offering college credit for MOOC completion. In other words, a MOOC should score as well as a traditional online course if it is going to be worth college credit.  (Lowenthal & Hodges, 2015)

Not surprisingly, after the QM peer-review assessment all six MOOCs failed to meet QM’s passing grade of 85%. The QM rubric consists of a set of standards grouped into eight dimensions (below); in the study, most MOOCs failed in two dimensions, #5 and #7.

1. Course overview and introduction
2. Learning objectives
3. Assessment and measurement
4. Instructional materials
5. Learner interaction and engagement
6. Course technology
7. Learner support
8. Accessibility (Quality Matters, 2014)

The apparent failure of the MOOCs in this study may give fodder to MOOC critics, yet I suggest that failure stems not from the MOOCs, but from:  1) applying a tool (QM rubric) to a MOOC, which inherently serves a variety of learning purposes and needs, e.g. not just for credit, but for professional development, personal interest, etc. and 2) assessing a MOOC on dimensions such as ‘learner interaction and engagement‘ and ‘learner support‘ doesn’t make sense in context of a MOOC, specifically at the level the QM standards articulate. Considering the massive component of MOOCs, it’s almost a given that facilitating structured, mandatory engagement and active learning is next to impossible. Furthermore since MOOC students are able to choose the level of engagement based upon their learning needs, including this as a standard doesn’t fit with the intent of the course.

The study acknowledges many of these points, and serves as a vehicle for discussion about applying quality standards to courses that align with the MOOC format. The authors also highlight a critical point, if the MOOC format is used as a vehicle for granting college credit, as it appears to be, quality benchmarks are essential.

Final Thoughts
A unique approach to quality assessment (and course design) is needed; one that heeds the needs of learners, the constraints and advantages of the delivery platform, and ensures a quality learning experience. Going further, I also suggest that before establishing quality standards, institutions would do well to first identify the primary purpose and intent of the MOOC. Categorizing a MOOC based on its purpose, then establishing quality standards is a good place to start.

References
Allen, I. E., Seaman, J., Poulin, R., & Straut, T. T. (2016). Online report card: Tracking online education in the United States (Rep.). Babson Survey Research Group. Retrieved from http://onlinelearningsurvey.com/reports/onlinereportcard.pdf

Lowenthal, P. R., & C. B. Hodges (2015). In search of quality: Using Quality Matters to analyze the quality of massive, open, online, courses (MOOCs). The International Review of Research in Open and Distributed Learning, 15(5). Retrieved from http://www.irrodl.org/index.php/irrodl/article/view/2348/3411

MOOC enrolment surpassed 35 million in 2015. (2016, January 05). Retrieved from http://monitor.icef.com/2016/01/mooc-enrolment-surpassed-35-million-in-2015/