“Learning Identifies in a Digital Age: Rethinking Creativity, Education and Technology” Book Review

How do we think about and make sense of education, technology and creativity? “Learning Identities in a Digital Age,”  Avril Loveless & Ben Williamson

9780415675727The bookLearning Identifies in a Digital Age: Rethinking Creativity, Education and Technologyis thought provoking and rich with concepts and research about the relationship between education and technology, and its influence on learner identity. Released in February 2013 as part of Routledge publishing’schanging times in education series’, I’ve  been challenged by this book. It brings forth the issues that I don’t always consider, but should when reading and writing about the technological applications and platforms that education institutions are embracing and promoting, i.e. MOOCs, machine grading, social media in education etc.  I am not opposed to progress and innovation by any means, but I am concerned about the long-term implications for learners, and high school and higher education in general. I’ve found this book helpful for guiding my thinking about these issues; it focuses on one important aspect, learning identities. It examines how learners see themselves, and how they are influenced and shaped by factors not within their control.

The authors take abackward gaze’ perspective, where they approach the subject matter “as a historian from the future might, looking back at our present time and seeing vast numbers of unresolved issues, differences of interpretations and general confusions….” (Loveless & Williamson, 2013).  The authors’ approach rests on the idea described by Nigel Thrift in his book Knowing Capitalism (2005). Thrift suggests this method prevents what he calls ‘historical atrophy’, where past events often are packaged up in order to move on and embrace modernity (Thrift, 2005, p 3). This sounds familiar. Though I do find that the book emphasizes more of the ‘now’, and promotes thinking about how policy decisions of governments and curriculum choices made by education institutions impact our students. Rather than provide answers, Loveless and Willamson aim to stimulate deep thought by treating education, technology and creativity as objects of thought, which I believe they do quite successfully.

Digital Identity vs. Learning Identity
I’m familiar with the term digital identity, yet learning identity, I discovered is more complex. Digital identify can be described as one’s persona that is displayed and shared online through social media sites and other platforms. Learner identity in the context of youth and young adult learners encompasses their online persona and another dimension—identity that is created through academic learning and pedagogy. For the most part, these latter factors are not within the learners control but are shaped by programs and methods driven by policy, an institutions curriculum, educators and even society’s use of, and attitudes towards technology.  For readers interested in learning more about digital identity for students, I’ve included links to resources at the end of the post from Catherine Cronin, an educator with considerable experience in teaching digital citizenship.

Big Picture Overview
An interesting fact about the authors, is that they are two decades apart in age, which according the preface, promoted differing viewpoints that led to different types of questions and arguments within the book.

The scope of the book is guided by these three questions:

  1. How is the future of education being through and re-thought in relation to new technology and media?
  2. What kind of learning identities are presupposed and promoted by the merger of new technologies and media with education?
  3. How are those learning identities to be organized in emerging models of learning, curriculum and pedagogy?

Content is divided into two sections, Part I, Reconfiguring education and technology, and Part II, Thinking, curriculum and pedagogy. You can review the specifics of each of the eight chapters by visiting Routledge’s website here.

Conclusion
I highly recommend this book for educators that work within K-12 and higher education settings, and I’ll go so far as to suggest it is a must-read for individuals in either of those groups that teach or support online education in any capacity. Decision makers in education public and/or institutional policy would also benefit from the book’s topics and arguments—it could provide a basis for promoting constructive dialogue among stakeholders about learner identities. The book is dense with ideas, addressing through the topic of learner identity how technology is interwoven with education and its effect on education and students.  I do hope that this book makes its way into the hands of educators and decision makers sooner rather than later.

Resources on Digital Citizenship:

How Course Design Puts the Focus on Learning Not Teaching

This is the second post in a series of four on instructional design for online courses. The goal of this series is to introduce a fresh, innovative approach to course design.

1197947341_89d0ff8676Instructional design, also known as learning design, appears to be making a comeback, which is most fortunate given that I am writing a series on this very topic. Massive open online courses [MOOCs] that mimic the classroom model where the learner is passive and the instructor is not, highlights the need for fresh, new approach to course design. And it’s not just MOOCs that need help, but numerous courses currently offered online; many are in need an overhaul to create an environment focused on learning, rather than one that focuses on instruction. My aim here is to provide readers with a course design framework, information and tools for designing online courses. These tools and skills appear to be in demand by educators that are trying to adapt their courses and teaching methods to an online or blended format.  Some educators also find when entering into the MOOC world of instruction, they are in need of a different skill set from what is required for face-to-face teaching.

In the first post of this series, Why Online Courses [Really] Need Instructional Design I wrote about the dire need for instructional design: how it is needed to guide the process of learning for students, and guide the teaching of the course as well. A courses’ structure is a reflection of the design teams’ [or designer] belief in how people learn. The teams’ learning perspective translates into the choices made for instructional tools, the delivery methods, application activities and assessment methods for the course. We can see this in traditional higher education, which for the most part ascribes to the cognitive theory of learning, a theory that rests on the assumptions that learning is an internal process; a function of the learners memory. It’s an instructor-focused paradigm, where the teacher describes concepts for the learner via instruction, and in some cases relies upon visual representations for reinforcement. (Roblyer & Doering, 2010). This model still is the primary model in colleges and universities—professors lecturing to a class of [passive] students. Even though considerable research proves that students learn better when active in the learning process [in keeping with the constructivist theory], the cognitive theory prevails. George Siemens, co-founder of the first MOOC noted in a recent blog post:

The current MOOC providers have adopted a regressive pedagogy: small-scale learning chunks reminiscent of the heady days of cognitivism and military training. Ah, the 1960′s. What a great time to be a learner.” gsiemens, March 10, 2013

Before I move on and provide further examples, I’ll review four learning orientations—beliefs in how people learn. I wrote about each theory in-depth in a previous post, A Tale of Two MOOCs: Divided by Pedagogy, though here I’ve put together an image that summarizes the core principles of each.

When examining the image [above], one can see how learning theories influence the methods of instruction for a course. This diagram is not meant to be an implementation tool for course design, but an information source. In subsequent posts of the series I’ll review how learning theory is incorporated into the design of a course during the initial phase, the analysis phase [following the analysis is the development phase and then implementation].

Image depicts four perspective on learning based upon theoretical principles [inside quadrants]. Instructional methods associated with each are adjacent to respective quadrant. Orange quadrants represent a student focused learning model and blue represents instructor focused.

Image shows four perspectives on learning based upon theoretical principles. Instructional methods associated with each, adjacent to respective quadrant. Orange quadrants represent a student-focused learning approach, blue instructor-focused.

In another article published recently, The Pedagogy of MOOCs, the author suggests that xMOOCs offered through platforms such as Udacity, are a step backward for education. Rather than leveraging the technology and the thousands of students to advance learning, where students become contributors to the course, the MOOC applies instructor-centered teaching and assumes the learner is passive – an empty vessel.

Closing Thoughts
The crux of my post, the point I would like to leave with readers, is that a fresh, new perspective is needed for teaching and course design—course design is about creating environments to help students learn. As new courses are developed or transformed from face-to-face to an online format, the focus should not be on the technology, the platform, the video lectures, the forums, the instructor, but on the students —what methods will facilitate their learning? How will they learn? Stay tuned for my next post in this series.

Resources:

Teaching Tips From a Master MOOC-Maker

Teach a MOOC … what are you, crazy? … However, what I learned was that teaching a MOOC has been the purest and most fun form of teaching and learning that I’ve ever done. Maria H. Andersen, Ph.D. (Canvas Network, Sloan Consortium Streamed Session, April 9, 2013)

MP900444382[1]I attended the Sloan Symposium last week as a virtual attendee and participated in several  sessions including Designing a MOOC for Canvas. The above quote comes from the sessions’ leader, Maria Andersen who currently works at Canvas and teaches her own MOOC on Social media through the Canvas Network. The session was insightful, and several readers may find the tips shared helpful, which is the purpose of this post. Strategies shared in the session are applicable to online course design in general and are not exclusive to Canvas.

I’ll include the highlights of the session—an insiders look at MOOCs based on Andersen’s experience supporting thirty MOOCs in her role with Canvas as Director of Learning, and the methods she shared for creating activities that drive learning and sustain student interest. I have no doubt that many readers will find what Anderson has to say instructive and helpful, even more so for to those considering developing a MOOC, and/or planning to teach one in the future.

Andersen has extensive teaching experience, both in face-to-face and online venues, though she much prefers teaching MOOC students, describing them as eager to learn, motivated, and willing to dig deep into content areas of interest for the sake of personal development. In contrast, Andersen describes teaching students of for-credit courses as painful and tedious (Andersen, Designing a MOOC for Canvas). Though I have differing views of traditional students than Andersen, I liked what she had to say about the roles of teachers and learners, and the design methods for online courses.

Design Strategies and Insiders Tips for Teaching a MOOC

Role of the Instructor: Andersen shared sage advice for MOOC instructors. First, that the role of the instructor is profoundly different in a MOOC in comparison to traditional for-credit course. The instructor’s role is one of curator and creator – creator of a learning environment that encourages contributing and sharing. Instructors also need to accept that fact that he or she may not be the only expert in the class. One or more enrolled participants may hold advanced degrees or be an expert in the course subject – her advice, embrace them, use them to guide other learners, perhaps as a teaching assistant or discussion moderator. A UC Irvine professor teaching with Coursera did not follow this advice. He attempted to silence the experts in course, instructing them not to participate in discussion forums. The professor ended up quitting half way through the course. 

globe_mouse

Andersen suggests leveraging international perspectives

Other advice included leveraging the international perspectives of students in the class to provide learning depth and diversity. Anderson shared examples from her course where students contributed resources from Asia that gave cultural insight and diverse perspectives on course topics. She encourages her students to contribute and share in the course through blog posts and comments, which she encourages by frequently mentioning or showcasing student work or comments in class messages created for students. Including relevant resources on the course home page that students find and crediting the student is another effective method. In the MOOC e-Learning and Digital Cultures, the professors discussed and read clips of students blog posts during the live bi-weekly Google+ hangout sessions. As a student I found this effective, I felt instructors were involved and present in the course.

Profile of Learners: Anderson shared that the majority of learners in Canvas Network have college degrees, many holding advanced ones—nothing we don’t already know, but the rest of information was original, for instance that most learners attention span, the time students devote to the course is between two to six hours per week, the average falling around four. The ideal length of a massive course appears to be four weeks, anything longer than that becomes a challenge for students to sustain. Though it is possible, but requires specific strategies to keep the course going and learner engaged, for example a featured guest discussing a topic on Google hangout, or engaging in a discussion within a discussion forum.

In the learning community there is much discussion about the rigor of xMOOCs or lack there-of considering the length and time invested by students.  Andersens’ view—less hours invested per week does not mean less rigor but more. With a well-designed course, one that encourages learners to learn actively and create content, she finds learners are intensely focused and engaged.

Tips on Course Design

Excellent advice on course design from Andersen in this section—the principles here also apply to  small, for-credit online classes. Where does one start with MOOC course design if adapting content from a face-to-face class? Create a new syllabus. Do NOT use the same syllabus as used in a face-to-face course. Developing new materials and methods is key to a successful MOOC, or at least adapting content and methods that will be applicable to the different learner and learning contexts.

iStock_supportsginXSmall

Include a ‘start here’ page that guides students through the early stages of the course

Below I’ve included key points on course development that Andersen presented as it applies to MOOCs, which is also applicable to small, online for-credit courses.

  • Include a ‘start here’ page on the course site for students to go to when starting the course—similar to an orientation. Students in the first week of an online class are overwhelmed, and don’t know what to do first. An orientation page helps tremendously. Including a welcome video from the course instructor is much appreciated by students.
  • Learning activities and assessments should drive learning with action, students should have to do something.
  • Activities should get students to apply the content and share. An example from Andersen’s social media course— one activity was for students to get 50 new Twitter followers over a two-week time period. Then they had to describe in writing how they went about doing so either in a class forum or blog post.
  • Assessments should provide another opportunity to learn—not to assess whether they have learned. Assessments should benefit the students not the instructor.
  • Assessments [ideally] should drive students to find information and provide opportunity for further learning. Allow students to take assessments as many times as needed to achieve a goal score. An example from Andersen’s class—she developed a quiz that asked specific and detailed questions about a social media platforms user policy [Facebook]. She designed the quiz so that students would not be able to pass the test unless they read the policy in-depth, or even had to research the answers on Google. Either way they would learn something in the process.

Onwards to a MOOC

The advice Andersen provided about MOOCs was helpful. I hope that readers interested in teaching MOOCs found something of value, yet I don’t want to overlook the fact that the role of MOOCs is still unclear, the future of xMOOCs is fuzzy. For that reason, considering the other dimensions that surround MOOCs is recommended, and using what is here as a guide. In an ideal world, [sigh] MOOCs should be developed and taught with a clear purpose that includes expanding and sharing learning with others beyond the walls of the institution.

Four Good Reasons Why Students Need Instructor Feedback in Online Courses

In this post I describe why instructor feedback in an online course is essential for students that have yet to master a specific skill set and knowledge, and why MOOCs won’t cut it.

girl_thinkingIn a world of MOOC news within higher education, what is getting lost are the other modes of online learning that include closed online classes, offered for-credit at colleges and universities. These courses rely on cognitive or constructive pedagogy, with determined learning objectives and are delivered 100% online to small classes of thirty or fewer students. In this model, the instructor can support and interact with students, provide feedback, and encourage critical thinking. This type of personalized instruction can’t be provided in a massive open online course [MOOC], which leads me to suggest that the MOOC model [as it stands now] is not the right modality for most lower-level college courses required for a college degree.

What is Instructor Feedback?
I want to clarify before going further what instructor feedback means in the context of online learning classes. Instructor feedback is constructive and specific information that is provided by the instructor to the student on his or her course work [artifacts or other] and/or class contributions in relation to the course objectives and expectations. Feedback can be provided in a variety of mediums including, written, recorded voice, chat, video or other. In my next post I’ll address how to give effective feedback to students using various methods.

College Students Need Feedback
College students benefit greatly from instructor feedback, including when it’s provided in a small online learning community where interaction exists between students and instructor and students and students. In a Massive Open Online Course, [or even a F2F class of 100+ students]  it’s impossible to provide the required learning conditions for this type of interaction. It worries me that colleges and universities appear to be moving towards the MOOC model for delivering some or all courses (as in the case of SUNY or California’s public higher education institutions); courses that don’t provide for a student-to-instructor ratio that supports personalized learning. The MOOC model cannot provide the type of learning experiences needed for freshman or junior college students that is required for courses that include writing composition, communications, literature analysis, and other humanities courses. One could even argue that this is the case for some courses in math and sciences. Though I am an advocate of MOOCs, since they provide an excellent learning experience in numerous circumstances, the model which relies on the premise of massive, is not an effective one for every learner in every learning situation.

iStock_studentsCloudXSmallWhy MOOCs Won’t Work for College Students
I am not suggesting that college students can never learn in a MOOC setting, but I do suggest that certain courses not only require a low student-to-instructor ratio, and that colleges need to provide students with the skills in how-to-learn in a networked environment where learning is pulled and not pushed. I’ll use my 18-year old daughter, a high school senior here as an example. She will be a college freshman this September, and though she is a good student, with several Advanced Placement courses under her belt, she in no way would be able to learn successfully in a MOOC in her freshman year. Not that she can’t learn, or won’t be able to at some point, but she is a product of the public school system where students are told what to do, when to do it, how to do it. Furthermore, high school students are not prompted to think outside the box, to create a networked learning environment, or to be a self-directed learner.  My daughter is an expert test taker, she says she has figured out the system, can produce what the teachers are looking for, and thus can get good grades. She is similar to many high school students. How can we expect these students to be successful in a massive course with little guidance let alone feedback?

Four Reasons why Students Need Instructor Feedback and Peer Support
Below are four reasons that support the position that college students need instructor feedback in small, closed, online classes.  I should mention that I concede that small (under forty students) face-to-face classes can accomplish all but point #3, though this point is an essential component for students working within a digital world and can only be accomplished in an online class.

  1. Prompt feedback allows students to assess existing knowledge, reflect on what they have learned, what they still need to learn, and receive suggestions for improvement [Chickering and Gamson, 1997].  The principles in the classic article Seven Principles for Good Practice in Undergraduate Education, still apply today; the tools and methods may change but the principles should not.
  2. Students want feedback from instructors. Research suggests that students want feedback, and personalized feedback that includes suggestions for improvement, with explanations (Getzlaf et al, 2009).  In an online course, detailed and specific feedback on assignments or class contributions through discussion forums, live chats etc., is even more critical given the medium.
  3. Students require guidance in how-to-learn in an open and online environment; instructor feedback and peer interaction in closed online courses can develop digital communication skills, including how to seek information, create personal learning environments and collaborate virtually with peers.
  4. Over 60% of newly admitted college students in the US are not ready for college level work. They lack the basic writing and math skills required for the college courses they are enrolled in (SREB, 2010).  For this reason alone, college students need instructor guidance and support in completing lower level college classes, and in some cases remedial classes. Instructors can also guide students to find open resources, and provide support and encouragement to students who might be discouraged or frustrated.

Concluding Thoughts
Bottom line – the MOOC model cannot provide the level of feedback and support needed for many college students.  Instructors skilled in online teaching for small classes can provide constructive feedback to students, create a learning community that promotes interaction, and most importantly, teaches students how-to-learn in an online environment. I’ll be watching closely what happens within higher education with regards to MOOCs, and hope that administrators consider carefully a strategy that supports student development in the first and second year of college. In my next post, I’ll provide practical how-to instruction on tools and methods for giving meaningful feedback to students in an online class.

Resources:

Groups, Clay Shirky and Online Education

This post explores the significance of student groups in online learning courses—the value and influence on institutions in light of the principles outlined in Shirky’s book “Here Comes Everybody”.

Here_Comes_Everybody

Image: penguingroup.com

I just finished reading Clay Shirky’s book Here Comes Everybody, The Power of Organizing Without the Organization. You may wonder how valuable such a read would be given the book was written in 2008, yet reading the book with five years of Internet advancements under our belt, was strangely thought-provoking.  More so when considering the influence and power that groups can, and have wielded in the realm of online education, specifically in courses attracting massive numbers. Here I’ll share the potential that groups hold for learning within online courses, the three principles needed for successful groups, and how student groups are subtly influencing the paradigm shift in education.

Clay Shirky: Author
Shirky is a professor, journalist, author; he studies and writes about the effects of the Internet on society from a cultural and economic viewpoint. Several recent articles written by Shirky have caused some educators to bristle. In a blog post from 2012, Napster, Udacity, and the Academy Shirky compares higher education to the music industry, suggesting that the MOOC model, or some version of it, will replace higher education as we know it. Yet my focus here is not on Shirkys’ views on education, but his insights on group formation which is particularly relevant in light of learning online in massive courses.

Three Principles of Effective Groups
Shirky discusses how society is transforming, with citizens newfound ability to form en masse with the advent of the Internet and the low barriers to group formation. Now, in 2013 there are even fewer barriers to group formation than at the time of Clay’s writing. Now groups can come together with a choice of platforms. Though all groups develop for different reasons, there are elements common to effective groups which Shirky outlines in his book (p 261):

  1. The Promise is what brings the group together, around a topic of interest with a basic desire to participate. Implied in the promise is that each member will participate and contribute.
  2. The Tool is the platform that will help people approach the problem/topic together. Usually a leader [organizer] emerges within a group, or soon-to-be group and chooses the platform for group communication and collaboration i.e. Facebook, Google + Community, etc. He or she will invite members, and/or approve members joining, etc.
  3. The Bargain is the guidelines or rules for participating. Group norms are established, i.e. what is acceptable for communication and not, contributions, etc. The organizer essentially established the tone, which influences the culture of the group. I have seen examples of this in virtually every large online group I have participated in; the organizer dictates through actions and tone, which influences the effectiveness of group collaboration and even participation.

Groups that Collaborate
To collaborate effectively groups need the three components as mentioned. Shirky uses Wikipedia as an example of a large group that demonstrates the three principles. With its tightly knit core group and a commitment to a promise, to create a database of free content maintained by a massive community of contributors, Wikipedia has control built-in by its group norms [the bargain]. An example of the bargain in action, is when one or more of the community of contributors overrides an article written by someone that tries to sabotage its integrity. Enough members care about Wikipedia, which is why it continues to thrive (p 140).

Groups, Learning and MOOCs
Here is where things get interesting. In small, online closed courses, group collaboration is under the control of the instructor—groups actions are structured, guided, even graded as part of a student’s final grade. Group work in this instance can be effective, as instructors can teach students how to participate and collaborate effectively.

But in MOOCs learning through group interactions is not within the instructors control, yet there is even greater potential for rich learning to happen with its large, diverse body of learners. Though MOOC organizers can guide participants and be catalysts for group formation by suggesting participants share, connect and collaborate outside of the MOOC platform. [It's also helpful that instructors suggest tools to facilitate group work. Though this may seem obvious, the instructor cannot assume that everyone is familiar social tools as a vehicle for learning]. Still, learning within a group in this context is dependent upon the self-direction and motivation of its members.

The Power and Influence of Groups on the Institution
Yet for institutions that offer massive courses, there is a risk. When working with massive numbers of students, not only is group collaboration and learning not guaranteed, there is potential for groups to influence actions and decisions of instructors and institutions in ways that may not be expected, or even desired. Groups have the potential to sabotage the learning of others and the course over which the instructor has little control. Already we have seen the influence of groups within Coursera courses. For example with the Microeconomics course where groups of students were challenging the professor which prompted the professor to quit the course before it was over. Or the Fantasy-SciFi that was sabotaged by a group of students participating in the discussion forums that were working under anonymous profiles causing numerous to be vocal about their negative experience. And the Foundations of Online Education with the thousands of student complaints about the  structure and technology glitches, forced it to shut down.

Conclusion
We are just beginning to see the power of groups in online learning courses with massive numbers of students. There is great potential yet to be realized, for the development of new knowledge and problem solving with the collaborative efforts of students worldwide. The power of groups cannot by ignored, the influence they have is great, and the institutions that embrace it and acknowledge that they are no longer in control, will be better prepared to create conditions to harness its potential.

Resources

Professors, Pedagogy and MOOCs

In this post I’ve collected and commented on recent reports outlining several professors perspectives on the development of MOOCs, the teaching experience and how the instructional methods differ from traditional courses.

iStock_000019623568XSmallWhat is it like to teach 10,000 or more students at once, and does it really work? (Kolowich, 2013). Excellent question—and now that Massive Open Online Courses [MOOCs] offered through providers such as Coursera have been around for a several months, we are starting to get data and insights from the professors in the trenches—those that have developed and facilitated the courses with thousands of students. The Chronicle of Higher Education shared results of a survey it conducted in February with professors from higher education institutions involved in teaching a MOOC. A total of 103 professors responded to an online questionnaire that was sent out to 184 professors that had recently taught, or were in the process of teaching a MOOC (Kolowich, 2013). Results are intriguing, and in some cases startling, for example the responses to a question on peer grading [see image below]:

Screen Shot 2013-03-19 at 12.26.02 PM

Screen Shot from The Chronicle’s survey results on peer grading. http://www.chronicle.com/the-professors-behind-the-mooc

What I found fascinating was the change in professors’ attitudes towards MOOCs after they had finished teaching their own massive online course. Before teaching a MOOC, 29.7% respondents reported being very enthusiastic’ about fully online courses, yet after the teaching experience, 55.9% reported being ‘very enthusiastic’. Hmm. Even the somewhat skeptical group changed their views after their MOOC experience. To read more results from the survey, click here.

Screen Shot 2013-03-19 at 12.43.35 PM

Screen shot from “Voices from the Survey”, The Chronicle

Voices from the Survey
Included in The Chronicle’s coverage on the survey results, is a section that shares professors views on online learning, pedagogy and grading.  It is an interesting read. To the right is one of the professor’s comments, which addresses a topic that may be worthy of further research. From the last two  MOOCs I have completed with Coursera, I too have the impression that many active participants hold at least an undergraduate degree. Perhaps after identifying the demographic profile of the average student in a MOOC, course content and methods could be adapted accordingly.  Click here to browse through the feedback from The Chronicle’s report.

MOOC Development at Duke University
Duke University launched its first course with Coursera in June 2012, Bioelectricity: A Quantitative Approach, and wrote an extensive report upon its conclusion that summarizes the course development and instructional experience. The report is thorough, well prepared, and provides details about the experience from the developer and instructor’s perspective, including the number of hours invested developing and teaching the course (Dukespace.lib).
Included also is extensive data on enrollment rates, student participation patterns, demographics on active students, including their educational background. The data from this course supports what Professor Llewellyn stated in The Chronicle’s survey as mentioned above—that the active students (those students that participated in the survey at least), possessed an advanced level of education as the screen shot shows below right:
Screen shot from Duke University report on first Coursera Course.

Screen shot from Duke University report on development of Bioelectricity: A Quantitative Approach offered through Coursera in June 2012

The course involved over 600 hours in development and delivery, and the professor of the course, Dr. Roger Barr, invested 420 hours of the 600. The report also speaks of Dr. Barr’s extensive involvement in the discussion forums, as he devoted many hours to answering questions, reading posts and monitoring feedback.

Final Thoughts
What is becoming apparent after reviewing the reports mentioned in this post, and in conversations with several of my peers through Google+, etc, the time involved in teaching a MOOC is extensive, requiring an instructor’s undivided attention. I’ve heard of one or more professors teaching a MOOC while assuming his or her full teaching responsibilities at the university, which put tremendous pressure on the individual. Also apparent is the volume of upfront work that is required—an extensive amount of time is devoted to preparing the content, materials, instructions for students, and the course home page. There is still much more to learn about MOOCs. It is too early at this point to determine how this format will be most effective for learners, and which instructional design methods work best, but we are seeing emergent patterns and results, which are taking us in the right direction.

Further Reading

Peer Grading: A Student Perspective in an Open and Online Course

In this post I share my peer grading experience as a student in the e-learning and digital cultures course [edcmooc] offered through Coursera. I’ll provide readers a window into the student experience how it works, guidelines provided by the instructors and assignment criteria. I’ll also share the assignment I submitted for this course and share the results—grades and comments provided by four students that evaluated my digital artefact.

Holding Blank Score CardsMy last post delved into peer grading, the pedagogy and the learning theories behind the process of peer grading. I thought readers may find it useful to view the experience from the inside, viewing the process as a student would.

Description of Assignment: A Digital Artefact
Within the five-week course, topics included, a) what it means to be human in a digital world, b) utopian and dystopian views of our world past, present and future, and c) how learning is influenced by technology in today’s digital culture. There was one assignment for the course, an artefact [artifact spelled the British way is with an 'e'], a digital presentation representative of two or more concepts from the course, as described below:

Screen Shot 2013-03-05 at 6.21.47 PM

Description of assignment for #edcmooc from the course web site. Below this introduction on the page within the course website, were further detailed directions and guidelines, including how long the assignment should be, suggestions for platforms to use, i.e. Voicethread, Pixton, Prezi, etc. possible topics, and assignment criteria which in turn was used for grading purposes.

I learned far more than I expected from the process of completing the assignment, and from the peer grading exercise itself. It was engaging, quite enjoyable, and if we use the activity on the social networks as any indication, numerous students appeared to feel the same as I did. Discussions on Twitter @#edcmooc were prolific and are still going strong.

Screen Shot 2013-03-07 at 8.07.18 PM

Screen Shot of Twitter conversation in #edcmooc happening after the evaluation.

Student Enthusiasm for Peer Grading
Students appeared highly engaged, excited about the results of the assessments, theirs and others during the three-day evaluation period. Students shared on the courses’ Facebook page, they Tweeted, they discussed, and posted questions seeking advice about grading. Peer grading seemed to be taken quite seriously by active students.

Assignment Criteria
Often neglected in online courses are clear and specific descriptions provided about class assignments, the why, the how and the purpose. In my experience working with faculty in designing online courses, writing the narrative to cover these points requires time and attention to detail, but is well worth the time it takes, and instructors in #edcmooc followed these principles to a tee. One example is the assignment criteria:

“These are the elements peer markers will be asked to consider as they engage with your artefact. You should make sure you know how your work will be judged by reading these criteria carefully before you begin.

  1. The artefact addresses one or more themes for the course
  2. The artefact suggests that the author understands at least one key concept from the course
  3. The artefact has something to say about digital education
  4. The choice of media is appropriate for the message
  5. The artefact stimulates a reaction in you, as its audience, e.g. emotion, thinking, action” [Coursera, e-learning and digital cultures]

The GradingHow it Worked
The instructions provided on how to grade were thorough, and once I started the process of grading, the system guided me through following the assignment criteria closely. From the course website, with use of screen shots:

What you have to do
“When you have submitted your own artefact, the system will give you access to three other artefacts created by your peers, on which we ask you to provide feedback, and to offer your evaluation. This feedback will take the form of numbers and comments. It will involve the following steps for each”. Following this paragraph where further descriptions on how to make comments, (provide reasons), how to give and receive feedback, and encouraged further discussion and sharing on social media platforms after the close date of the assignment and included links for further reading on the peer review process and critical thinking.

Screen Shot 2013-03-02 at 3.50.45 PM

Screen shot: The first step we had to do in grading was, upon reviewing the artefact, was to give feedback according the criteria for this assignment.

Screen Shot 2013-03-02 at 3.50.53 PM

Screen Shot: The next step was assignment a grade following the above scale.

Screen Shot 2013-03-02 at 3.51.01 PM

Screen Shot: In the final step we were given the opportunity to write a synopsis,

My Artefact and Peer Feedback
My artefact which I submitted for grading focused on the theme of ‘being human in a digital world’ and included the concepts discussed in the coursehumanism, posthumanism and transhumanism specifically. I used the platform of Pinterest [which I joined some time ago, but didn't use until this assignment]. I was pleasantly surprised at how effective this tool was; I was able include a fair bit of text to describe and summarize the concepts with image files, or embedded YouTube clips.

Screen Shot 2013-03-10 at 6.45.32 PM

Screen shot of my Digital Artefact on Pinterest. Click the image to view the board.

Peer Feedback
The quality of feedback I received from the student graders was overall very good. I was impressed with the comments, the insight and depth given the assignment criteria.  Also of note what how peer #2 mentioned reviewing the board helped him or her to ‘conceptualize the concepts’. This is an example of how peer grading can enhance learning for students.

Screen Shot 2013-03-03 at 10.46.38 PM

Screen Shot: Peer Feedback

Screen Shot 2013-03-10 at 6.56.37 PM

Screen shot: Final score out of 2.

Screen Shot 2013-03-03 at 10.46.55 PM

Screen shot: Final comments

Conclusion
I wrote in a previous post, A Tale of Two MOOCs @ Coursera, how the e-Learning and digital cultures format was an excellent example of a connectivist learning environment; a student focused learning community where students learn through making connections within a network. The digital artefact assignment and peer grading method were excellent choices in keeping with the connectivist coursestudents not only made connections within social networks throughout the course, but the peer review process served as a means to further conceptualize learning, expand personal connections beyond the class network, and prompted students to share their work with peers after the formal grading process using their real identities. The value of peer grading in this course went far beyond the grade and feedback each student received on his or her assignment; it created opportunities for learning that traditional grading could never provide. It was a brilliant fit for this course.

Links to #edmooc discussions and Final assignment Sharing