Tag Archives: education design

Designing DDLR & DDeLR – Assessments

Today is all about pinning down the most appropriate types of assessments for this subject. Yesterday I think I got a little caught up in reviewing the principles of good assessment – which was valuable but it might also be better applied to reviewing and refining the ideas that I come up with.

For what it’s worth, these are the notes that I jotted down yesterday that I want to bear in mind with these assessments. DDLR Assessment ideas

Looking over the four versions of this subject that my colleague J has run in the last 2 years has been particularly enlightening – even if I’m not entirely clear on some of the directions taken. The course design changed quite substantially between the second and third iterations – from a heavily class-based activity and assessment focus to more of a project based structure. (For convenience I’ll refer to the subjects as DDLR 1, 2, 3 and 4)

DDLR 1 and 2 provide an incredibly rich resource for learning to use eLearn (our Moodle installation) and each week is heavily structured and scaffolded to guide learners through the process of developing their online courses. The various elements of the units of competency are tightly mapped to corresponding activities and assessment tasks – moreso in DDLR 2. (Image from the DDLR subject guide)

I have to wonder however whether the course provides too much extra information – given the relatively narrow focus on designing and developing learning resources. Getting teachers (the learner cohort for this subject) to learn about creating quizzes and assignments in Moodle is certainly valuable but are these truly learning resources? This may well be one of the points where my approach to this subject diverges.

The shift in approach in DDLR 3 and DDLR 4 is dramatic. (As far as a diploma level course about designing learning resources might be considered dramatic, at least.) The assessments link far more closely to the units of competency and all save the first one are due at the end of the subject. They are far more formally structured – template based analysis of the target audience/learners, design documents, prototypes and finished learning resources, as well as a reflective journal.

It does concern me slightly that this subject has a markedly lower rate of assessment submission/completion that the two preceding ones. That said, this subject is often taken by teachers more interested in the content than in completing the units of competency and that may just have been the nature of this particular cohort.

This new assessment approach also seems far more manageable from a teaching/admin perspective than the previous ones, which required constant grading and checking.

My feeling is that this is a more sustainable approach but I will still look for ways to streamline the amount of work that is required to be submitted.

The next step was to map the various elements of competency to assessment items. The elements for both units of competency are written differently enough to need to be considered separately (unfortunately) but they both still broadly sit within the ADDIE (Analyse, Design, Develop, Implement, Evaluate) framework. ADDIE seems like a useful way to structure both the course and the assessments so I have mapped the elements to this. I have also highlighted particular elements that are more indicative of outputs that might be assessed. Working through the analysis process will be quite dry (and could potentially come across as slightly patronising) so finding an engaging approach to this will be important.

Photo of elements of competency mapped to ADDIE elements (I’m also quite keen to bring digital badges into this process somehow, though that’s a lower priority at the moment)

Finally, I had a few ideas come to me as I worked through this process today that I might just add without further comment.

DDLR / DDeLR ideas

Get the class to design and develop a (print based? ) checklist / questionnaire resource that might be used to address DDLR 1 and DDeLR 1 UoCs. Get someone else in the class to use it to complete their Analysis phase.

Can I provide a range of options for the forms the assessment/resource pieces might take?

Try to develop a comprehensive checklist that teachers can use on the resources that they produce to raise the quality overall of resources at CIT. (Again, this could be a student led tool – the benefit of this is that it makes them think much more about what a good resource requires – does this meet any UoCs??)

Convert the print based Analysis document into a web resource – book tool or checklist maybe? Also possibly fix the print based one first – from a deliberately badly designed faulty version. (Lets me cover some readability / usability concepts early)

How much of this subject is leading the learners by the hand? How much is about teaching them how to use eLearn tools?

Could one of the learning resources be about developing something that teaches people how to use a particular eLearn tool???

Need to identify what kinds of resources teachers can make. Good brainstorm activity in week 1.

Think about the difference between creating a learning resource and finding one and adding it to your course. (Still important but tied to the UoC?)

If I give teachers the option to use previously developed resources (authenticity issues??), they should still provide some kind of explanatory document AND/OR edit the resource and discuss what changes they made and why.

Need to consider the relative strengths and weaknesses of the various types of tools.

In-class feedback of learning resources to better support the evaluation and implementation based elements of competency.

One activity (possible assessment) could be for learners to gather information needed to do an analysis from a partner in the group. (and vice versa) Might lead to a more critical examination of what information is being sought. Learner might even provide suggestions for design/development?

Sample resources?




Learning from Board Games :: UXmatters


Some great usability tips that we can draw from board games

via Delicious (via IFTTT)

Learning design: Why you want to lead with the scenario


This post by Cathy Moore (and another that I came across not too long ago here at Computing Education Blog ) struck a chord with me. In essence, they are both saying that learners can benefit by having their skills and knowledge tested right from the beginning of a subject. Whether it involves participating in a scenario and completing some kind of formative assessment, putting this activity up front lets your learners see what they are expected to know, what they don’t currently know and why this is a relevant and worthwhile part of their studies. The odds are pretty good that they will fail the scenario or quiz or whatever the first time around but as long as we make it clear that this is OK and that it’s just a part of learning, the memories of this experience will give context and meaning to everything else that they learn afterwards. I took this approach perhaps a little inadvertently in a digital literacy course that I trialled last year. I wanted to test the value of a particular quiz

via Delicious (via IFTTT)

San Jose State’s MOOC Missteps Easy to See – Higher Education


Some useful lessons about running MOOCs gained by looking at a poorly run one. The fact that these courses were still being built as they were being delivered – something perhaps not uncommon in face-to-face land but rarely an inspiring sign – should have been the first give away. It’s hard not to think that this was the result of a top-down “OMG, everyone else has a MOOC, we have to have one too, now, now now” mentality that even I have been bumping up against lately

via Delicious (via IFTTT)

Great e-Learning designs for Moodle – Karyn Milne CIT Creative Industries

screenshot of moodle course

The following short video (5:03) showcases some of the fantastic design work that one of our Creative Industries teachers – Karyn Milne – has done in her Moodle course. (We call our Moodle system eLearn, in case you find references to eLearn in the video confusing).

The main tips that I have taken from this are:

  1. Use advance organisers to give learners a context and a framework for the activities and resources that are coming. In this instance it is as simple as expanding on the topic heading – Printing (Technology, literacy and cultural change) or The Bauhaus (Form follows function – and the new hopes)
  2. Visual representations of the content help add extra meaning. Now Karyn is a skilled graphic designer so maybe your topic banners might not be quite as artistic but it is still relatively easy to add simple images that also help to break up the dreaded Moodle wall of text
  3. Provide simple and direct instructions with the actions emphasised
  4. Provide a range of different resources and activities – in these two topics we have documents, videos, a quiz and a discussion forum.