Tag Archives: assessment

Unsurprising but important research: there is a sequential bias based on order in which work is presented and then graded in learning management systems (after Wang et al., 2024)

My awesome colleague Rachel Forsyth (of our amazing “trust” paper) sent me a message saying “unsurprising but important research” and then a link to Wang et al. (2024), and that is a good summary. In a study of more than 30 million grading records in a Learning Management System, Wang et al. (2024) find that students with surnames later in the alphabet (and thus graded later in the sequence) a) get lower grades, b) get more negative and impolite comments, and c) are complaining more about their grades to the relevant authority. This happens across subjects, and accumulates for students in such a way that it shows up in final grades and can thus potentially even influence job opportunities. So what should we do?

Continue reading

Currently reading: “Sustainable assessment revisited” (Boud & Soler, 2016)

“Sustainable assessment” is about making assessment useful to learning beyond the frame of the course it is related to, not just in terms of retaining the learnt information and skills for longer, but to support future learning. Resource-intensive courses or practices might become more sustainable if they have far-reaching consequences beyond just the course, and really sustainable if they educate self-managing, learning stake-holders who will act responsibly and competently in society in a challenging future. Teachers are likely intending that long-term impact with their teaching already, but how can it also be supported through assessment design? My summary of Boud & Soler (2016) below.

Continue reading

Operationalising and assessing sustainability competencies (some ideas from Wiek et al. (2016) and Redman et al. (2020))

We put a lot of effort into teaching for sustainability, but whether or not we are actually successful in doing so remains unclear until we figure out a way to operationalise learning outcomes and, obviously, ways to assess them. Below, I am summarising two articles to get a quick idea of how one might do this.

Continue reading

Prompt engineering and other stuff I never thought I would have to teach about

Last week, I thought a very intensive “Introduction to Teaching and Learning” course where we — like all other teachers everywhere — had to address that GAI has made many of the traditional formats of assessment hard to justify. We had to come up both with guidelines for the participants in our course on how to deal with GAI in the assessment for our course, and with some kind of guidance for them as teachers.

Continue reading

Currently reading: “The impact of grades on student motivation” (Chamberlin et al., 2023)

An argument that I encounter a lot is that student assignments need to be graded in order for students to put in any effort at all. But is that true? In the literature, grades have been connected to stress and anxiety for students, more cheating, less cooperation, less thinking, less trust — so ultimately less learning. So what does grading student work do for student motivation? My summary of Chamberlin et al. (2023) below.

Continue reading

Currently reading: “Teaching with rubrics: the good, the bad, and the ugly” (Andrade, 2005)

Doing my reading for the monthly iEarth journal club… Thanks for suggesting yet another interesting article, Kirsty! This one is “Teaching with rubrics: the good, the bad, and the ugly” (Andrade, 2005) — a great introduction on how to work with rubrics (and only 2.5 pages of entertaining, easy-to-read text, plus an example rubric). My summary of the article:

Continue reading

Currently reading: “Beyond open book versus closed book: a taxonomy of restrictions in online examinations.” by Dawson, Nicola-Richmond, & Partridge (2023)

If we want to do a valid assessment of what a specific student can do, we need to know what information they had available when producing the artifact we are evaluating, who they could communicate with, and what tools they had access to. And we might want to restrict access to some or all of those, to some degree or completely. Dawson et al. (2023) develop a taxonomy of restrictions that I find really useful as an overview!

Continue reading