Pages

Tuesday, July 18, 2023

Michael Johnston: Not too excellent please


NZQA would like help deciding what excellence means.

The trouble is, too many students have been achieving it.

So, NZQA has published a discussion document. Presumably, they want people to discuss what excellence means and let them know.

Before NCEA was implemented 20 years ago, we didn’t have to worry about what excellence meant. Grades were allocated to fit pre-determined distributions. A few percent would get grades of A, a few percent more, grades of B, and so on. It was called ‘norm-based’ assessment.

A lot of people thought norm-based assessment was unfair. It rationed the best grades so that only the best students could attain them, they said. NCEA was designed to fix that.

NCEA is a ‘standards-based’ system. That means students are judged only on their own performance, rather than relative to the performance of others.

That was the idea, anyway.

Some starry-eyed educators looked forward to a day when everyone would get Excellence. Under a standards-based system, that is possible, in theory.

Twenty years on, it’s becoming true – in practice. In some assessments, Excellence is now the most frequent grade. As it turns out, though, that’s not so excellent after all.

In its discussion document NZQA puts the problem like this: “Excellence has now become the goal for many students … While this is very acceptable as a goal, many students expect and do receive it.” This, they say, “lowers the standing of Excellence, as it no longer discriminates good from superior performance.”

NZQA has quite the dilemma on its hands.

Under our standards-based system, if students show excellence (whatever it may mean), they should get a grade of Excellence. On the other hand, if too many students get Excellence, then it isn’t special anymore.

So, we need to define excellence in a way that allows all excellent students to attain it. But we also need to define it so that not too many are excellent.

What NZQA doesn’t seem to have considered is that, however we define excellence, it will not only be a goal for students. It will be a goal for their teachers too.

Teachers like their students to be excellent. That means, when it comes to marking, teachers will always be inclined to give them Excellence.

So, whatever NZQA decides excellence is, in a few years we will be having this discussion again.

Maybe they should just go back to using a norm.

Dr Michael Johnston has held academic positions at Victoria University of Wellington for the past ten years. He holds a PhD in Cognitive Psychology from the University of Melbourne. This article was published HERE

3 comments:

Robert Arthur said...

I remember all the hype when School Cert was phased out. It was to be the end of mark scaling and norm based marking as above. If all the coloossal effort devoted to NZCA had been put into School Cert and the teaching of, it could have been a superlative qualification. And employers understood it. How many of parents and the public can summarise NZCA?

Barend Vlaardingerbroek said...

Pressure is put on the system to toughen up when too many candidates get an 'Excellent' grade, and to loosen up when too few get one. In the end, when everyone is more or less happy, you end up with a grade distribution that looks awfully much like a norm-referenced one!
The idea of Standards came from vocational education. Unit Standards have pass and fail grades. You can either do a job or you can't. The notion of Standards was then applied to academic subjects and the grading system was shortly thereafter amended to allow for 'Excellent' passes. But this means very little in the absence of a consistent means of comparing performances within the target population i.e. norm referencing.

Martin Hanson said...

Though I disagree with Melanie Phillips on many issues, the title of her book "All must have prizes" a quote from Alice in Wonderland, sums up our situation perfectly.