Setting a Balanced Paper: Coverage, Difficulty and Time

A paper that everyone fails and a paper that everyone passes tell you equally little. Setting one that actually measures a class is a craft, and most of it happens before you write the first question.
Every staff room has had this conversation. The results come in, the average is 38, and somebody says the class did not work hard enough. Sometimes that is true. Often the paper was simply badly built — too long, weighted towards two chapters, or made of questions that only separate the top three students from each other.
A good paper is not a hard paper or an easy one. It is one where a student's score tells you something reliable about what they know. That takes planning before any question gets written.
Start with a grid, not a question
Before writing anything, draw a simple table: chapters down the side, marks across the top, split into recall, understanding and application.
Fill in the marks you intend each chapter to carry. Weight them by teaching time, not by how much you enjoyed the chapter. If you spent three weeks on one topic and four days on another, a paper giving them equal marks is not measuring your class — it is measuring who guessed your preferences.
This grid takes ten minutes and prevents the most common fault in school papers, which is accidental concentration: three of five long questions drawn from the chapter that happened to be freshest in the setter's mind.
Mix the difficulty on purpose
A workable split for a routine school exam is roughly a quarter straightforward recall, half material a student who has studied properly can handle, and a quarter that genuinely stretches.
The first quarter is not padding. It gives weaker students a route to a defensible mark and tells you who has done nothing at all — information you lose entirely if every question is hard. The last quarter is what separates the top of the class. Without it, your best students all score 95 and you learn nothing about them.
If your paper has no easy questions, your results measure confidence. If it has no hard ones, they measure handwriting speed.
Time it honestly
The most frequent complaint about school papers is that they cannot be finished, and it is usually justified.
There is a crude but effective check: work the paper yourself, writing out full answers, and multiply your time by three. Students write more slowly than the person who set the questions and already knows the answers. If your tripled time exceeds the allowance, the paper is too long — and an unfinishable paper measures speed, not knowledge.
Cutting one long question is almost always better than hoping they will manage.
Write questions that mean one thing
Ambiguity is the enemy of fair marking. “Discuss photosynthesis” invites anything from two lines to two pages, and whatever a student writes, somebody can argue it deserved more marks.
Say what you want and what it is worth: state the equation, name the two stages, explain where each takes place. Now the student knows what to produce, you know what you are marking, and a colleague marking the other half of the scripts will mark it the same way you do.
Write the marking scheme at the same time as the question, not afterwards. If you cannot write the scheme in one line, the question is unclear.
Reuse, but deliberately
There is nothing wrong with reusing questions — a good question stays good. The risk is reusing a whole paper, which within a week of the exam is circulating in photocopied form and no longer measures anything.
Keeping questions in a shared bank, tagged by chapter and difficulty, makes this manageable: you assemble a fresh paper from stock each time rather than rewriting one from nothing or reprinting last year's. It also means a new teacher inherits the department's accumulated judgement instead of starting from scratch.
Read it once as a student
Before it goes to print, read the paper from the top as though you were sixteen and nervous. Are the instructions clear? Is the choice obvious? Do the marks add up? Is there a typo in question six that will produce forty raised hands?
Five minutes of that catches most of what otherwise becomes an announcement shouted across the hall twenty minutes in — which disrupts everyone and penalises precisely the students who are concentrating hardest.
Comments
Leave a reply