Assessment

AI Quiz Makers: Five Things to Check Before You Print

Generated quizzes fail in predictable ways: ambiguous items, mismatched keys, reading level, fake difficulty. Here is the five-minute check.

October 31, 2026· LessonCraft Editorial5 min read
AI Quiz Makers: Five Things to Check Before You Print

A quiz generator can produce twenty questions on cell division in about forty seconds. Thirty copies take four minutes. Handing out a quiz with two defensible answers takes one class period to recover from.

The problem is not that generated questions are bad. It is that they are plausible, and plausible is exactly the property that gets past a tired skim on a Friday afternoon. These five checks are the difference between a draft and something you can print.

Check 1: solve every question yourself

Not skim — solve. With a pen, on the printed page, in the order students will meet them.

This catches the most expensive failure: an item with two correct answers, or a "which of the following does NOT" question where the negative is buried in a subordinate clause. Models are good at producing items that look right; they are indifferent to whether exactly one option survives scrutiny.

For maths and science, solving also catches answer-key drift. Generated keys occasionally disagree with generated questions, especially on multi-step problems where the model wrote the answer before writing the distractors.

Check 2: confirm the answer key matches the questions

Keys fail in three ways:

  • Position drift. The model writes the key for an earlier draft of the question and then reorders the options.
  • Unit errors. Kilometres in the question, metres in the key.
  • Rounding disagreement. The question says "round to one decimal place"; the key shows two.

Read the key against the questions, not against your memory of solving them. Two minutes, and it is the only check that catches drop-down errors in a digital quiz you will not see again until students open it.

Check 3: read the first question aloud

Reading level is the invisible failure. A question can be conceptually correct and lexically too hard, and students who cannot parse the stem are indistinguishable from students who do not know the content.

Read the first three stems aloud. If you have to restart a sentence, simplify it. Watch specifically for:

  • Nominalisations ("the process of condensation" instead of "when water condenses")
  • Stacked subordinate clauses
  • Two-part stems joined by "and explain why"

The last one is common in generated short-answer items and inflates the reading load without adding assessment value.

Check 4: test whether "hard" means harder

Generated difficulty scales by wording length far more often than by cognitive demand. A "hard" multiple-choice item frequently has the longest stem and the same recall-level answer as the "easy" one.

A quick test: for three items labelled hard, ask what a student has to do that is different. If the answer is "read more", the difficulty is fake. Rewrite at least one item per quiz yourself so it requires inference, application, or justification.

Bloom's-style gradations are useful here as a diagnostic rather than a design tool: if every item sits at remember or understand, the quiz measures recall regardless of its labels.

Check 5: verify the mix, not just the count

A quiz with ten questions can be all recall. Check the distribution before printing:

  • How many items test recall of a definition?
  • How many require applying a procedure?
  • How many require explaining reasoning?

For most units, a workable ratio is roughly 5:3:2 for recall, application, and explanation — adjusted to the standard being assessed. If the standard's verb is explain, your quiz should not be nine-tenths recall.

The mix matters for a second reason: it tells you what to reteach. A quiz that is all recall tells you students can memorise; it says nothing about whether they can use the idea.

Format decisions worth making before generating

A few choices save time later:

  • Separate answer key. Ask for it as a separate page or section, so the student version prints clean.
  • Editable items. Generate questions as a list you can delete from, not as a table you cannot reformat.
  • Space for working. Printed quizzes need room for working; generated layouts rarely allow for it.
  • Number the standards. If the quiz covers two standards, tag each item so you can analyse results by standard rather than by total score.

Where generated quizzes genuinely help

Three cases hold up:

  1. Item volume for practice. Twenty retrieval questions on a topic, which you then cut to the eight good ones.
  2. Distractor ideas. Generated wrong answers are useful raw material even when the question itself is weak.
  3. Parallel versions. A second form of the same quiz with reordered options and swapped numbers, generated from the corrected first version.

What they do not replace: deciding what the quiz is for. A quiz that exists because Friday needs a grade measures compliance, not learning, and no generator fixes that.

Frequently asked questions

Are AI-generated quizzes allowed in school assessments?

Teacher-made formative quizzes are usually fine under existing policy, because the teacher remains responsible for content. Summative or standardised assessments often have explicit rules — check before using a generated item in anything that counts.

How many questions should I generate to get ten good ones?

Roughly double. Generating twenty and keeping the ten that survive the five checks is faster than generating ten and trying to repair the weak ones.

Can students tell a quiz was generated?

They can tell when items are interchangeable and the phrasing is uniform. Two rewrites — one item with a local context, one with a question that requires a sentence of explanation — break the pattern.

Bottom line

An AI quiz maker is a draft engine with a blind spot for ambiguity. Solve the items, check the key, read the stems aloud, test whether hard is actually hard, and confirm the mix. Five minutes of checking protects a class period of instruction — a trade worth making every time.

Put this into practice in the next ten minutes

The lesson plan generator does the drafting so you can spend your time on the judgement call.