How to Create Reading Comprehension Quizzes That Actually Test Understanding

The Problem with Most Reading Quizzes

"According to the passage, what did the author say about X?" is not a comprehension question. It's a scanning question. Students don't need to understand the passage — they just need to find the sentence with "X" in it.

This type of question is common, easy to write, and nearly useless for building reading skills.

Real reading comprehension involves:

A Taxonomy of Reading Comprehension Questions

Level 1: Literal Comprehension

Students find information explicitly stated in the text.

Example: "What reason does the author give for the decline of bee populations?"

When to use: As a starting point, to verify students read the text. Should make up no more than 20% of a reading quiz.

Level 2: Reorganization

Students identify relationships between ideas in the text — not stated directly, but derivable from the text.

Examples:

When to use: Core of most reading quizzes. 30–40% of questions.

Level 3: Inferential Comprehension

Students go beyond what's stated to what's implied.

Examples:

When to use: This is where real comprehension is tested. 30% of questions.

Level 4: Evaluation

Students assess the quality of the author's argument.

Examples:

When to use: For higher-level courses, or as extension for strong readers.

Level 5: Appreciation and Personal Response

Students connect the text to their own knowledge and experience.

Examples:

When to use: Discussion-based classes, literature courses, reflective learning contexts.

Generating Comprehension Questions with AI

Paste any text into SimpleQuizMaker and the AI automatically generates comprehension questions across multiple levels. For more targeted results:

Prompt the level:

For literary texts:

For informational texts:

Designing Distractors for Reading Questions

The biggest challenge in reading MCQs is writing plausible wrong answers. These common distractor types work well:

Too broad: A statement that's generally true but overstates what the passage actually says

Too narrow: A true detail from the passage that doesn't answer the question

Opposite: The reverse of the correct interpretation

Out of scope: Plausible-sounding but not supported by the text

AI-generated distractors typically represent these types well, because the AI understands what "close but wrong" looks like for comprehension questions.

Frequently Asked Questions

How long should the reading passage be for a comprehension quiz?

For 15-minute quizzes: 300–500 words (grades 4–8), 500–800 words (grades 9–12), 600–1000 words (college).

Should I include the passage in the quiz or expect students to have read it beforehand?

Include it for timed tests — students need it to answer inference and evaluation questions accurately. For open-book take-homes, providing it is optional.

Related reading: [How to Write Good Quiz Questions](/blog/how-to-write-good-quiz-questions) · [Higher-Order Thinking Questions](/blog/higher-order-thinking-questions) · [English Quiz Generator](/quiz-subjects/english-quiz-generator)