Scenario-based questions allow you to assess whether test-takers can apply their knowledge in realistic situations rather than simply recall information.
You can use a shared Passage to provide context for one or more multiple-choice (MCQ) or multiple-select (MSQ) questions. With this functionality, more than one question can be displayed with the passage on a single screen.
Note: Scenario-based questions are only available in the new Exam UI. They are not supported in the legacy exam UI. The new Exam UI is enabled on the General tab on the exam shell.
What are scenario-based questions?
Scenario-based questions present a realistic situation or context and ask test-takers to apply their knowledge to answer one or more related questions.
A Passage provides the scenario or other shared context. Multiple questions can then be associated with the Passage and displayed together on a single screen.
This approach can help you assess:
- Application of knowledge in realistic situations
- Analysis and problem-solving
- Judgment and decision-making
- Connections between multiple concepts
- Job-relevant knowledge and skills
Scenario-based questions can provide richer evidence of competency than questions focused solely on memorization.
How do I create a scenario-based Passage?
This functionality is set on the Passage:
What question types are supported?
The display-together functionality supports:
- Multiple-choice (MCQ)
- Multiple-select (MSQ)
Important: Only MCQ and MSQ items can be used when a Passage is configured to display multiple questions together. Adding another item type will result in an error.
How does it work?
Scenario-based questions use a Passage to provide context for the questions.
When configured to display items together, multiple questions can be presented alongside the same Passage. This allows test-takers to refer back to the scenario as they answer each question.
A Passage can also be used with a single question when questions do not need to be grouped.
Questions can be displayed horizontally.
The functionality also allows Test Builders to display the Passage and exam questions horizontally, giving test-takers access to the scenario as they work through the related questions.
What will test-takers see?
Test-takers will see the Passage alongside the associated questions.
For a scenario with multiple questions, the Passage provides the shared context while the test-taker works through the related MCQ or MSQ items.
The exact question flow can also be controlled using your existing exam settings.
Existing exam settings
Scenario-based questions support standard exam shell settings, including:
-
Require an answer before continuing
- You can require test-takers to answer every question before moving to the next group of questions.
-
Prevent answer changes
- You can prevent test-takers from changing an answer after it has been entered.
-
Display rationales immediately
- You can configure the exam to display the rationale as soon as a test-taker selects an answer.
-
Prevent backward navigation
- You can prevent test-takers from moving backward to review previously answered questions.
When should I use scenario-based questions?
Scenario-based questions are particularly useful when you want to determine whether a test-taker can apply knowledge rather than recall information.
Consider using them when you want to assess:
- Application: Can the test-taker apply a concept to a realistic situation?
- Analysis: Can the test-taker interpret information and determine what is important?
- Decision-making: Can the test-taker select an appropriate action?
- Problem-solving: Can the test-taker determine how to respond to a situation?
- Integration: Can the test-taker connect multiple concepts to solve a problem?
For questions that only require simple recall, a traditional standalone question may be more appropriate.
Best practices
When creating a scenario-based assessment:
-
Use realistic scenarios
- Create situations that reflect the types of circumstances test-takers may encounter in practice or on the job.
-
Provide meaningful context
- Include enough information in the Passage for test-takers to understand the situation and make informed decisions.
-
Connect questions to the scenario.
- Each question should require the test-taker to use information from the scenario or apply knowledge within that context.
-
Assess application, not memorization
- Use the scenario to determine whether the test-taker can apply what they know, analyze information, and make decisions.
Frequently Asked Questions
Can I use any item type with a Passage?
No. When a Passage is configured to display multiple questions together, only MCQ and MSQ items are supported. Other item types will generate an error.
Can I use a Passage with only one question?
Yes. Passages can be used for both scenario-based questions with multiple associated items and situations where a single question is displayed alongside a Passage.
Can test-takers see the Passage while answering questions?
Yes. The Passage provides the shared context for the associated questions, and questions can be displayed horizontally with the Passage.
Can I require test-takers to answer every question before continuing?
Yes. Existing exam shell settings can be used to require an answer before the test-taker moves to the next group of questions.
Can test-takers change their answers?
This depends on your exam configuration. You can configure the exam to prevent candidates from changing an answer after it has been entered.
Can I prevent test-takers from going back to previous questions?
Yes. The exam can be configured to prevent test-takers from moving backward to review previously answered questions.
Which ExamUI supports scenario-based questions?
Scenario-based questions are available in the new ExamUI and are not supported in the legacy exam UI.