The purpose of performing the full exam quality assurance (QA) is to ensure that all the content is displaying and performing in Meazure as expected, and to review the candidate exam experience before locking down the content and opening the exam to actual candidates. This article will describe the exam QA process.
Before performing the exam QA, you should have created items and built exams. This QA is intended to review those finalized versions.
QA process outline
- (If applicable) Clone the exam.
- In the exam shell, set the proctoring setting to unproctored.
- Grant yourself the exam on a test user account.
- Login to the candidate portal as your test user.
- Navigate to the Exams tab. This will list all the exams available to your candidate user.
- We recommend taking the Platform Tutorial first.
- To write an exam, click Write Exam.
- Enter exam and item feedback on the question notepad (clipboard icon).
- Click Submit Exam when you are finished with the exam.
What exam shell settings should I use if the exam has not been granted to candidates and the QA is scheduled to be completed before this date?
- Set the exam shell to unproctored and ensure the question notepad is enabled on the exam shell.
What exam shell settings should I use if the exam has been granted to candidates, the booking window is open, and/or the exam is proctored?
- Clone the exam and rename the cloned exam with an internal QA identifier. This QA exam shell should be unproctored with the question notepad enabled for feedback.
What to look for during QA
- Do the questions appear as they should (e.g., styling and syntax)?
- Do the screens appear as they should (e.g., styling and syntax)?
- Are there any content changes that need to be made (e.g., terminology or clarifications)?
- Anything else that stands out (e.g., images missing or incorrectly assigned)?
How to QA a rules-based exam
- Rules based exams will only use a limited number of questions per exam based on the blueprint you provided. To review all exam questions, you must grant your user account a rules-based exam and also create an additional static exam form with all exam content. See this article for more information on building a static exam form: How to create a static exam form
How to QA multiple exam forms within an exam shell
- Add a new exam grant for each form.
- Manually assign a form for each grant.
- Assign a specific expiry date for each grant as an identifier for the form.
Next steps
- Run the Exam Notes Report and identify any items with comments. These comments will be linked to the item's canonical ID.
- Using the item's canonical ID, edit the questions based on the feedback provided.
- Please note: items on static exams do not update automatically. If you'd like these items to be their most up-to-date version on active exam forms, the forms will have to be updated as well. However, if the exam is rules-based, Meazure will automatically use the most current item version.