Adjudicating responses in SecureMarker
In SecureMarker, you can configure scripts to require marking by two independent markers. The final mark assigned to an item is the aggregated mark between the two markers.
If items are configured for double marking and one or both markers mark a response out of tolerance, the response is sent for adjudication. Adjudicators can review responses requiring adjudication, including their original marks, comments, and annotations.
This article explains how to adjudicate a response in the Adjudication screen in SecureMarker.
In This Article
1. Go to the Adjudication screen
To view the Adjudication screen, select Adjudication on the navigation bar.
2. Choose an item
Select an item or item group to mark in the Items grid.
3. Select Adjudicate
Select Adjudicate to open the Adjudication screen.
4. Mark the response
You can review the two original responses including their original marks, comments, and annotations, unless you have only been assigned the Adjudication Blind role (for more information on adjudication roles, read Creating a role in SecureMarker).
You can view basic details about the selected response in the Adjudication screen:
- Exam – Displays the name of the exam.
- Item – Displays the name of the item.
- Response ID – Displays the response’s ID number.
You can also annotate and leave comments as part of your adjudication.
Downloading mark schemes
If a mark scheme has been attached to the item, you can download it while adjudicating scripts.
Select Download Mark Scheme to download a mark scheme attached to the item. Mark schemes are uploaded to items in Surpass. For more information, read Uploading a mark scheme to an item.
Viewing marking history
You can view a marking history for each response, unless you have only been assigned the Adjudication Blind role (for more information on adjudication roles, read Creating a role in SecureMarker). Details include the name of the examiner(s) who marked the response and the date(s) on which the response was marked.
Select View Marking History to view the item or item group’s marking history.
In the Marking History dialog, you can detailed information about the marking history of the item or item group.
Refer to the following table for information on each column in the grid.
| Column | Description |
|---|---|
| Date (Time) | Displays the date and time on which the item was last marked. |
| Name | Displays the name of the examiner. |
| Mark | Displays the mark awarded by the examiner out of the total available marks. |
| Type |
Displays the type of marking.
|
| Comment | Displays any comments added to the response by the examiner. |
Select Close to return to the Adjudication screen.
Viewing annotations and annotating responses
If annotation tools are set up on the parent test form in Surpass, you can mark up candidates’ scripts. For more information, read Configuring a test form for SecureMarker.
Select Annotations to view markers’ annotations and comments, and enable annotation tools.
Select Annotation Tools to open annotation tools.
The toolbar contains the following tools:
| Button | Description |
|---|---|
| Cursor | Allows you to select item content. Also allows you to move annotation components. |
| Highlight Line | Allows you to draw a semi-transparent horizontal line across response content. |
| Highlight Colour |
Allows you to change the colour of the highlight. |
| Tick |
Allows you to leave a stamped tick mark on the item content. |
| Symbols |
Allows you to place a stamped symbol on the item content. |
| Comments | Allows you to add a text box overlaying the item. |
| Eraser | Allows you to erase annotations. |
The toolbar can be dragged around the screen.
Viewing and adding comments
If annotation tools are set up on the parent test form in Surpass, you can view and add comments to candidate responses.
Adjudicating responses with Marked Learning Outcomes
If an item has Marked Learning Outcomes, a score must be added for each Learning Outcome in the Marking Panel.
Each Learning Outcome’s maximum mark is displayed next to the entry field. To change a given mark for a Learning Outcome, input a mark in the corresponding entry field.
The item’s mark is automatically calculated from the sum of all Learning Outcome scoring values. For more information about Marked Learning Outcomes, read ‘Setting up Marked Learning Outcomes’ in Using tags in items.
Assigning zero marked codes
If zero marked codes are enabled in Site Settings, a code can be assigned to a response awarded a mark of zero. For more information, read ‘About Zero Marked Codes’ in About Site Settings options.
Responses where one marker assigns a zero marked code and the other marker does not assign the same code are sent for adjudication.
Adjudicators can assign zero marked codes. Once you have assigned a mark of zero, the option to assign a zero marked code appears.
Select a zero marked code from the Code drop-down menu. Hover over the information icon to view the code’s reasoning, as configured by a user with the Manage Site Settings permission.
- If an item has Marked Learning Outcomes, a zero marked code can only be applied if each learning outcome is given no marks
- If an item has been configured for double marking and one marker assigns a zero marked code and the other marker does not assign the same code, the response is sent for adjudication
- Responses with a zero marked code assigned cannot be submitted as a control item
5. Submit marks
To assign a mark to a response, enter a value in the Mark field and select Submit. The adjudicated mark overrides the original mark, which is the aggregated mark between the two markers.
The next response to adjudicate automatically populates on the Adjudication screen.
Further reading
To learn more about marking and working in Adjudication, read the following articles:
Select Annotations to view markers’ annotations and comments, and enable annotation tools.
Select General Comments to open comments on markers’ responses and add your own comments during adjudication.