Reviewing marked responses in the Quotas screen
In SecureMarker, examiners cannot mark candidate responses unless they are assigned a quota for specified items. Quotas can either be unlimited or for a fixed number of responses. Examiners with unlimited quotas can mark responses freely until the response pool is empty. Examiners with fixed quotas can only mark the number of responses they have been assigned.
This article explains how to review marked responses in the Quotas screen of SecureMarker, including how to view the Mark Distribution Graph and how to discard marks assigned to responses.
In This Article
1. Go to the Quotas screen
To view the Quotas screen, select Quotas on the navigation bar.
2. Select a qualification and exam
3. Choose an item or examiner
In the Items grid, choose an item or item group containing marked responses to review.
In the Examiners grid, select an examiner to view their marked responses.
4. Select Review Marked Items
Select Review Marked Items in the Items grid to review marked responses for the selected item or item group. Select Review Marked Items in the Examiners grid to review a specific examiner’s marked responses.
5. Choose a marked response
Choose a marked response to review in the Marked Items screen.
About the Marked Items screen
The Marked Items screen displays all responses to the selected item. Details include the number of responses to an item, the user name of the examiner who marked the response, and the total number of marked responses.
The Marked Items screen displays the total number of responses for an item, the total number of marked responses, and the percentage of responses that have been marked for an item or item group.
Refer to the following table for more information about each column in the Items grid.
| Column | Description |
|---|---|
| Response ID | Displays the response’s unique ID code. |
| Item Name | Displays the name of the item or item group. |
| Marker | Displays the name of the user who marked the response. |
| Time Marked | Displays the date and time on which the response was marked. |
| Mark Awarded | Displays the total mark awarded to the response. |
You can navigate through pages of data using the Page menu. Use the Rows entry field to define how many rows are displayed in the Items grid. Select Refresh to update the number of rows.
Filtering marked responses in the Marked Items screen
Select the expander () on a column header to open a filter menu. Columns with filters applied are indicated by the filter icon: . You can combine filters across multiple columns.
For Response ID, Item Name, and Marker, select Ascending to filter the column content in ascending order (A-Z). Select Descending to filter the column content in descending order (Z-A). Use the text field to filter column contents based on a specified string. Select Clear to reset the filter.
For Time Marked, you can either select Today to only display responses that match the current date or use the date picker to choose a date range. Select Apply to save the filter. Select Filter off to reset the filter.
For Mark Awarded, you can either select Exact to display exact marks or use the From and to picker to choose a range of marks. Select Apply to save the filter. Select Filter off to reset the filter.
Select Clear Filters to reset all filters.
Exporting data to a spreadsheet
In the Items grid, select Download CSV to export the Items data to a spreadsheet.
About the Mark Distribution Graph
In the Marked Items screen, you can view statistical information about marked responses. This allows you to compare the distribution of marks awarded by a specific examiner with the overall distribution of marks for the selected response. You might want to monitor the mark distribution graph to determine if an examiner is marking too harshly.
Choose a response in the Items grid and select Mark Distribution Graph to view statistical information about the marking progress of the response.
In the Mark Distribution dialog, you can view the name of the item and the name of the examiner who marked responses for the item.
Refer to the following table for more information on the available data in the mark distribution graph.
| Field | Description |
|---|---|
| Overall > Responses marked |
Displays the number of overall responses marked for the item or item group. |
| Overall > Average mark | Displays the overall average mark awarded to a response for the item or item group. |
| Overall > Median mark | Displays the middle mark awarded to a response when arranged in ascending order. |
| Overall > Mode mark | Displays the most commonly awarded mark for the item or item group. |
| Overall > Mark standard deviation | Displays the number used to determine how far marks are spread out from the average mark. A low standard deviation means that most of the numbers are close to the average. A high standard deviation means that the numbers are more spread out. |
| Overall > Mark variance | Displays the mark variance. A high variance indicates that marks are very spread out from the average mark. |
| Marker > Responses marked | Displays the number of responses marked by the examiner. |
| Marker > Average mark | Displays the average mark awarded to a response by the examiner. |
| Marker > Median mark | Displays the middle mark awarded to a response when arranged in ascending order. |
| Marker > Mode mark | Displays the mark most often awarded to responses by the examiner. |
| Marker > Mark standard deviation | Displays the number used to determine how far marks are spread out from the average mark. A low standard deviation means that most of the numbers are close to the average. A high standard deviation means that the numbers are more spread out. |
| Marker > Mark variance | Displays the mark variance. A high variance indicates that marks are very spread out from the average mark. |
6. Select View Item
Select View Item in the Marked Items screen to review the marked response.
7. Review the marked response
The Review Marked Items screen displays the marked response. In this screen, you can review all marked responses for the item and view the mark awarded to each response.
Select Previous and Next to navigate each response for the item.
Select General Comments to view comments added to the response by the examiner.
Downloading mark schemes
You can download mark schemes attached to items in the Review Marked Items screen.
Select Download Mark Scheme to download a mark scheme attached to the item. Mark schemes are uploaded to items in Surpass. For more information, read Uploading a mark scheme to an item.
Submitting a marked response as a control item
If the response has been marked to an acceptable standard, you can submit the response as a control item in the Review Marked Items screen.
Select Submit as CI to submit the marked response as a control item.
If Examiner Feedback is enabled, you must enter a reason for submitting the response as a control item. Select Submit as CI to submit the response. For more information, read ‘Adding examiner feedback’ in Creating control items in SecureMarker.
The proposed control item appears in CIs Waiting for Review in the Quality Control. For more information, read Reviewing control items in SecureMarker.
Discarding marks
You might want to discard marks assigned to a response if it has been marked incorrectly. You can discard marks in the Review Marked Items screen.
Select Discard Mark to return the response to the quota of items waiting to be assigned to an examiner. For more information, read Setting quotas for examiners in SecureMarker.
In the Discard Mark dialog, select Discard Mark to save your changes.
Further reading
To learn more about working in Quotas, read the following articles: