Standard Setting tasks allow you to rate items in an item list. As an assignee, you can rate each item according to the Angoff rating method to help determine a cut score along with other assignees’ ratings. The Angoff rating method is designed to identify the proportion of minimally competent candidates.
This article explains how to work in a Standard Setting task as an assignee, including how to rate items.
In this article
1. Open the task
On the Tasks list, select the Standard Setting task you want to work on. The task details panel displays the task’s description, total item count, and days until the deadline. You can also download attachments if the task has any. For more information, read About the Tasks screen.
Select Open Task to open the Standard Setting screen and start working on the Standard Setting task. This changes the task’s status to In progress.
2. View your item
The Standard Setting screen contains all items in the associated item list. Items are displayed in the test driver, allowing you to see the items from a candidate’s perspective.
|Item Settings||View information about the item’s Correct Answer.|
|Item Tags||View the item’s assigned tag groups and tag values. For more information, see Using tags in items.|
|Item Tag Collections||
View the item’s assigned tag collections. For more information, read Using tag collections in items.
IMPORTANT: If Present revised Angoff rating is enabled, you can only view tag collections after submitting your initial rating.
Select Undock to pop out the dialog windows for any information available in the panel. Select and drag the dialog window to move it around the screen.
Select Dock to return the dialog window to the right-hand side panel.
Select an item breadcrumb on the item navigation panel to go to another item.
Alternatively, you can enter a specific item number into the Go to item field to navigate directly to that item.
If an item is in an item set, you can enter a decimal (such as 1.3) in the Go to item field to navigate directly to that item.
You can also select Previous and Next to move through the item list.
Select Flag when previewing an item to flag and leave a comment.
Input your comment and then select Confirm.
Flagged items are indicated by a flag () in the item navigation panel.
To remove a flag, select Unflag .
3. Rate your item
The Angoff rating method requires you to rate each item in the item list out of 100. Depending on the task’s navigation setting, you can either do this in any order or in a forward only manner.
Enter a rating between 1-100 in the Initial Angoff Rating field.
Select Submit Item to submit your rating.
Repeat the rating process until you have rated every item in the item list.
Giving revised Angoff ratings
If the Present revised Angoff rating setting is enabled, you must also enter a revised rating after submitting your initial rating.
4. Close the task
After rating all items, your Standard Setting task closes.
You can close the task manually at any time. There are two ways to close a Standard Setting task.
Select Close task to close the task and return to the Tasks screen.
Alternatively, you can select Return to Tasks screen .
5. Complete the task
Select Complete Task in the task details panel once you have closed the task.
This changes the task’s status to Complete.
Marking a task as incomplete
You can mark a task as incomplete if you incorrectly select Complete Task or the task needs to be worked on again.
By default, completed tasks are not shown in the Tasks list. To display completed tasks on the Tasks list, open Filter and select Show Completed.
Find and select your completed task. Select Mark as incomplete to mark the task as incomplete. The task’s status reverts to In progress.
For more information on Standard Setting tasks, or working in other task types as an assignee, read the following articles:
- About task types
- About the Tasks screen
- About task managers, assignees, and lead assignees
- Working in an Authoring task as an assignee
- Working in an Individual Review task as an assignee
- Working in a Shared Review task as an assignee
- Working in an Item Analysis Review task as an assignee
- Working in a General task as an assignee