Working in a Standard Setting task as an assignee

NOTE: Only users with the Standard Setting Assignee permission can work in Standard Setting tasks. For more information, read About task managers, assignees, and lead assignees.

Standard Setting tasks allow you to rate items in an item list. As an assignee, you can rate each item according to the Angoff rating method to help determine a cut score along with other assignees’ ratings. The Angoff rating method is designed to identify the proportion of minimally competent candidates.

This article explains how to work in a Standard Setting task as an assignee, including how to rate items.

In this article

1. Open the task

NOTE: If you have both Assignee and Manager permissions, select Own Tasks on the All Tasks / Own Tasks toggle to only see tasks that are assigned to you.

On the Tasks list, select the Standard Setting task you want to work on. The task details panel displays the task’s description, total item count, and days until the deadline. You can also download attachments if the task has any. For more information, read About the Tasks screen.

TIP: To find a specific task, you can search, order, and filter the Tasks list. For more information, read ‘Finding tasks’ in About the Tasks screen.

Select Open Task to open the Standard Setting screen and start working on the Standard Setting task. This changes the task’s status to In progress.

2. View your item

The Standard Setting screen contains all items in the associated item list. Items are displayed in the test driver, allowing you to see the items from a candidate’s perspective.

Use the item information panel to view the item’s correct answer, tags and tag collections.

Icon Setting Description
Item Settings View information about the item’s Correct Answer.
Item Tags View the item’s assigned tag groups and tag values. For more information, see Using tags in items.
Item Tag Collections

View the item’s assigned tag collections. For more information, read Using tag collections in items

IMPORTANT: If Present revised Angoff rating is enabled, you can only view tag collections after submitting your initial rating.

Select Undock to pop out the dialog windows for any information available in the panel. Select and drag the dialog window to move it around the screen.

This image has an empty alt attribute; its file name is image-528.png

Select Dock to return the dialog window to the right-hand side panel.

This image has an empty alt attribute; its file name is image-529.png

Select an item breadcrumb on the item navigation panel to go to another item.

Alternatively, you can enter a specific item number into the Go to item field to navigate directly to that item.

If an item is in an item set, you can enter a decimal (such as 1.3) in the Go to item field to navigate directly to that item.

IMPORTANT: If the task’s navigation setting is set to Forward only, you cannot navigate to the next item until you have rated the current item, and you cannot return to previously rated items. The Go to item field is also hidden.

You can also select Previous and Next to move through the item list.

Flagging items

You can flag items and leave a comment for lead assignees and task managers.

3. Rate your item

The Angoff rating method requires you to rate each item in the item list out of 100. Depending on the task’s navigation setting, you can either do this in any order or in a forward only manner.

Enter a rating between 1-100 in the Initial Angoff Rating field.

Select Submit Item to submit your rating.

WARNING: Once you submit an item, you can no longer edit your rating. Ensure you are happy with your rating before submitting an item.

Repeat the rating process until you have rated every item in the item list.

Giving revised Angoff ratings

If the Present revised Angoff rating setting is enabled, you must also enter a revised rating after submitting your initial rating.

4. Close the task

After rating all items, your Standard Setting task closes.

You can close the task manually at any time. There are two ways to close a Standard Setting task.

Select Close task to close the task and return to the Tasks screen.

Alternatively, you can select Return to Tasks screen .

5. Complete the task

Select Complete Task  in the task details panel once you have closed the task.

This changes the task’s status to Complete.

Marking a task as incomplete

You can mark a task as incomplete if you incorrectly select Complete Task or the task needs to be worked on again.