Working in a Standard Setting task as an assignee

Standard Setting tasks allow you to rate items in an item list. As an assignee, you can rate each item according to the Angoff rating method to help determine a cut score along with other assignees’ ratings. The Angoff rating method is designed to identify the proportion of minimally competent candidates.

This article explains how to work in a Standard Setting task as an assignee, including how to rate items.

In this article

1. Open the task

On the Tasks list, select the Standard Setting task you want to work on. The task details panel displays the task’s description, total item count, and days until the deadline. You can also download attachments if the task has any. For more information, read About the Tasks screen.

Select Open Task to open the Standard Setting screen and start working on the Standard Setting task. This changes the task’s status to In progress.

2. View your item

The Standard Setting screen contains all items in the associated item list. Items are displayed in the test driver, allowing you to see the items from a candidate’s perspective.

Use the item information panel to view the item’s correct answer, tags and tag collections.

Icon	Setting	Description
	Item Settings	View information about the item’s Correct Answer.
	Item Tags	View the item’s assigned tag groups and tag values. For more information, see Using tags in items.
	Item Tag Collections	View the item’s assigned tag collections. For more information, read Using tag collections in items.  IMPORTANT: If Present revised Angoff rating is enabled, you can only view tag collections after submitting your initial rating.

Select Undock to pop out the dialog windows for any information available in the panel. Select and drag the dialog window to move it around the screen.

Select Dock to return the dialog window to the right-hand side panel.

Select an item breadcrumb on the item navigation panel to go to another item.

Alternatively, you can enter a specific item number into the Go to item field to navigate directly to that item.

If an item is in an item set, you can enter a decimal (such as 1.3) in the Go to item field to navigate directly to that item.

You can also select Previous and Next to move through the item list.

Flagging items

You can flag items and leave a comment for lead assignees and task managers.

3. Rate your item

The Angoff rating method requires you to rate each item in the item list out of 100. Depending on the task’s navigation setting, you can either do this in any order or in a forward only manner.

Enter a rating between 1-100 in the Initial Angoff Rating field.

Select Submit Item to submit your rating.

Repeat the rating process until you have rated every item in the item list.

Giving revised Angoff ratings

If the Present revised Angoff rating setting is enabled, you must also enter a revised rating after submitting your initial rating.

4. Close the task

After rating all items, your Standard Setting task closes.

You can close the task manually at any time. Select Return to Tasks to close the task and return to the Tasks screen.

5. Complete the task

Select Complete Task  in the task details panel once you have closed the task.

This changes the task’s status to Complete.

Marking a task as incomplete

You can mark a task as incomplete if you incorrectly select Complete Task or the task needs to be worked on again.