In a Standard Setting task, assignees rate items in an item list according to the Angoff rating method to help determine a cut score for your test. The Angoff rating method is designed to identify the proportion of minimally competent candidates.
This article explains how to create and assign Standard Setting tasks, including details about task navigation settings, initial and revised Angoff ratings, rating process settings, adding attachments, and managing tags.
In this article
1. Check task prerequisites
To create a Standard Setting task, you must have an item list containing the items to be rated and users with Standard Setting Assignee permissions at the level of the item list’s parent subject. To learn more, read Preparing for tasks.
2. Choose your task type
To create a task, select Create Task on the Tasks screen.
Select Standard Setting in the Create Task dialog.
Select Continue to confirm the task type.
3. Set task details
Fill in the following fields in the Task Details tab.
|Name*||The name of the task.|
|Reference*||An alphanumeric reference code used to identify your task. This must be unique.|
Information about the task. The Description field accepts a maximum of 4,000 characters.
|Start Date*||The day the task begins. This cannot be in the past.|
|End Date*||The day that the task finishes. You can extend this later if necessary. For more information, read Editing tasks.|
Select Continue to confirm these details.
4. Set task settings
Fill out the following details in Task Settings to customise the task.
|List to rate*||The item list that will be used in this task. Choose an item list in the menu to select it. You can also use the text search field to find a specific item list.|
|Parent Subject||The chosen item list’s parent subject. This field automatically updates based on the selected list.|
Choose how navigation between items works in this task. You have two options:
Select Browse to add up to 30 files to the task, such as reference materials for task assignees. The total file size limit is 600 MB. To delete an attachment, select Remove .
TIP: Surpass supports the following file types for task attachments: DOCX, DOC, XLSX, XLS, PPTX, PPT, MP4, MOV, MPG, MPEG, AVI, WMV, PDF, FLV, WAV, MP3, JPG, JPEG, GIF, BMP, PNG, SWF, TXT, and CSV.
Select Continue to confirm the task settings.
5. Rating Methods
Select a rating method from the Rating Methods drop-down menu. There is currently one rating method available: Angoff requires assignees to rate each item in the task out of 100.
You can select additional settings according to your chosen rating method.
|Present revised Angoff rating||
If you select the Angoff rating method, you can choose to enable a second rating input field for assignees. When assignees can enter a revised rating depends on your chosen task navigation:
If enabled, assignees can view tag collections in the task after they have entered their initial rating.
6. Manage tags
There are three ways you can control the tags that assignees can use during the task:
- Show all tags lets assignees edit all tag groups.
- Customise tags specifies which tag groups are available to assignees. Choose a tag category under Select tag category. Open Select tag groups to choose tag groups from the selected category. These tag groups are editable by assignees. The tag groups appear in the Selected tag groups tag. To remove a tag group, select Remove .
- Hide all tags stops assignees from editing tags when authoring items.
Select Continue to confirm the settings.
Managing tag collections
If the chosen item list’s items have tag collections, you can manage the tag collections that task assignees can view and edit during the Standard Setting task in the Tag Collections tab.
There are three ways to control the tag collections that assignees can use during the task:
- Show all tag collections lets assignees edit all tag collections.
- Customise tag collections specifies which tag collections are available to assignees.
- Hide all tag collections stops assignees from editing tag collections during the task.
Select the relevant option under Select tag collections for the task.
If you select Customise tag collections, choose a subject that contains your tag collection in the Select subject list. Use Select all to choose all available subjects or use the search bar to find specific subjects.
Choose a tag collection group from the Select tag collection group list.
Select Most Recent to choose from the latest n of tag collections created, up to 99 tag collections.
Select Individual to manually choose tag collections from a list of available tag collections. You can Select All tag collections. You can use the search bar to find specific tag collections.
Select Add to create additional tag collection rules, up to 10 rules.
To delete a tag collection rule, select Remove .
7. Choose your task assignees
Choose the users you want to assign to the task in Task Users > Assigned to. You can only select users associated with the parent subject that have the Standard Setting Assignee permission. Choose the relevant option for each user in the table.
|Assignee||The user(s) that will be given this task. You can assign a maximum of 100 users to a Standard Setting task.|
|Lead||The user(s) that will be acting as lead assignee(s) on this task. Lead assignees cannot give ratings, are not affected by the forward only task navigation setting, and can download a summary of the task.|
|Remove||Deletes the adjacent user from the task.|
8. Create your standard setting task
Select Create Task to finish creating the Standard Setting task.
Assignees can access the task on the Tasks screen after the start date set in Task Details.
For more information on Standard Setting tasks, and Tasks in general, read the following articles: