Creating a Multiple Response question

NOTE: Multiple Response questions can be used in standard tests, legacy tests, and the Surpass (Legacy) tablet app. For more information about delivery types, read About Surpass test delivery options.

A Multiple Response question offers candidates a set of possible answers to a question. The options contain correct answers and plausible but incorrect answers (also known as distractors). Candidates can select multiple answer options as their response.

This article explains how to create a basic Multiple Response question in Surpass and includes details on how to add rationale and labels to answer options, set minimum and maximum candidate selections, and use table answers in HTML subjects.

In This Article

1. Choose your item type

In your subject, select Create New Item to open the Question Types menu. Choose Multiple Response to create a blank Multiple Response item and go to the Edit screen.

2. Name your item

Enter the item’s name in the Name field.

An item's Name field filled with 'Sample Item Name'.

3. Enter your question text

NOTE: Question stem tables and the formatting toolbar behave differently in Mixed subjects and HTML subjects. For more information, read Creating tables in items and Using the formatting toolbar.

Enter your question text in the question stem. Select Add Text Area to add an additional question stem. You can have a maximum of five question stems per item.

Open Additional Options  to add source material or assistive media to your question stem. In mixed subjects, you can also add a table to your question stem (in HTML subjects, tables can be added using the formatting toolbar).

4. Add your answer options

Enter your answer options in the answer fields. Multiple Response items default to three answer options. Select Add Answer Option to add an additional answer option. You can have a maximum of 30 answer options per Multiple Response item. Select Delete to remove an answer option. Multiple Response items must have a minimum of three answer options.

Adding labels to answer options

You can add short labels to your answer options, like ‘A’, ‘B’, ‘C’ or ‘1’, ‘2’, ‘3’.

Adding an exclusive answer option

You can add an exclusive answer option to a Multiple Response item that candidates cannot select in combination with any other answer options.

EXAMPLE: Exclusive answer options might be used for an ‘all of the above’ or ‘none of the above’ style answer option.

Adding answer option rationale

The Rationale fields let you leave a comment against each answer option. This is useful if multiple authors are working on the same item and you want to explain the reasons behind your authoring choices.

Re-ordering answer options (random, alphabetical, manual)

By default, Surpass presents Multiple Response answer options to candidates in a randomised order. If answer options are not set to be randomised, they are delivered to the candidate in the same order they are seen in the Edit screen. You can also order answer options alphabetically, or manually re-order your answer options on an option-by-option basis.

Setting the number of candidate selections

You can set the maximum number of selections a candidate can make in a Multiple Response items. This prevents candidates from selecting all available answers. For items delivered in HTML tests, you can also set the minimum number of responses a candidate must make before the item is considered attempted.

Using answer layout options

Multiple Response answer options can be presented in either one or two columns. In a two column layout, you can combine text, image, and/or equation content in a single answer option.

Setting answer options as a table (HTML subjects only)

You can set HTML-subject Multiple Response answer options to be a table. This lets candidates choose their response from a predefined set of related answer options.

5. Set the correct answers and marks

NOTE: This only applies to computer-marked Multiple Response items. For more information about human marking, read Setting the marking type.

You can choose between three marking modes for Multiple Response items: standard, weighted, and combination marking.

Using standard marking

In a Multiple Response item with standard marking, each correct answer gives the candidate a percentage of the item’s total mark.

EXAMPLE: If an item has two correct answers and a total mark of ten, each correct answer gives the candidate five marks.

Using weighted marking

In a Multiple Response item with weighted marking, each answer option has its own marking value.

EXAMPLE: One candidate may choose answers worth two and three marks for a total of five marks. Another candidate may choose answers worth one and five marks for a total of six marks.

Using combination marking

In a Multiple Response item with combination marking, each combination of answers has its own marking value..

EXAMPLE: Answers A and B may be worth five marks, A and C may be worth seven marks, and B and C may be worth ten marks. In this example, candidates would not get credit for selecting A, B, or C on their own or A, B, and C together.

6. Select a workflow status

Set the item’s workflow status in the Status drop-down menu. Only items set to Live can be used in a test.

An item's workflow status being set to Live.

7. Preview your question

WARNING: Flash is no longer supported by web browsers. Use the Surpass Viewer to preview items in the legacy test driver. For more information, read Installing the Surpass Viewer.

To see your item from a candidate’s perspective, select Preview .

In Mixed subjects, you can preview your item in the HTML test driver. Use the Preview arrow to open the Preview Options menu and select Preview in HTML . Any custom CSS is applied in the Preview screen. For more information on custom CSS, read ‘About Subject settings’ in About Site Settings options.

You can check your item’s marking behaviour in the Preview screen. Select answer options to update the Mark field.

If you need to continue working on the item, select Edit to return to the Edit screen.

8. Saving and closing your item

Select Save to save your item to your subject.

To see additional saving options, use the Save arrow to open the Save Options menu. Select Save & Close to save the item and return to the Subjects screen. Select Save & New to save the item and create another Multiple Response item.

WARNING: Saving changes to live items included in scheduled tests might affect candidate delivery.

Select Close to leave the Edit screen. If you have unsaved changes, you are prompted to either save or discard them.