User Guide 3.1 | Open Assessment Technologies S.A.

User Guide 3.1

This is an older version of the TAO User Guide, click here for the documentation of the most recent release, TAO 3.3.

Item Scoring Rules

Test-takers who complete a Test will often ask, "What score did I get?" Scores are generated through performance in the various interactions that make up the Items, which themselves compose the Test. Interactions generate individual scores, which count towards the overall score of the Item, and all Item scores are tallied to produce the final Test result. Knowing how to set up scoring within an interaction is therefore useful in determining the Test-Taker's grade.

After you have created your Interaction, go to the Response window and follow the steps below to set up your chosen scoring method.

1. In the Response Properties panel on the right, locate the Response Processing pull-down choice box offering the two options: Match Correct and Map Response.

Match Correct: With this processing option, either the question is answered correctly or incorrectly. There is no partial credit, so if part of the response is incorrect, the whole answer is marked as incorrect.

Map Response: With this processing option, it is possible to give partial credit for a response. This is useful for questions where the answer is given in multiple parts. With the map response option, some parts of the answer can also be weighted more heavily than other parts if you consider them to be of higher importance.

2. Select the Response Processing type that is appropriate for the question.

This is going to depend to a large extent on preference, particularly with respect to partial credit.

If you select Match Correct, stop here - the scoring settings for this Interaction are complete.

3. If you select Map Response, review the responses in your Interaction, then determine and assign corresponding weights to each potential response.

Partial credit can be awarded here by assigning values in the weight boxes in order of importance in your Interaction canvas.

Note: For most interaction types, score boxes are located to the right of the potential responses.

4. Set the values of the Score Range fields, located in the Response Properties panel.

This is where you can specify the minimum and maximum number of points awarded for this interaction. Its use is optional.

The minimum score indicates the minimum number of responses the Test-taker is required to select for it to be a valid answer. If the interaction involves selecting more than one response, the maximum score should reflect the total of the weights for all correct responses, i.e. the maximum score possible for your Interaction. If only one response is expected, the maximum should equal that of the highest weight. Adjust these values as needed.

So if, for example, there are two correct responses in the question, and you have assigned a weight of 1 to one of them, and a weight of 2 to the other, the Test-taker would get a score of 3 if they are both correct (providing the maximum is set to 3 or above).

Other values in the Score Range field include Mapping Default, which contains the default value given if no specific scores are assigned to a response, and the check box used to Define Correct Response. The latter should be checked if there are specific correct responses, and left unchecked if the correctness of the answer is dependent on the sum of weights accumulated by the Test-taker in answering the interaction.

Lastly, it should be noted that TAO assigns a Response Identifier to each interaction response. It is best not to change this.

We use cookies on our website to support technical features that enhance your user experience. Cookie Policy Privacy Policy