Adaptive testing options

The Path and Prerequisite editors in test Part properties allow test authors to create multi-stage adaptive tests using scoring-based rules between test parts.

Multi-stage adaptive testing (MSAT) is a test design where test-takers are routed through pre-assembled groups of items (in this case, test Parts) based on their performance/score of the first Part of the test they complete, rather than receiving subsequent test parts one-by-one.

The Path and Prerequisite editors can work in tandem but one is not required for the other to function.

1. Configure the test’s scoring properties.

The Test level properties icon can be found in the Test bar at the top of the canvas. Click on the dropdown Scoring.

In Outcome processing, select either Total Score or Cut Score. In the graphic below, Total Score is selected, as well as the box for Category score.

2. Click on the Test Part level properties icon.

Test part level properties icons can be found in each grey Test part bar when authoring a test.

Multi-stage adaptive testing is only available for tests with three or more test Parts.

Configure the areas of the Part (described in Test Part settings) as needed.

Categories

It is recommended to add a Category for each test Part (and checking the Category score box in test Scoring). This helps differentiate each test Part for precision when configuring paths and prerequisites.

In the graphics for this article, each Part in the demo test has a category that correlates to it’s number in the test’s sequence (part1, part2, etc).

3. Select the Path editor.

The Path editor allows you to set conditions where, depending on the test-taker’s performance in the Part being edited, redirects the test taker to a different test Part.

1. Click Add a Path.

2. Under Target, select the test Part the test taker will be redirected to if the conditions are met. Choose Test End to exit test takers from the test if the conditions are met.
   In this example,

3. Under Variable, select the score variable that will be used to determine the conditions. This element should be configured to reflect how the test taker performed in the initial test Part. The options are:

   • Score total: The total number of points achieved in the test Part.

   • Score total max: Use this option if the test taker needs to achieve the test Part’s maximum amount of points to be redirected to the target.

   • Score ratio: What percentage the test taker achieved (how many points achieved out of the maximum available).

   • Category score: If categories are set for items in the first test Part, and you want to redirect the test taker depending on how they performed in that specific category, use this option.

4. In the Op. (operator) box, select an option. The operator calculates whether the test taker achieved the conditions; for example, if a test taker needs to achieve less than the amount of points designated in the Value field, select <.

5. In the Value box, enter the number of points or the ratio the test taker needs to achieve to be redirected to the target.

Repeat this process if multiple paths are needed.

For this example, if the test taker scores less than 3 points in test Part 1, they will be redirected directly to test part 3.

4. Select the Prerequisite editor.

The Prerequisite editor allows you to set conditions for a specific test Part, so that the Part is only shown to test takers who meet those conditions. This is to prevent test takers from viewing a test Part if they do not meet the conditions set in the Prerequisite editor.

This is especially useful for tests with several test Parts (more than 3). For example, if a test taker is redirected to part 3 from part 1 (due to Path configuration), they will continue the subsequent test Parts in order. If that test taker should not view any of those subsequent test Parts, you can set a Prerequisite for that test Part rather than configuring another Path.

1. Click Add a Prerequisite.

2. Under Variable, select the score variable that will be used to determine the prerequisite. This element should be configured to reflect how the test taker performed in the selected test Part (typically a test Part that would be presented before the test Part being configured). The options are:

   • Score total: The total number of points achieved in the selected test Part.

   • Score total max: Use this option if the test taker needs to achieve the selected test Part’s maximum amount of points to view the current test Part.

   • Score ratio: What percentage the test taker achieved (how many points achieved out of the maximum available) in the selected test Part.

   • Category score: If categories are set for items in the first test Part, and you want to redirect the test taker depending on how they performed in that specific category, use this option.

3. In the Op. (operator) box, select an option. The operator calculates whether the test taker achieved the prerequisite; for example, if a test taker needs to more points than the amount designated in the Value field, select >.

Repeat this process if multiple paths are needed.

In the graphic below, the test taker will not be directed to test part 2 if their score in test part 1 is greater than or equal to 3.