Scoring assessments manually (TAO Ignite)
Once test takers complete an assessment, scorers will be able to view and score items for manual scoring from the session overview page. If a session contains items that require manual scoring, the Score action in the session overview page triggers the grading process.
For more information on configuring manual scoring, Creating items with manual scoring (TAO Ignite).
To find a specific session, use the search bar in the top-left corner of the Sessions management interface in the TAO Portal. You can search for sessions by name or group.
1. Select Enter session on the right side of the session you want to view.
Below the session details (see Entering a session's overview page) , a table displays the following information for all test takers assigned to the session:
Name: The name of a test taker.
Session status: Displays which stage of the session a test taker is currently in (Not started, In progress, Finished).
Scoring status: Displays whether a test taker’s assessment has been graded. This field will be blank if the test taker has not started the assessment. If it is in progress, it will display Awaiting submission (or Processing Submission while the platform processes a submitted session). If it has been completed by the test taker and requires manual scoring (but is not yet scored), it will display Scoring needed. If it has been completed and graded, it will display Scored.
For manual scoring scoring to become an available option, a test taker’s session status must be Finished.
The list can be ordered by Name, Session status, or Scoring status.
The search box at top-left of the table can be used to search the list by Name.
2. Select a test taker.
The following actions are available for Admins, Group Managers and Scorers once a test taker has completed the assessment:
Score: This option will display if manual scoring is required (see step 3 for more details).
Report: This option allows proctors to view the session report for an individual test taker. For more information, see Viewing a test taker's report.
Review test: Allows administrators to view the test taker’s responses, the defined correct responses, and the score for that test-taker.
Exempt: Select the ellipses button for a particular test taker to exempt them from the assessment. This option is only available to Admins and Group Managers.
3. Select Score to begin grading the test taker’s assessment.
Use the arrows to navigate to view each interaction in the assessment that requires manual scoring.
In the panel on the left side of the interface, the scorer will see the outcome declaration(s) defined for each interaction, along with the score range defined for each outcome declaration. Select the score earned to grade each interaction. For more information on outcome declarations, see Creating items with manual scoring (TAO Ignite).
Select the pencil icon in the top right corner to view and use the highlighter tool. The highlighter tool allows scorers to highlight areas in the test-taker’s response to help them identify information that contributes to the final score of the interaction. For instance, they can highlight all the grammatical errors so that they can easily compute a score for grammar. Highlighters are only visible to the scorer.
Leaving feedback
Scorers may leave a direct comment to a test taker’s response by selecting text from the response and clicking Write Feedback → Save. Test takers will be able to view this feedback when reviewing the test in Finished Sessions. For more information, see the following topics:
4. Select SEE OVERVIEW to view the test overview page.
From the test overview page, you can view each interaction’s score, bookmark interactions to return to later, and add notes on an interaction.
Select the Test overview downward arrow to return to the grading page.
4. Once you have completed grading (see percentage bar in the bottom-left corner), select SEND SCORES.
A prompt appears to inform the grader that all scores will be final. Select SUBMIT THE SCORES to finalize the grading process for the assessment.
The test taker’s Scoring Status will appear as Scored in the session overview page. Select Review to view each question and it’s final score.