Related articles
Applies to
-
Administrators
Prerequisites
-
Access to the Data Explorer feature in TAO Portal.
-
Knowledge of the Datastore Item Results entity.
Purpose
This document provides a practical guide to the DatastoreItemResults datastore in Data Explorer. This entity supports post-exam test taker analysis. Its purpose is to help to understand what type of evidence each datastore contains and how that information can be used to reconstruct a test taker’s behavior during an exam session.
The guide focuses on the most relevant fields for analyzing progress, interactions, responses, technical issues and proctoring-related incidents.
How to access the data
-
Open Data Explorer module.
-
In the ‘Data Setup: Configure or Load’ dropdown list, select Datastore Item Results.
-
In the ‘Filters’ tab, filter by the test taker ‘login’ field or by ‘deliveryExecution Id’ (represents the concrete exam session for a test taker in a given delivery).
-
Click Generate
Most relevant fields and descriptions
This section explains what data can be consulted and extracted from Datastore Item Results in Data Explorer.
The datastore stores the evaluated result of an item, together with delivery, response, score, timing, session and metadata context.
At a high level, Item Results stores:
-
the identity of the delivery execution and the item,
-
the response(s) submitted for that item,
-
the raw response(s) and raw outcome(s) produced by the engine,
-
the interpreted score and correctness / pass information,
-
timing information such as start time, end time, duration, and submission time,
-
session and metadata context,
-
LTI launch context when available.
Here below the most relevant fields:
|
Event metadata field |
Description |
Data example |
|
|
The position of the item in the test. |
|
|
|
The interpreted completion status of the item result. |
|
|
|
The unique identifier of the delivery execution, meaning the specific session for a given test taker and delivery combination. |
|
|
|
Delivery identifier (represents the test) in which the item result was produced. |
|
|
|
The duration value reflects the total time a test taker spent on a given item. For non-linear tests, the duration is cumulative and includes time spent on the item in secondary attempts. |
|
|
|
Indicates whether the item was evaluated as correct. |
|
|
|
The exact time the item was completed or submitted by the test taker in linear tests, or last interacted with in non-linear tests. |
|
|
|
The identifier of the item for which this result row was created. |
|
|
|
The exact time the test taker opened the item in the test for the first time. |
|
|
|
The time at which the item result record was last updated in persistence. |
|
|
|
The locale or language context associated with the result row. |
|
|
|
The login or user identifier associated with the test taker. |
|
|
|
Indicates whether the item result was manually graded. |
|
|
|
The maximum possible score for the item. |
|
|
|
The identifier of the technical message or transaction associated with the result creation or update. |
|
|
|
The alias of a metadata property linked to the item. This is usually a reporting-friendly key. |
|
|
|
The display label of a metadata property linked to the item. |
|
|
|
The display value of a metadata property linked to the item. |
|
|
|
How many times the item was seen or attempted by the test taker. |
|
|
|
The MAXSCORE outcome extracted in flattened form. |
|
|
|
The SCORE outcome extracted in flattened form. |
|
|
|
The QTI identifier of the item. |
|
|
|
The QTI label of the item. |
|
|
|
The correctness value associated with that response entry. |
|
|
|
The submitted raw value for that response entry. |
|
|
|
The score achieved by the test taker for the particular item. |
|
|
|
The time at which the session ended. |
|
|
|
The display name of the session. |
|
|
|
The time at which the session started. |
|
|
|
The state of the item result record. |
|
|
|
Whether the item’s score was correct, false, partially correct, or skipped. |
|
|
|
The exact time the answer to the item’s question was submitted. The time at which the item result was submitted. |
|
|
|
The identifier of the tenant in which the result was stored. |
|
|
|
The total maximum score possible in the test. |
|
|
|
The total score achieved by the test taker in the test. |
|