Datastore Delivery Results

This topic lists API and Data Explorer fields (and their descriptions) associated with a delivery ID and it’s results. The entities described in this topic are considered to be the most meaningful when performing a query of a delivery’s data - not all entities returned with a query are listed.

API: “Data” will be listed out for each test taker’s attempt at the delivery’s test. If the same delivery is assigned to more than one session (for the same test taker), the test taker’s attempts will be recorded as a separate data set with different a deliveryExecutionId (see below) per attempt.

CSV notes that this field is present when exporting session results in a CSV file. For more information, see Exporting and interpreting CSV session results .

Session level data

`isDeleted`

The value of this API field is always set to false, as only the most recent delivery results currently display.

If the same delivery has been taken multiple times by the test taker, previous results are marked as isDeleted=true.

This field is only valid if you are launching the delivery via LTI with multiple attempts parameter. For more information, see Custom parameters (delivery launch).

Identification

Data Explorer	API	Description
Test Qti Id	`testQtiId`	The Identifier for the test, which can be viewed and changed from the general properties panel in test authoring.
Test Qti Label	`testQtiLabel`	The label provided for a test in the Test properties form.
Full Test Resource Id	`fullTestResourceId`	The Resource Identifier located in the delivery’s Properties panel.
Login	`login`	CSV The test taker’s ID/username (not name).
Test Qti Title	`testQtiTitle`	The Title of the test, which can be viewed and changed from the general properties panel in test authoring.
Delivery Id	`deliveryId`	The delivery ID of the test.
Delivery Execution Id	`deliveryExecutionId`	Unique identifier for the delivery execution (the session for a given test taker/delivery combination).

Metadata

Data Explorer

API

Description

Metadata

Metadata. Label

CODE

metadata: {
label: }

Any metadata properties defined for the test will be listed with the property's name and the value assigned to the test. This field contains the same information of metadataRaw but with flat structure.

label: The name of the test, which can be found in the Label field in Test Properties.

metadataRaw

This field lists the raw, unprocessed set of metadata associated with the delivery’s items. These fields are used to provide additional context to the results of the query.

Timestamps

Data Explorer	API	Description
Publication Time	`publicationTime`	The exact time the delivery was published (provided as a unix timestamp).
Session Start Time	`sessionStartTime`	CSV The exact time the test was started by the test taker (provided as a unix timestamp).
Session End Time	`sessionEndTime`	CSV The time that the test was submitted (provided as a unix timestamp). This will typically be the same value as `submissionTime`.
Duration	`duration`	How long it took the test taker to complete the test (in seconds). The value of this field should equal the `duration` value(s) of each individual item added together.
Submission Time	`submissionTime`	The exact time the test taker submitted the test (provided as a unix timestamp). This will typically be the same time as `sessionEndTime`.
Last_update_date	`lastUpdateDate`	The date the session was last updated (provided as a unix timestamp). For tests with manual scoring, this value will display the time at which scoring was completed. Until all manual scoring is performed (if any), the value of this field should be the same as the `sessionEndTime`.

Scoring


Cut Score Ratio	`cutScoreRatio`	If a cut score is configured for the test, the percentage of the cut score (a cut-off point for passing the test) achieved by the test taker’s score will display. This percentage is displayed as a decimal value. If no cut score is defined for the test, the value of this field will be `null`. For more information, see Configuring scoring for tests.
	`outcomes`	CSV Any scoring outcome defined on the test level (in Test authoring) will be listed here. For more information, see Configuring scoring for tests. `SCORE_TOTAL_MAX`: The maximum score defined for the test. `SCORE_RATIO`: The total score achieved by the test taker divided by the maximum possible score). This value should be a decimal number between 0 and 1. `SCORE_TOTAL`: Total score from the given test taker for the test.
Score	`score`	CSV The amount of points achieved by the test taker, if defined by the test scoring. The value of this field should match the value of `SCORE_TOTAL` in `outcomes`.
Max Score	`maxScore`	CSV The maximum possible score for a delivery (test). The value of this field should match the value of `SCORE_TOTAL_MAX` in `outcomes`.

Item level data

These fields record each item in the test individually with details about the item, and how the test taker responded to it in the test.

Data Explorer	API	Description
Item Id	Listed first after CODE `items: { }`	Each item’s reference ID, which can be found in the item’s general properties in Test authoring.
Num Attempts	`numAttempts`	How many times the item was seen (or attempted) by the test taker. Only the last attempt’s results are displayed and taken into account for the item’s scoring.
	`metadata`	The metadata defined for an individual item `label`: The label of the item in the Item properties (in the Edit Item form). Metadata properties (`propertyLabel`), such as subject matter, are listed here with each property name and the value assigned to the given item.
Full Item Resource Id	`fullItemResourceId`	The item’s Identifier, which can be found in the Item Properties (in Item authoring).
Status Correct	`statusCorrect`	CSV Whether the item’s score was correct, false, partially correct, or skipped.
Qti Title	`qtiTitle`	CSV The title of the item in the Item Properties (in Item authoring).
Max Score	`maxScore`	The maximum score available for the item.
Submission Time	`submissionTime`	The exact time the answer to the item’s question was submitted. This time is provided as a unix timestamp.
Qti Id	`qtiId`	The Identifier, which can be viewed and modified in the Item’s Properties (in item authoring).
Qti Label	`qtiLabel`	CSV The label of the item in the Item properties (in the Edit Item form).
Duration	`duration`	CSV The duration value reflects the time (in seconds) a test taker spent on a given item. The duration value excludes the time the item took to load and become available, as well as any time a test taker had their session paused.
Score	`score`	The score achieved by the test taker for the particular item.
Item End Time	`itemEndTime`	The exact time the item was completed/submitted by the test taker (for linear tests) or last interacted with (for non-linear tests). This time is provided as a unix timestamp.
Item Start Time	`itemStartTime`	The exact time the test taker opened the item in the test for the first time. This value is provided as a unix timestamp.
Completion Status	CODE `outcomes: { SCORE: MAXSCORE: completionStatus: }`	CSV In API results, all outcomes defined on the item will be listed here (especially the ones defined for manual scoring). Completion Status: The completion status of the item. The possible values are `incomplete`, `not_attempted`, `unknown`, or `completed`. `not_attempted` means the item was seen but no response was given. `completed` means the item was seen and a response was given. `unknown` and `incomplete` display when an item was not seen by the test taker. In API results, SCORE AND MAXSCORE will display repeated values.
	`responses`	CSV `RESPONSE_x` : This value is the response identifier of all the interactions defined in the current item. It is editable from the item authoring screen. If you have multiple interactions in an item, you will have multiple entries here. `correct`: Whether or not the test taker’s answer was correct. `value`: The value provided by the test taker for the interaction. For information on the format of the `baseType` value as an interaction response, see the table below.
Manually Graded	`manuallyGraded`	Displays if a manually scored item has been scored or not. This value will display as `true` if the item has been scored, and `false` if it is awaiting scoring.
Manually Graded At	`manuallyGradedAt`	The time an item was manually graded (if applicable). This value is provided as a unix timestamp. It will display as `null` if the item is awaiting scoring.
	`hasFileUpload`	When set to true, this field indicates the item has an upload in one of the responses.

Reference: Serialization for item responses

This table summarizes how QTI baseTypes are serialized depending on their cardinality at export time.

BaseType	Cardinality	Serialized Example
identifier	single	`single-identifier`
identifier	multiple	`['multiple-identifier1'; 'multiple-identifier2'; 'multiple-identifier3']`
identifier	ordered	`<'ordered-identifier1'; 'ordered-identifier2'; 'ordered-identifier3'>`
boolean	single	`true`
boolean	multiple	`[true; false; true]`
boolean	ordered	`<true; false; true>`
integer	single	`0`
integer	multiple	`[1; 2; 3]`
integer	ordered	`<4; 5; 6>`
float	single	`0`
float	multiple	`[1.1; 2.2; 3.3]`
float	ordered	`<4.4; 5.5; 6.6>`
string	single	`string1`
string	multiple	`['string2'; 'string3'; 'string4']`
string	ordered	`<'string5'; 'string6'; 'string7'>`
point	single	`0 1`
point	multiple	`[2 3; 4 5; 6 7]`
point	ordered	`<8 9; 10 11; 12 13>`
pair	single	`pair1 pair2`
pair	multiple	`[pair3 pair4; pair5 pair6; pair7 pair8]`
pair	ordered	`<pair9 pair10; pair11 pair12; pair13 pair14>`
uri	single	`https://www.mywebsite1.com`
uri	multiple	`['https://www.mywebsite1.com'; 'https://www.mywebsite2.com'; 'https://www.mywebsite3.com']`
uri	ordered	`<'https://www.mywebsite4.com'; 'https://www.mywebsite5.com'; 'https://www.mywebsite6.com'>`
directedPair	single	`pair1 pair2`
directedPair	multiple	`[pair3 pair4; pair5 pair6; pair7 pair8]`
directedPair	ordered	`<pair9 pair10; pair11 pair12; pair13 pair14>`
duration	single	`PT0S`
duration	multiple	`[PT1S; PT2S; PT3S]`
duration	ordered	`<PT4S; PT5S; PT6S>`
record	N/A	`{'identifier1'; false; 999; 9.99; 'string1'; 1 2; identifier1 identifier2; 'https://www.my-website.com'; identifier1 identifier2; PT0S}`