Skip to main content
Skip table of contents

Datastore Delivery Results

This topic lists API and Data Explorer fields (and their descriptions) associated with a delivery ID and it’s results. The entities described in this topic are considered to be the most meaningful when performing a query of a delivery’s data - not all entities returned with a query are listed.

API: “Data” will be listed out for each test taker’s attempt at the delivery’s test. If the same delivery is assigned to more than one session (for the same test taker), the test taker’s attempts will be recorded as a separate data set with different a deliveryExecutionId (see below) per attempt. 

CSV notes that this field is present when exporting session results in a CSV file. For more information, see Exporting and interpreting CSV session results .

Session level data

isDeleted

The value of this API field is always set to false, as only the most recent delivery results currently display.

If the same delivery has been taken multiple times by the test taker, previous results are marked as isDeleted=true.

This field is only valid if you are launching the delivery via LTI with multiple attempts parameter. For more information, see Custom parameters (delivery launch).

Identification

Data Explorer

API

Description

Test Qti Id

testQtiId

The Identifier for the test, which can be viewed and changed from the general properties panel in test authoring. 

Test Qti Label

testQtiLabel

The label provided for a test in the Test properties form. 

Full Test Resource Id

fullTestResourceId

The Resource Identifier located in the delivery’s Properties panel.

Login

login

CSV

The test taker’s ID/username (not name).

Test Qti Title

testQtiTitle

The Title of the test, which can be viewed and changed from the general properties panel in test authoring.

Delivery Id

deliveryId

The delivery ID of the test.

Delivery Execution Id

deliveryExecutionId

Unique identifier for the delivery execution (the session for a given test taker/delivery combination).

Metadata

Data Explorer

API

Description

Metadata

Metadata. Label

CODE
metadata: {
label: }

Any metadata properties defined for the test will be listed with the property's name and the value assigned to the test. This field contains the same information of metadataRaw but with flat structure.

  • label: The name of the test, which can be found in the Label field in Test Properties.

metadataRaw

This field lists the raw, unprocessed set of metadata associated with the delivery’s items. These fields are used to provide additional context to the results of the query.

Timestamps

Data Explorer

API

Description

Publication Time

publicationTime

The exact time the delivery was published (provided as a unix timestamp). 

Session Start Time

sessionStartTime

CSV

The exact time the test was started by the test taker (provided as a unix timestamp). 

Session End Time

sessionEndTime

CSV

The time that the test was submitted (provided as a unix timestamp). This will typically be the same value as submissionTime.

Duration

duration

How long it took the test taker to complete the test (in seconds). The value of this field should equal the duration value(s) of each individual item added together.

Submission Time

submissionTime

The exact time the test taker submitted the test (provided as a unix timestamp). This will typically be the same time as sessionEndTime.

Last_update_date

lastUpdateDate

The date the session was last updated (provided as a unix timestamp). For tests with manual scoring, this value will display the time at which scoring was completed. Until all manual scoring is performed (if any), the value of this field should be the same as the sessionEndTime.

Scoring

Cut Score Ratio

cutScoreRatio

If a cut score is configured for the test, the percentage of the cut score (a cut-off point for passing the test) achieved by the test taker’s score will display. This percentage is displayed as a decimal value. If no cut score is defined for the test, the value of this field will be null. For more information, see Configuring scoring for tests.

outcomes

CSV

Any scoring outcome defined on the test level (in Test authoring) will be listed here. For more information, see Configuring scoring for tests.

  • SCORE_TOTAL_MAX: The maximum score defined for the test.

  • SCORE_RATIO: The total score achieved by the test taker divided by the maximum possible score). This value should be a decimal number between 0 and 1.

  • SCORE_TOTAL: Total score from the given test taker for the test. 

Score

score

CSV

The amount of points achieved by the test taker, if defined by the test scoring.  The value of this field should match the value of SCORE_TOTAL in outcomes.

Max Score

maxScore

CSV

The maximum possible score for a delivery (test). The value of this field should match the value of SCORE_TOTAL_MAX in outcomes.

Item level data

These fields record each item in the test individually with details about the item, and how the test taker responded to it in the test.

Data Explorer

API

Description

Item Id

Listed first after

CODE
items: {
}

Each item’s reference ID, which can be found in the item’s general properties in Test authoring.

Num Attempts

numAttempts

How many times the item was seen (or attempted) by the test taker. Only the last attempt’s results are displayed and taken into account for the item’s scoring.

 

metadata

The metadata defined for an individual item

  • label: The label of the item in the Item properties (in the Edit Item form).

  • Metadata properties (propertyLabel), such as subject matter, are listed here with each property name and the value assigned to the given item.

Full Item Resource Id

fullItemResourceId

The item’s Identifier, which can be found in the Item Properties (in Item authoring).

Status Correct

statusCorrect

CSV

Whether the item’s score was correct, false, partially correct, or skipped. 

Qti Title

qtiTitle

CSV

The title of the item in the Item Properties (in Item authoring).

Max Score

maxScore

The maximum score available for the item.

Submission Time

submissionTime

The exact time the answer to the item’s question was submitted. This time is provided as a unix timestamp.

Qti Id

qtiId

The Identifier, which can be viewed and modified in the Item’s Properties (in item authoring). 

Qti Label

qtiLabel

CSV

The label of the item in the Item properties (in the Edit Item form).

Duration

duration

CSV

The duration value reflects the time (in seconds) a test taker spent on a given item. The duration value excludes the time the item took to load and become available, as well as any time a test taker had their session paused.

Score

score

The score achieved by the test taker for the particular item.

Item End Time

itemEndTime

The exact time the item was completed/submitted by the test taker (for linear tests) or last interacted with (for non-linear tests). This time is provided as a unix timestamp. 

Item Start Time

itemStartTime

The exact time the test taker opened the item in the test for the first time. This value is provided as a unix timestamp. 

Completion Status

CODE
outcomes: {
SCORE:
MAXSCORE:
completionStatus: }

CSV

In API results, all outcomes defined on the item will be listed here (especially the ones defined for manual scoring).

Completion Status: The completion status of the item. The possible values are incomplete, not_attempted, unknown, or completed.

  • not_attempted means the item was seen but no response was given.

  • completed means the item was seen and a response was given.

  • unknown and incomplete display when an item was not seen by the test taker.

In API results, SCORE AND MAXSCORE will display repeated values.

 

responses

CSV

RESPONSE_x : This value is the response identifier of all the interactions defined in the current item. It is editable from the item authoring screen. If you have multiple interactions in an item, you will have multiple entries here.

  • correct: Whether or not the test taker’s answer was correct.

  • value: The value provided by the test taker for the interaction. For information on the format of the baseType value as an interaction response, see the table below.

Manually Graded

manuallyGraded

Displays if a manually scored item has been scored or not. This value will display as true if the item has been scored, and false if it is awaiting scoring.

Manually Graded At

manuallyGradedAt

The time an item was manually graded (if applicable). This value is provided as a unix timestamp. It will display as null if the item is awaiting scoring.

hasFileUpload

When set to true, this field indicates the item has an upload in one of the responses.

Reference: Serialization for item responses

This table summarizes how QTI baseTypes are serialized depending on their cardinality at export time.

BaseType

Cardinality

Serialized Example

identifier

single

single-identifier

identifier

multiple

['multiple-identifier1'; 'multiple-identifier2'; 'multiple-identifier3']

identifier

ordered

<'ordered-identifier1'; 'ordered-identifier2'; 'ordered-identifier3'>

boolean

single

true

boolean

multiple

[true; false; true]

boolean

ordered

<true; false; true>

integer

single

0

integer

multiple

[1; 2; 3]

integer

ordered

<4; 5; 6>

float

single

0

float

multiple

[1.1; 2.2; 3.3]

float

ordered

<4.4; 5.5; 6.6>

string

single

string1

string

multiple

['string2'; 'string3'; 'string4']

string

ordered

<'string5'; 'string6'; 'string7'>

point

single

0 1

point

multiple

[2 3; 4 5; 6 7]

point

ordered

<8 9; 10 11; 12 13>

pair

single

pair1 pair2

pair

multiple

[pair3 pair4; pair5 pair6; pair7 pair8]

pair

ordered

<pair9 pair10; pair11 pair12; pair13 pair14>

uri

single

https://www.mywebsite1.com

uri

multiple

['https://www.mywebsite1.com'; 'https://www.mywebsite2.com'; 'https://www.mywebsite3.com']

uri

ordered

<'https://www.mywebsite4.com'; 'https://www.mywebsite5.com'; 'https://www.mywebsite6.com'>

directedPair

single

pair1 pair2

directedPair

multiple

[pair3 pair4; pair5 pair6; pair7 pair8]

directedPair

ordered

<pair9 pair10; pair11 pair12; pair13 pair14>

duration

single

PT0S

duration

multiple

[PT1S; PT2S; PT3S]

duration

ordered

<PT4S; PT5S; PT6S>

record

N/A

{'identifier1'; false; 999; 9.99; 'string1'; 1 2; identifier1 identifier2; 'https://www.my-website.com'; identifier1 identifier2; PT0S}

JavaScript errors detected

Please note, these errors can depend on your browser setup.

If this problem persists, please contact our support.