Algorithm question selection

Questions in both the Test and Practice Zone areas are adaptive to how the student answers questions (correct/incorrect) as the activity progresses, and questions not seen before are prioritised.

The algorithm considers the following 3 types of questions:

1. Prefer a question that the student has never seen before (in the activity category) AND prefer a question for which the student has never seen a similar question (we call these variants, and they are questions of a similar structure, but may have different numbers, shapes, etc..)

2. If the student has seen many questions and has seen at least one question of every variant type (could be across Practice and Test zones), then prefer a specific variant that the student has never seen before.

3. Only if the student has seen all questions and variants of questions in the database for the given activity, would a question that has been seen before be presented.

Test Zone

The Test Zone is a controlled environment primarily intended for formal testing. It evaluates a student’s ability in real time and adjusts the difficulty of questions dynamically based on performance as the test progresses. (Note: Any activity, including those in the Test Zone can be hidden by each Teacher for their students, to ensure if the test zone is being used for formal testing, that the students may not have had access to that area prior to test time.)

How Adaptive Testing Works in the Test Zone

1. Initial Difficulty Level:
   • First attempt at a given test:
     • The test starts at a predefined baseline for the year level, for example a year 9 student would start at a low band 6 the very first time they take a given test.
     • Subsequent tests are adjusted slightly based on their previous result, but are limited in the distance away from the baseline. Moving up or down progresses quicker in the first portion of the test than later on.
2. Progression Logic:
   • Correct Answers: Increase the difficulty, moving the student to higher bands.
   • Incorrect Answers: Decrease the difficulty, finding the student’s true competency level.
   • The algorithm adjusts more significantly at the start of the test and refines as the test progresses.
3. Guessing Mitigation:
   • Some adjustment of streaks vs random patterns of correct/incorect answers are analyzed to reduce the effects of possible guessing behavior.
4. Final Band Level:
   • Determined by the most recent performance and overall test progression, with weighting to avoid overemphasis on random successes.

Reuse of Questions

• Questions can be shared between the Practice and Test Zone, however for tests (ie. in the Test Zone) the algorithm prioritises unseen questions.
• If all questions in a given category of test are exhausted, previously seen questions (from prior tests, or even from the Practice Zone) or variations may be reintroduced.
• Previously answered questions from the Practice Zone are typically avoided unless no other questions are available.

Feedback and Reporting

• After the test, students and teachers can view:
  • The band level achieved.
  • A breakdown of the questions answered, including difficulty levels.
• Band levels reflect demonstrated ability in a supervised setting, providing diagnostic insight.