Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: guidance on Deploying Random Variants

Keywords: quiz, question, mathematics, science, exam, multiple choice, e-exam, e-assessment, summative, formative, instant feedback

Table of Contents
maxLevel3
minLevel2

...

  1. Click Add another node.
  2. Set Answer test.
  3. Set SAns, TAns and Test option.
  4. Set Score or Penalty.
  5. Set Next value to achieve the desired traversal of tests. Note. You can click Save changes and continue editing to refresh the preview of the response tree, as pictured below:

STACK response tree diagram showing the order in which nodes are connected

Step 3: Deploy random variants

Questions in STACK can contain randomly generated elements. A student will be given a random variant of a question generated by a pseudo-random seed.


Warning
titleCaution

The tutor is strongly advised to pre-generate and "deploy" variants of a question. Not pre-generating question variants Forces Moodle to generate them on the fly - for quizzes with larger numbers of participants this can cause quizzes to crash/freeze.
When a student attempts the question, they will be given a random selection from the deployed variants.


Why deploying variants

Questions in STACK can contain randomly generated elements. A student will be given a random variant of a question generated by a pseudo-random seed.

The tutor is strongly advised to pre-generate and "deploy" variants of a question. Not pre-generating question variants Forces Moodle to generate them on the fly - for quizzes with larger numbers of participants this can cause quizzes to crash/freeze.
When a student attempts the question, they will be given a random selection from the deployed variants.

Deploying Random variants:

...

Other reasons for deploying variants of a question:

  • STACK runs all the question tests on each deployed variant to establish each variant of the question is working. This aids quality control. By using question tests, it is unlikely a student will be given a random variant which does not work correctly.
  • The tutor can decide if each deployed variant appears to be of equal difficulty. The tutor can easily delete variants they do not like.


Info
titleCaution
  • If an author does not deploy any variants (not advised!) then the student gets any random variant.
  • Questions that don't use randomisation cannot be deployed explicitly. STACK automatically detects randomisation.


How to deploy question variants

The deployment interface can be found by editing a question and clicking on question tests and deployed variants.

  1. The easiest way to do so is to preview the question: Image Added
  2. Then click the Question tests & deployed variant link on the top right corner.Image Added
  3. Click ‘deploy’ if not already deployed.
  4. Next to Attempt to automatically deploy the following number of variants, enter the number of variants you would like and click Go. You can preview results and either exclude variants, or return to the quiz question settings to revise the randomisation you have used in the question.
  5. Check variants as required.
  6. This will show the list of currently deployed variants, and links to undeploy all or a specific variant.
  7. Optionally, click ‘Run all tests on all deployed variants (slow):’ and check/undeploy any variants you don’t want to use.
    Image Added
    Limitations
Info
titleLimitations

There is currently no way to loop systematically over all variants and deploy them all.


Step 4: Test questions

You can test questions by deploying random variants, and adding test cases.

Add test cases:

  1. Click Add a test case
  2. Provide a test input, and the expected outcome.
  3. Click Save changes
  4. Clik Run all tests on all deployed variants to run the test on all the deployed variants of your question.

...

  • Not pre-generating question variants Forces Moodle to generate them on the fly - for quizzes with larger numbers of participants this can cause quizzes to crash/freeze. Ensure you generate/deploy question variants before the quiz runs.
  • STACK allows students to use standard mathematical functions including sin, cos, and int for integration. For integration questions, you need to add 'int' as a forbidden word or else students can enter 'int' and Moodle will perform the integration for the student.
  • Students will need to be instructed on how to enter Mathematical equations correctly. Digital Education recommends having a formative or practice quiz to familiarise students with the process of completing and submitting a STACK question. Guidance on Maxima can be found on the STACK documentation page, and in the Maxima manual.
  • When using randomization, ensure you run question tests to ensure the difficulty of the question is consistent. See the STACK documentation page on Randomisation for more details.
  • Once a quiz is underway it is still possible in Moodle to edit a question, and to re-grade students' attempts. This is useful in rare cases where there is a mistake. However, do not change anything related to the random generation of questions! Results are unpredictable, and may well result in a situation when the modified question is different to that answered by students taking the test prior to modifications. 

...