Skip to end of metadata
Go to start of metadata

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 9 Current »

IMPORTANT: Creating exam papers in WISEflow is an academic responsibility. Content should be added by users with expertise in the subject matter to ensure that any risk of error is minimised.

The guidance below refers to creating exams and assignments in the new assignments area. While it is still possible to create material using the legacy assignments area, it is not recommended as this will prevent access to new features such as the ability to rescore exams and change correct answers.

Creating a FLOWmulti exam paper

There are a number of different question types to choose from when creating a FLOWmulti exam. The question editor is provided by Learnosity, who have extensive documentation on all the different options available. Access Learnosity’s Author Guide on all question types.

  1. In the Author Overview, click +New assignment.

    A screenshot of the author overview in WISEflow. The New assignment button is highlighted.

  2. Give your assignment a title and optionally add a description and/ or labels. Labels can be especially useful to help differentiate a number of assignments. You can also choose whether to add any pre-existing questions or material from the content bank underneath the Assignment outset section of this menu.

    Click Create to finish.

    A screenshot of the new assignment menu. The assignment has been given a title and 3 labels have been added.
  3. You will now be taken to the assignment setup page, where you can see the shell of your assignment and content can be added.

    A labelled screenshot of a new FLOWmulti assignment.
  • 1. The total number of questions and the maximum score of the assignment

  • 2. Add or edit an author group (enables collaboration with multiple users on an assignment)

  • 3. Create a new version of the assignment, suitable to be attached to a flow, or access existing versions

  • 4. Edit the assignment title/ description/ labels, change the assignment configuration, create a copy of the assignment or preview the assignment

  • 5. Manage or reorder assignment items

  • 6. Add a new item

  1. Click Add an item and select New item. Items act as new pages in your exam paper. Optionally give the item a title and/ or description and click Save.

A screenshot of the new item menu. This item has been given the title 'Section A'.

  1. You will now be taken to your newly created item, where questions and other content can be added. Click Add new.

    A screenshot of a newly created item. The Add new button is highlighted.

  2. This reveals the question editor, where a number of different question types can be selected and features such as embedded videos or separate text instructions can be included.

    Click on your selected question type to add it to the item. A multiple choice question will be used as an example in this written guidance.

    A screenshot of the question editor.

  3. Your chosen question will be displayed in edit mode. Add your question text to the question text box (1). Under Options (2), define the answer choices. Potential answers can be dragged and reordered if needed and you can click +ADD (3) to provide additional options.

    A multiple choice question shown in edit mode. Various parts of the editor are labelled.

  4. Below the options, you can set the correct answer for the question and its points value (1), add alternative answers (2), allow multiple responses (3) and shuffle options (4), which will present the answers in a random order for each student.

    A labelled screenshot of the area where the correct answers are defined in the question editor.

By default, automatically scored questions will only award points to a student if their selected answers are an exact match to the correct answer. See Different scoring types for more information about scoring behaviour.

  1. Underneath More options there are a number of additional settings, including the ability to set the question as an unscored/ practice question, enable a penalty if the question is answered incorrectly, allow the student to check whether their answer is correct and change the scoring method (e.g. to award points for partially correct answers).

    image-20241112-175927.png

There are a lot of extra options that can be set on a question. See Editing questions: More options for more information.

  1. Scroll back up to the top of your question. It is strongly recommended that you switch to Preview mode to check that your question is behaving and scoring as expected. You can interact with different answers to check how points are being awarded and/ or show the correct answers and any distractor rationale you have added.
    When you’re satisfied, click Save to finish.

    A screenshot of a question in edit mode. The three correct answers have been selected and the preview confirms that 1 point will be awarded for this.

  2. Continue adding questions to the item (page), or add a new item and question as needed. In this example, a new item called Section B has been added to the exam paper and this will contain essay questions.

    A screenshot of the question editor in a FLOWmulti assignment. The essay type question has been highlighted.

Note: The next few steps cover some key differences in settings for essay questions. Skip to Step 15 for information on viewing the whole assignment and creating a flow version of your exam paper (i.e. publishing it so that it can be attached to a flow).

  1. When editing the essay type question, the question text can be entered in the question text field as normal. Instead of defining a correct answer, text formatting options can be set below.
    You can also set a word limit and choose whether to display the word count to students.

    A screenshot of an essay type question in edit mode.

  2. Essay type questions are manually scored. Under More options, define the Max score for the question. You also have options to define a minimum score if the question is attempted, allow answers that exceed the word limit to be submitted, and enable a spellchecker.

    A screenshot of question options available for essay type questions.

The spellchecker in essay type questions is not supported when the lockdown browser is in use. Aim to test your essay questions on a mock flow in the WISEflow staging environment to make sure they are behaving as expected before the actual exam.

  1. Scroll back up to the top of the editor. As before, you can switch to Preview mode to see how your question will appear to students. Click Save to finish.

  2. At the top of the page, you can use the Item drop-down or arrow keys to navigate between different items (pages) in your exam paper. Click To the assignment setup to return to the setup page.

    A screenshot of the top of the assignment page. The item navigation and 'To the assignment setup' button are highlighted.

  3. Back on the assignment setup page, you can now see all sections of your exam paper. It is recommended that you check the image-20241113-110239.png Configuration settings of your assignment if needed and image-20241113-110352.png Preview the assignment.

    A screenshot of the assignment setup page. The assignment now has two sections containing various questions.

Tip: The Preview as participant option is really helpful as it allows you to see the assignment as it would appear in WISEflow’s exam environment and offers a truer view of the student experience.

  1. Once you are satisfied with your exam paper, click Flow versions and then click Create flow version.

    A screenshot of the assignment setup page. The Flow versions and Create flow version buttons are highlighted.

Tip: When making subsequent edits to an exam paper, use the text box below the Create flow version button to provide a brief explanation of what’s changed before you create another new flow version.

  1. You will now be taken to the newly created flow version of your exam paper. This will need to be attached to a flow (assessment) in order for students to see it and answer the questions. Each flow version has a unique reference code which can be copied for this purpose. See Attaching a FLOWmulti exam paper for more information.

    image-20241113-111520.png

Note: You cannot add new content to a flow version of an exam paper, however you can still edit the scoring for existing questions if this needs to be corrected.

See Rescoring a FLOWmulti exam for more information.

You can also:

  • image-20241113-112153.png Open the Version list to view and access different versions of this assignment

  • image-20241113-112237.png Return To the original assignment to make further edits and create a new flow version

Understanding Flow Versions

Terminology

Original assignment

  • A fully editable assignment/ exam paper, you can make significant changes to an original assignment at any time.

  • Editing an original assignment will not impact any existing flow versions.

  • One original assignment can be used to create many different flow versions.

Flow version

  • A published version of your assignment/ exam paper which can be attached to a flow and released to students.

  • Each flow version has a unique reference code.

  • You cannot add or remove any content from a flow version of an assignment, although you can adjust the scoring of existing questions.

Once you have created a flow version of your FLOWmulti assignment/ exam paper for the first time, the Flow versions button on the assignment setup page splits into two different sections.

A screenshot of the assignment setup page. The flow versions and flow list buttons have been labelled.

1. Access the reference code for the latest flow version of the assignment and/ or create a new flow version of the assignment (note: the option to create a new flow version will only be available if new changes have been made to the assignment).

  1. See the Version list containing all versions of this assignment (and access any flow versions).

A screenshot of the version list. Different versions of an exam paper are listed.

If you are looking at your original, editable assignment, this will be denoted by the assignment header in the upper left corner and the To the assignments list button on the right hand side of the page:

image-20241113-120157.png

If you are looking at a flow version of the assignment, this information will also be clearly displayed at the top of the page:

A screenshot of a flow version of an assignment.

Editing questions: More options

Different scoring types

Scoring type

Behaviour

Exact match

The student must enter the exact correct answer in order to be awarded the point(s). Example: the correct answer is worth 3 points. The student’s answer must match the correct answer to be awarded 3 points, otherwise they will receive 0 points.

Partial match per response

The student will be awarded the defined number of points for each element of the question that is answered correctly. Example: there are 3 correct answers worth 3 points. For every correct answer the student chooses, they will be awarded 3 points (up to a maximum of 9 points).

Partial match

The student will be awarded a portion of the defined number of points, depending on how many correct responses are present. Example: there are 2 correct answers worth 3 points. If a student chooses 1 correct answer, they will be awarded half of the total points (1.5 points).

Unscored/ Practice usage: points will not be awarded for this question.

Match all possible responses: this allows responses in alternative answers to be mixed and matched. See Learnosity’s article on Using the Match All Possible Responses Validation Option for more information. (Note: this option is only available for certain question types, e.g. Fill in the blanks.)

Penalty points: will subtract points if the question is answered incorrectly. The total score for the exam paper cannot go below 0 unless the separate Negative scores setting has been configured. Penalty points can behave differently depending on which scoring type is in use, see Learnosity’s article on Using Penalty Points with Different Scoring Types.

Answer verification

A screenshot of the answer verification setting in the question editor in WISEflow.

When the “Allow verification of the answer” option is ticked, students will have a “Check Answer” button underneath the question that will show them whether their response is correct or not.

A screenshot of a question where verification is permitted.

Adding a distractor rationale (answer explanations)

A screenshot of the text box where a distractor rationale can be added in the question editor.

You can add one distractor rationale per question (not per specific answer). The distractor rationale will be shown on a FLOWmulti assignment if a student is permitted to access this after submitting, or it can be shown while the assignment is underway if answer verification has been enabled on the question.

A question with a distractor rationale added. The rationale is displayed after the student clicks the Check Answer button.

Assignment configuration options

Additional settings for the overall assignment can be set by clicking the Wrench icon on the assignment setup page.

A screenshot of the assignment setup page. The wrench icon used to access assignment configuration is highlighted.

Shuffle Items

Enabling this setting will randomise the order of all items/ pages in the exam. This tends to be most useful when the exam has been organised to have 1 question per item.

Negative Marking

Can be used in combination with the penalty points option on individual questions. This will allow the overall score for the assignment to go below 0, if enough penalty points are applied.

Reading Mode

Allows students to have read-only access to the exam paper for a set period of time before being allowed to answer questions.

No Backward Navigation

Important: it is strongly recommended that this setting is only enabled for in-person exams, where students can get assistance if they have moved to the next item in error.

Prevents the student from returning to a previous item/ page in the assignment. If there are any unanswered questions on the item, students will receive a warning message notifying them that they will be unable to return if they choose to proceed to the next item.

Staff can use the invigilator password to help a student navigate back to a previous section if needed. (Note: DO NOT give the invigilator password to students while an exam is underway in any circumstances. This will compromise the security of the exam. Instead, you should type this in for them and assist directly.)

Information Page

This setting can be used to provide information on a separate start page before students access the exam questions. Unless you are using the Shuffle items setting, it is recommended that you add a passage to the first item in your exam/ assignment and write any important information there instead of using this setting.

Creating a FLOWlock exam paper or an assignment (FLOWassign, FLOWhandin, FLOWattend)

If you are not creating a multiple choice exam or an exam which features interactive questions (i.e. a FLOWmulti exam), you should write your exam paper or assignment brief using your word processor of choice and save it as a PDF so that it can be viewed directly in WISEflow.

The PDF can be provided to a user with Manager access to the flow (i.e. a programme administrator) and they will attach this for you.

Sharing your FLOWmulti exam paper

You can share a FLOWmulti exam paper/ assignment with other Authors to collaborate by creating an Author group and adding this in. See Using Author Groups for more information.

Attaching an exam paper or assignment to a flow

Attaching a FLOWmulti exam paper

Provide the code to a Manager

You can provide the code for the version of the exam paper you wish to use to a users with Manager access to the flow (assessment) and they will be able to attach this for you.

Attach the paper by yourself (Author access required)

  1. Copy the appropriate reference code for your exam paper.

  2. From the Author overview, click on Go to associated flows.

A screenshot of the Author overview in WISEflow. The Associated flows button is highlighted.
  1. If you have Author access to the flow, it should be visible here under Active flows. Click on the flow to expand it. Under Assignments, paste the reference code into the text field and click Attach.

    A flow as seen via the Authoring role. The text field in the Assignment area has a reference code pasted into it and has been highlighted.

  2. Once you have successfully attached the exam paper, you can preview it, or delete it and replace with a new version as needed.

Attaching a FLOWlock exam paper or an assignment (FLOWassign, FLOWhandin, FLOWattend)

The easiest way to attach a FLOWlock exam paper or an assignment for a FLOWassign, FLOWhandin or FLOWattend type flow is to provide a PDF file to a user with Manager access to the flow so that they can attach it for you.

Replacing an existing exam paper or assignment

Important: exam papers and assignments can only be replaced before the participation period/ start date of the flow. Once this date/ time has passed, it is no longer possible to change the attached exam paper or assignment!

The steps below are for a FLOWmulti exam paper or assignment and assume that you have Author access to the flow that the exam or assignment has been attached to.

If you do not have Author access to the flow or you need to replace the assignment on another flow type, provide the reference code or PDF file for the replacement exam or assignment to a user with Manager access and ask them to do this for you.

  1. From the Author overview, click on Go to associated flows.

    A screenshot of the Author overview in WISEflow. The Associated flows button is highlighted.
  2. If you have Author access to the flow, it should be visible here under Active flows. Click on the flow to expand it. Under Assignments, click on the Delete button and confirm the deletion.

    image-20241210-204541.png
  3. The FLOWmulti exam paper or assignment can now be replaced with a new version.

  • No labels