Marking MCQ/ FLOWmulti Assessments

Marking MCQ/ FLOWmulti Assessments

A typical FLOWmulti assessment includes automatically scored questions, such as multiple-choice, and/or may also contain multiple questions that require manual scoring by an assessor.

Manually Scoring Questions

  1. Click on the Marking tab and select on the relevant flow (assessment):

WISEflow Marker Overview.png
  1. On the flow page, open the marking tool by clicking the Resume marking button (This may say Start marking when you first go to the page).

WISEflow Marking Tool.png
  1. In the marking tool, the Submissions button opens a panel that displays all questions in the assessment, including those that have been automatically scored. You can also view Turnitin similarity scores and any appendix material uploaded by the student in the Item selected.

WISEflow submission tab.png
  1. To view only questions that require manual marking, click the Manually marked filter.

WISEflow Manuall Marked button.png
  1. Click Score to open the Scoring panel for a specific question. Alternatively, Click on the Scoring button and navigate through the items to locate questions that require manual marking.

WISEflow score and scoring.png
  1. For manually marked questions, enter a score using the available score input field(s). Your score will be saved automatically.

WISEflow score input field.png
  1. To navigate between students, click the Participations button on the left side of the marking tool. You can then select a student to open their exam.

WISEFlow Participants button.png

Alternatively, click the Toggle Navigation Panel button to navigate by student or by flow item.

WISEflow navigation panel.png

Tip: you can also use the keyboard shortcuts CTRL+↑ or CTRL+↓ to navigate to another student, and CTRL+← or CTRL+→ to navigate to another item in the exam paper. The same shortcuts will work on a Mac, using the CMD key instead of CTRL.

Delivering Feedback

Feedback can be delivered in three ways:

Converting Scores to Grades

  1. Go to the Flow overview and click the Personal Setup button.

WISEflow personal setup buttom.png
  1. From the drop-down menu, select Grade scaling (from scores).

  2. Confirm the grade scale you want to use (usually this is 0-100%) and click Save.

  3. If the paper has optional questions each with a response box you can override the max scores on the paper to the maximum score any student could achieve. The grade scaler will then calculate a % grade disregarding the un-selected questions.

  4. In the Marking overview, click the Apply scaled grades button.

WISEflow apply scaled grades.png
  1. Click Confirm.

  2. Finally, click Submit all. The grades will now be available for moderation.

Overwrite Automatically Scored Questions

You can override the score of an automatically marked question for an individual student by enabling the Modify auto-scores toggle in the marking tool.

WISEflow modify auto-scores.png

If there is an issue with the scoring setup and you need to update the scores for all students, it is best to rescore the whole exam:

  1. First, correct the exam in the Authoring role (see Changing Incorrect Answers or Rescoring a FLOWmulti exam).

  2. Then, rescore the exam in the Managing role (see Rescoring a FLOWmultil exam).

Response and Scoring Statistics

View Single Question Statistics

You can view response and score statistics for an individual question by clicking the Question statistics button in the top-right of the marking tool.

WISEflow individual question statistics (big).png

View and Download Response / Scoring Data for Entire Flow
(for all your allocated participants)

WISEflow all question statistics (big).png
  1. Click the Question statistics button on the left side of the marking tool.

  1. Click on either the responses or scores tabs.

WISEflow statstic tabs.png
  1. Click Download response data or Download scoring data and choose the file type from the drop-down list. The Aggregated for the flow option gives you broader, high-level statistics, whilst the Participant question responses/scores options gives you more granular data on individual attempts.

WISEflow download statistics data.png

Tip: We recommend you use the statistics function to download score data when you have completed and submitted marks to facilitate marking and moderation with co-markers, who will otherwise only see the final submitted grade but not co-marker individual questions scores.

Using Item-Based Marking

Item-based marking allows markers to be allocated to a specific part of the assessment, rather than individual students. This allows them to see only the relevant sections of the exam for marking.

For further guidance, see Using Item-Based Marking (FLOWmulti only).