Toolbar.png

The guidance outlined on this page covers the functions of External Examiners, who are typically given the Reviewer role on the AssessmentUCL (WISEFlow) platform.

Link to AssessmentUCL (WISEflow) platform: https://europe.wiseflow.net/login/license/568

Getting Started

Reviewing Marking Infomation

Adding commentary (optional)

Troubleshooting

Overview of the External Examiner role

What can a External Examiner do?

External Examiners can:

Accessing assessments

  1. Login to WISEflow (AssessmentUCL) at https://uk.wiseflow.net/ucl

  2. Click on UCL.

image-20240925-102719.png
  1. You will be taken to the UCL single sign-on page, please enter your UCL username and password.

  2. You will arrive on the AssessmentUCL (WISEflow) dashboard. Click the Reviewer tab (Note: you may have access to more than one role).

Toolbar.png
  1. You should arrive on the Reviewer page (Flow Overview).

On this page, you can see a list of all the activated assessments to which you have been added as a reviewer, and you can quickly get an overview of the assessment titles, subtitles and assessment deadlines. The list can be sorted for each column in alphabetical order or by newest/oldest. You can also find specific flows by using the search bar in one of the columns.

From the overview, you can access an active flow by clicking its Open button. You can also access the Archive which contains all of the previous assessments you have been assigned to as a reviewer.

image-20240213-163050.png

Navigating the reviewer page

When you open an assessment in AssessmentUCL (WISEflow) as a reviewer you will be taken to the reviewer page.

Reviewer screenshot 1.png

The main options on this page are:

  1. See the assignment and additional material for assessors.

  2. See the start and end dates of the participation and marking periods.

  3. Click to see a list of flow managers.

  4. This shows which procedure for the submission of grades is used on the flow.

  5. Filters the list by assessors.

  6. This shows the percentage value of the similarity analysis; you can click on the figure to open the detailed similarity report.

  7. Here you can either open the paper in the assessor tool or go directly to the summary for the participant.

  8. This column shows the grades given by the assessors assigned to the participant.

Accessing a specific paper

To identify a paper to review, the External Examiner can:

  1. Sort grades from highest to lowest by clicking the Final grade column header, and/or

  2. Search by candidate number or submitted grade by typing in the search field.

A screenshot of the main flow page available to Reviewers. Parts of the page that can be used to sort and order grades or search for a specific student have been labelled.

Deadline for reviewing assessment

Marking, moderation and reviewing of marks must take place before the end of the marking period for the assessment. The marking period is set by the manager and can be extended.  

When the marking period ends, marks cannot be changed on AssessmentUCL (WISEflow). If changes are required, the Manager must re-open the marking period.

Turnitin similarity checking

Turnitin reports are available for all assignments submitted on the following flow types (assessments):

Turnitin reports can be accessed from the reviewer page or the marking tool which a Reviewer can also access. Clicking on the percentage score in the Similarity report column will open the report in a new tab:

image-20240213-163114.png

For guidance on interpreting Turnitin reports, please see Turnitin's help guides.

Viewing grades and feedback (comments, annotations and rubrics)

Viewing Grades

Grades can be seen on the main flow page for an assessment. The Submitted grades column (1) contains any grades submitted by markers, while the Final grade column (2) contains the overall, agreed grade:

A screenshot of the main page for an assessment accessed via the Reviewer role. The submitted grades column and the Final grade column are both highlighted.note

Tip: Hovering your mouse cursor over a grade will reveal the details of the marker that submitted it. You can also use the Filter assessors feature to select specific markers, which will label any grades they have submitted with their initials.

Tip: Hovering your mouse cursor over a grade will reveal the details of the marker that submitted it. You can also use the Filter assessors feature to select specific markers, which will label any grades they have submitted with their initials.

Viewing Feedback

Note: Flows (assessments) created after 7th March 2025 are likely to be using the new marking tool. Flows using the new marking tool have one button in the User Feedback column, which is used to access the student submission and any feedback that has been delivered.

A screenshot of a flow as seen in the Reviewer role. This flow is using the new marking tool

If the flow has been set up to use the old (legacy) marking tool, you will see two buttons in the User Feedback column instead. Clicking the second Open shared summary button in this column will display marker feedback, followed by the student submission:

A screenshot of a flow as seen via the Reviewer role. This flow is using the legacy marking tool and has two buttons available in the user feedback column. The second button, used to access a shared summary of marker feedback, has been highlighted.

Overall Comments (Common and Submission Feedback)

  1. On the main flow page, click the button in the User Feedback column to open the marking tool.

  2. Submission feedback (overall commentary on a single submission) can be accessed by clicking the Feedback button in the upper right corner of the page. This will open the feedback panel on the right, where any marker commentary can be seen in the Feedback overview section:

    A screenshot of the new marking tool accessed by a Reviewer. The Feedback button in the upper right has been highlighted. The feedback panel is displayed on the right hand side of the page and displays overall comments left by 3 different markers.
  3. Common feedback can be used to provide broader commentary on the cohort’s performance. Any common feedback can be accessed by clicking the Common feedback button on the left hand side of the page. This will open the feedback panel on the right, where any marker commentary can be seen in the Feedback overview section:

    A screenshot of the marking tool accessed via the Reviewer role. The common feedback button on the left hand side has been highlighted. The common feedback panel is open and a piece of feedback delivered by a marker is also highlighted.
note

Tip: Common and submission feedback is colour coded based on how it has been shared:

  • Blue: shared with participants (students) only. Other markers cannot see this feedback.

  • Yellow: shared with co-assessors and Reviewers (i.e. not visible to students).

  • Green: shared with all. Co-assessors and Reviewers can see this feedback immediately, participants (students) will see it at the end of the marking period.

  • Grey: private. Only the original marker and Reviewers can see this feedback.

You can also filter feedback based on how it has been shared or who delivered it.

Tip: Common and submission feedback is colour coded based on how it has been shared:

  • Blue: shared with participants (students) only. Other markers cannot see this feedback.

  • Yellow: shared with co-assessors and Reviewers (i.e. not visible to students).

  • Green: shared with all. Co-assessors and Reviewers can see this feedback immediately, participants (students) will see it at the end of the marking period.

  • Grey: private. Only the original marker and Reviewers can see this feedback.

You can also filter feedback based on how it has been shared or who delivered it.

Annotations

  1. On the main flow page, click the button in the User Feedback column to open the marking tool.

  2. Any annotations will be displayed directly on the student submission in the middle of the screen. Click the Annotations button in the upper right corner of the page to display the annotations list, where any written commentary associated with an annotation can be viewed:

    A screenshot of the marking tool, accessed via the Reviewer role. A student submission with annotations is visible in the middle of the screen. The annotations button and the annotations list on the right hand side have both been highlighted.
note

Tip: If there are a lot of annotations, clicking on an annotation in the annotations list will show you where it can be found in the submission.

Tip: If there are a lot of annotations, clicking on an annotation in the annotations list will show you where it can be found in the submission.

Rubrics

  1. On the main flow page, click the button in the User Feedback column to open the marking tool.

  2. If a rubric has been used to mark the work, this can be accessed by clicking the Shared rubrics button in the upper right corner of the page:

    A screenshot of the marking tool accessed via the Reviewer role. The shared rubrics button in the upper right corner has been highlighted.

  3. Shared rubrics will be displayed in the middle of the page. If multiple rubrics have been completed, you can use the dropdown menu to select a rubric completed by a different marker.

    A screenshot of a shared rubric. The dropdown menu which can be used to select and view a different rubric has been highlighted.

Feedback in the legacy marking tool

Feedback can be accessed by clicking the second Open shared summary button in the User Feedback column column:

A screenshot of a flow as seen via the Reviewer role. This flow is using the legacy marking tool and has two buttons available in the user feedback column. The second button, used to access a shared summary of marker feedback, has been highlighted.

Any overall comments on the flow (common feedback) are listed first, followed by comments on the specific submission, any completed rubrics and then any annotations that have been made.

Adding a comment

Please note that External Examiners can add a comment to an assessment, but this is not a UCL wide requirement. If in doubt, please refer to the Academic Manual, and/or department procedures.

To add a comment to a specific submission:

  1. Use the button in the User Feedback column to open the relevant student submission in the marking tool.

    A screenshot of a flow as seen in the Reviewer role. This flow is using the new marking tool

  2. Click on the Feedback button to open the feedback panel on the right hand side of the page.

    A screenshot of the marking tool as seen by Reviewers. The feedback button in the upper right has been highlighted.
  3. You will then be presented with a text box for typed commentary (1). You can additionally attach a file (2) if appropriate and change the sharing settings/ visibility of your comment from the default (3). Click Save to finish.

    A screenshot of the area used to deliver submission feedback in WISEflow. Different parts of the area have been labelled to show where commentary can be written, files can be attached and the sharing settings can be changed.

Adding a comment in the legacy marking tool

To add a comment to a specific submission:

  1. Use the first button in the User Feedback column to open the marking tool for the relevant student:

    A screenshot of the Reviewer's main flow page when the legacy marking tool is in use. The first button in the user feedback column has been highlighted.

  2. Click the student dropdown menu, which has the current student’s details on it, in the upper right corner of the page. Click Add comment.

    A screenshot of the legacy marking tool when accessed by the Reviewer. The student dropdown menu and the button used to add a comment to a submission have both been highlighted

  3. A comment box will appear on the right hand side of the page, where typed commentary can be added. You can additionally attach a file if appropriate and change the sharing settings/ visibility of your comment from the default.

    A screenshot of the area used in the legacy marking tool to add comments to a specific student submission.


    Comments are automatically saved, so once you have finished you can close the comment box. You can edit your existing comment at any time by selecting it from the student dropdown menu.

Why can't I review?

Can't log in

You will need your UCL username and password to log into WISEflow. If your login credentials are not correct, you may need to reset your password via MyAccount.

If resetting your password does not resolve the issue, you can contact ISD IT Services for assistance.

If your access needs are urgent, ask your department to raise a separate ticket for you via MyServices requesting a temporary access token.

WARNING: The details of any temporary access will be sent to you in a separate email. Just like your passwords, you should never share your temporary access token with anyone!

Can’t see flows (assessments)

You may not have been given access to the flows in WISEflow. Please contact Digital Education at examinations@ucl.ac.uk and let them know which flows appear to be missing.

Can’t see student submissions or marking information

If the flow (assessment) is listed in your overview but you cannot see any students or marking information, you may not have been allocated to the correct submissions or given the correct privileges. Please contact Digital Education at examinations@ucl.ac.uk and let them know what information appears to be missing.

Need to speak to someone or having issues?

If you can't find the answer to your question in the guidance above, please raise a query via the staff support page.