Creating a rubric

Overview

You can create a rubric in WISEflow at any time, without needing to have an assessment (flow) set up first. The rubric will need to be published and then attached to a flow in order to be used by markers. Rubrics are created via the Authoring role:

A screenshot of the Author overview in WISEflow. The Authoring role and the Rubrics button are highlighted.

 

A labelled screenshot of the rubrics area in WISEflow.
  1. Editable rubrics.

  2. Published rubrics, which can be shared with other (staff) users and attached to flows for markers to use.

  3. The content bank, which can store different elements of rubrics to be used in future rubric creation.

  4. Import and export WISEflow rubrics.

  5. Create a new rubric.

Which kind of rubric should I use?

There are two types of rubric in WISEflow: standard and custom rubrics. The comparison table below may help you decide which is the best fit for your assessment:

Standard Rubric

Custom Rubric

Standard Rubric

Custom Rubric

Simple and quick to set up

More complex and can take more time to set up (but can be sped up using templates)

Does not support zero weighted criteria

Can support zero weighted criteria

Can enable optional audio and/ or written feedback for each criteria

If audio and/ or written feedback is enabled, this is compulsory to complete

Does not support decimal values

Can support decimal values

Can only calculate a rough, overall grade (which can be edited afterwards)

Can offer more granular, precise grading (which can be edited afterwards)

Can only set up a grid layout

Can be created from a variety of different question types, more versatile/ flexible appearance

Good for creating analytic rubrics

Can be used for creating analytic and holistic rubrics

Tip: Still need help deciding which type of rubric is right for you? Contact the Digital Assessment Team at assessment-advisory@ucl.ac.uk or book a drop-in session with us.

Creating a Standard Rubric

  1. In the rubrics area of the Authoring role, click +New Rubric.

  2. Enter a title for your rubric, optionally add a description and/ or tags. Click Next, then select Standard rubric and click Create.

     

  3. You will now be returned to the rubrics area where the editable shell of your standard rubric is visible. Click +Add rubric matrix and select +New.

  4. This opens the matrix editor. Criteria can be seen in rows and ratings are in the column headers. Click Adjust matrix (1) to add more criteria and ratings (2) or remove them (3) as needed.

  5. Add titles to your criteria and ratings headers (max. 100 characters).

  6. Adjust the score for each of your ratings using the input fields underneath the rating headers.

Note: Decimal values are not supported in standard rubric scoring and the value for each rating is fixed (i.e. in this example “Fair” gives a base score of 60 and “Good” gives 70, however you cannot pick an inbetween value of 61, 62, 63, etc.).

Standard rubrics will only be able to calculate a rough overall grade for a submission; however the overall calculated grade can be overwritten with a more specific or decimal value if required.

  1. Adjust the weightings for each of your criterion using the input fields underneath the weighting column.

Important: Weightings must add up to a total of 100%. Zero weighted (0%) criteria are not supported in standard rubrics.

  1. Add descriptions for each criterion and rating (performance descriptors) in the appropriate cells (max. 1300 characters).

  1. Enable audio and/ or written feedback on your standard rubric by selecting these options from the Text and Audio columns. Cells will turn light blue when feedback is enabled.


    You can enable a space for audio or written feedback per criterion or add this only to the last criterion to have a single space for feedback at the end of the rubric. In the example above, text feedback is enabled for the first criterion and audio feedback is enabled for the second.

  1. Click Save in the lower right corner of the matrix editor to finish. You will see the shell of your standard rubric, which now contains the matrix you have built:

Next Steps

After creating your standard rubric, you have the following options:

  • Preview button Preview your rubric as it would appear to a marker. (Note that this does not include calculation and entry of the overall grade)

  • Edit button Edit the title, description and tags of your rubric

  • Copy button Create a copy of your rubric

  • Grade scaler button Add a grade scaler. See Adding a Grade Scaler to your rubric for more information.

  • Delete button Delete the entire rubric

You can also:

  • Edit matrix button Edit the rubric matrix

  • Add to content bank button Add the rubric matrix to your content bank.

  • Delete button Delete the rubric matrix (but keep the shell of the rubric)

Once you are satisfied with your rubric, you will need to publish it so that it can be attached to a flow (assessment) and used for marking. See Publishing and sharing your rubric for more information.

 

Creating a Custom Rubric

  1. In the rubrics area of the Authoring role, click +New Rubric.

  2. Enter a title for your rubric, optionally add a description and/ or tags. Click Next, then select Custom rubric and click Create.

  3. You will now be returned to the rubrics area where the editable shell of your custom rubric is visible. Click +Add an item and select +With custom question.

  4. This brings up the Question editor, which contains all the same question types you would normally use to create a FLOWmulti exam.

Which question(s) you choose to use in your custom rubric will depend on your criteria and how you’d like to format and design your rubric. The table below provides several options which may be useful but is not an exhaustive list:

Category

Question type

Example uses

Notes

Category

Question type

Example uses

Notes

Multiple choice

Block UI

Select a level of performance for criteria, provide generic feedback

This could be a simple yes/no response or include a link to an external resource

Written and recorded

Audio recorder

Provide audio feedback

 

Written and recorded

Essay

Provide written feedback

 

Fill in the blanks

Fill in text with drop-down

Select a score or a generic comment from a drop-down field

If being used for scoring, this question type will likely require the use of alternative answers

Highlight

Highlight text

Create a zero weighted grid of criteria and ratings/ performance levels

It’s recommended that you edit the tokens (define highlightable content) after adding all your text. If replacing existing text, pasting as plain text (CTRL+SHIFT+V) will preserve highlightable tokens.

Other

Range scoring

Select a score

 

  1. Select a question to create. In this example, a range scoring question has been used. The rubric criterion and description should be entered in the question text field and the maximum score for the question has been defined.

    Depending on which question type you select, you may have more complex scoring options or choose to set it as a practice or unscored question. Click Create question to finish.

  2. You will now see an item (page) containing your created question inside your custom rubric. The scoring of the question is visible at several points: next to the question (1), on the item header (2) and on the rubric header (3).

  3. Continue to add questions to your custom rubric as needed either by clicking +Add content to the item to add new questions to your existing item (page) or clicking +Add an item to create a new item and question. In most cases, it is preferable to keep all of your rubric questions in a single item. You can also use the dark grey tabs at the end of each question to drag and reorder them in the rubric.

    The total number of questions in your rubric and the maximum achievable score can be seen underneath the rubric header.

Next Steps

After creating your custom rubric, you have the following options:

  • Preview button Preview your rubric as it would appear to a marker. (Note that this does not include calculation and entry of the overall grade)

  • Edit button Edit the title, description and tags of your rubric

  • Copy button Create a copy of your rubric

  • Grade scaler button Add a grade scaler. See Adding a Grade Scaler to your rubric for more information.

  • Delete button Delete the entire rubric

You can also:

  • image-20241111-102252.png Preview or edit a question, along with options to copy it, convert it to a new item (page), or delete it

  • Add to content bank button Add an item/ questions to your content bank

  • Delete button Delete the rubric matrix (but keep the shell of the rubric)

Once you are satisfied with your rubric, you will need to publish it so that it can be attached to a flow (assessment) and used for marking. See Publishing and sharing your rubric for more information.

Adding a Grade Scaler to your rubric

Building a grade scaler into your rubric before publishing it is optional but helps save time for the administrative teams that attach your rubrics to flows (assessments).

  1. In your editable rubrics area, click the grade scaler button.

  2. Select the appropriate grading scale (Pass/ Fail, Percentage or (A-F) letter grades). Pass/Fail and A-F formats have sliders that can be dragged and adjusted or have a numeric value entered into their input fields.

    The Percentage option does not require adjustment.

  3. For all options, click Save grade scaler to finish.

  4. The grade scaler button will update with a number, indicating how many types of grading scale are accommodated.

 

Publishing and sharing your rubric

Publishing a rubric

  1. In your editable rubric, click Publish.

  2. You will be shown a preview of your rubric as it would appear to markers. You can also preview any grade scaling on a separate tab.

     

  3. At the bottom of the preview page, click Approve.

  4. After a few seconds, a published version of your rubric will be available in the Published rubrics area. (Note: you may need to refresh the page to view this)

Sharing a rubric

Changing sharing settings on a rubric

By default, published rubrics are private and only visible to their creator.

  1. Click on the sharing settings for a published rubric you have created and then click Search for author.

  2. Search for the user you want to share with and tick the box next to their details in the search results. You can repeat this step to search for and select multiple users before you share the rubric.

  3. Click Share with selected to finish.

    The published rubric will now be available to the selected users in their published rubrics area.

You can continue to add or remove people from the shared list of users by repeating these steps.

Sharing rubrics via a reference code (with Managers only)

All published rubrics have a unique 8 digit reference code.

You can click on this code to copy it to your clipboard. Rubric reference codes can be provided to users with Manager access, who can attach it to a flow even if the rubric has not been shared with them in WISEflow.

Editing a published rubric

It is not possible to edit a published rubric. However, you can always make changes to the editable copy of your rubric and publish a new version.

If you are not the owner of the rubric but it has been shared with you, you can still make an editable copy. See Copying an existing published rubric for more information.

Using rubric templates or copying an existing published rubric

Rubric templates

  1. Create a standard or custom rubric as normal. Click the option to add an item or a matrix as appropriate and then select From Content Bank.

  2. This will bring up the content bank where any pre-existing items or matrices that are available can be added to your rubric. Template content will be clearly labelled as such and you can preview any material before you select it to add to your rubric.
    For custom rubrics: the templates also list the weighting of each individual item and can be searched for by format (e.g. drop-down, mark entry, grid).

  3. For custom rubrics: use the + and - buttons to add as much content as you like, normally until the total weighting for all items is 100% (this can be ignored if the entire rubric is zero-weighted).
    For standard rubrics: use the radial button to select a matrix to add.
    In both cases: click Import to finish.

  1. For custom rubrics: your selected content will have been added to the rubric as separate items (pages). To combine them all into a single item, scroll down to the bottom of your rubric and tick the checkbox to select all items. From the Actions drop-down that appears, choose Merge the selected items to a single item.

  2. You can now edit the template and add your own written content to it as normal.

Copying an existing published rubric

  1. In the Published rubrics area, find the rubric you want to copy. Click the burger button on the right and select Make a copy to edit from the list of actions.

  2. You will now have an editable copy of this rubric in your editable rubrics area.

Deleting a published rubric

You cannot delete a published rubric if it has been attached to a flow for marking. If the rubric was only published recently and has not been used yet, it may be possible for a Manager to remove the rubric from the flow first - the original creator of the rubric can then delete it via the Authoring role.

If it is not possible to remove the published rubric from any flow(s) it was attached to (e.g. because marking is underway or has already finished), these alternatives may be helpful:

  1. Click the sharing settings of the rubric and select Remove sharing from all so that it is private and other users can no longer access or attach it.

  2. Click the burger button on the rubric and select the option to Hide it.

    The rubric will initially be greyed out but will no longer display in your list of published rubrics when the webpage is refreshed. Hidden rubrics can be shown again by clicking the filtering button and selecting the Hidden option.

    A hidden rubric can be made to display in your published rubrics list again by clicking the burger button and selecting the Show option.