Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Standard Rubric

Custom Rubric

Simple and quick to set up

More complex and can take more time to set up (but can be sped up using templates)

Does not support zero weighted criteria

Can support zero weighted criteria

Can enable optional audio and/ or written feedback for each criteria

If audio and/ or written feedback is enabled, this is compulsory to complete

Does not support decimal values

Can support decimal values

Can only calculate a rough, overall grade (which can be edited afterwards)

Can offer more granular, precise grading (which can be edited afterwards)

Can only set up a grid layout

Can be created from a variety of different question types, more versatile/ flexible appearance

Good for creating analytic rubrics

Can be used for creating analytic and holistic rubrics

Tip: Still need help deciding which type of rubric is right for you? Contact the Digital Assessment Team at assessment-advisory@ucl.ac.uk or book a drop-in session with us.

...

  1. In the rubrics area of the Authoring role, click +New Rubric.

  2. Enter a title for your rubric, optionally add a description and/ or tags. Click Next, then select Standard rubric and click Create.

    image-20241106-120026.png

  3. You will now be returned to the rubrics area where the editable shell of your standard rubric is visible. Click +Add rubric matrix and select +New.

    image-20241106-120354.png

  4. This opens the matrix editor. Criteria can be seen in rows and ratings are in the column headers. Click Adjust matrix (1) to add more criteria and ratings (2) or remove them (3) as needed.

    image-20241106-122603.png

  5. Add titles to your criteria and ratings headers (max. 100 characters).

  6. Adjust the score for each of your ratings using the input fields underneath the rating headers.

    A screenshot of the standard rubric matrix editor. The numeric fields used to assign a score to each rating are highlighted.
Info

Note: Decimal values are not supported in standard rubric scoring and the value for each rating is fixed (i.e. in this example “Fair” gives a base score of 60 and “Good” gives 70, however you cannot pick an inbetween value of 61, 62, 63, etc.).

Standard rubrics will only be able to calculate a rough overall grade for a submission; however the overall calculated grade can be overwritten with a more specific or decimal value if required.

  1. Adjust the weightings for each of your criterion using the input fields underneath the weighting column.

    A screenshot of the matrix editor for a standard rubric in WISEflow. The numeric fields used to indicate each criterion's weighting are highlighted.
Note

Important: Weightings must add up to a total of 100%. Zero weighted (0%) criteria are not supported in standard rubrics.

  1. Add descriptions for each criterion and rating (performance descriptors) in the appropriate cells (max. 1300 characters).

    image-20241106-130153.png

Tip: if you have the same or similar descriptors for a given rating across every criteria, you can use the lightning bolt button underneath each rating header to add this to all cells:

A screenshot of the matrix editor for a standard rubric in WISEflow. The lightning bolt button underneath a rating header with a description of 'Poor' is highlighted.
  1. Enable audio and/ or written feedback on your standard rubric by selecting these options from the Text and Audio columns. Cells will turn light blue when feedback is enabled.

    image-20241106-131539.png


    You can enable a space for audio or written feedback per criterion or add this only to the last criterion to have a single space for feedback at the end of the rubric. In the example above, text feedback is enabled for the first criterion and audio feedback is enabled for the second.

Tip: You can click on the Text and/ or Audio column headers to quickly enable or disable these feedback options for all criteria.

...

Category

Question type

Example uses

Notes

Multiple choice

Block UI

Select a level of performance for criteria, provide generic feedback

This could be a simple yes/no response or include a link to an external resource

Written and recorded

Audio recorder

Provide audio feedback

Written and recorded

Essay

Provide written feedback

Fill in the blanks

Fill in text with drop-down

Select a score or a generic comment from a drop-down field

If being used for scoring, this question type will likely require the use of alternative answers

Highlight

Highlight text

Create a zero weighted grid of criteria and ratings/ performance levels

It’s recommended that you edit the tokens (define highlightable content) after adding all your text. If replacing existing text, pasting as plain text (CTRL+SHIFT+V) will preserve highlightable tokens.

Other

Range scoring

Select a score

Tip: using rubric template questions can take a lot of the work out of building a custom rubric from scratch. See Rubric templates for more information.

  1. Select a question to create. In this example, a range scoring question has been used. The rubric criterion and description should be entered in the question text field and the maximum score for the question has been defined.

    image-20241107-100742.png

    Depending on which question type you select, you may have more complex scoring options or choose to set it as a practice or unscored question. Click Create question to finish.

  2. You will now see an item (page) containing your created question inside your custom rubric. The scoring of the question is visible at several points: next to the question (1), on the item header (2) and on the rubric header (3).

    A labelled screenshot of an editable custom rubric. The rubric contains 1 question worth a maximum of 15 marks, as indicated by the scoring seen next to the question and on the item and rubric headers.

  3. Continue to add questions to your custom rubric as needed either by clicking +Add content to the item to add new questions to your existing item (page) or clicking +Add an item to create a new item and question. In most cases, it is preferable to keep all of your rubric questions in a single item. You can also use the dark grey tabs at the end of each question to drag and reorder them in the rubric.

    The total number of questions in your rubric and the maximum achievable score can be seen underneath the rubric header.

    image-20241107-151031.png

Tip: You can also add text blocks without any scoring to an existing item by clicking +Add content to the item > Add text. This can be a useful way to denote different sections of the rubric on the same page (e.g. if the rubric is marking an exam that is separated into Part A and Part B), to provide additional instructions to markers or additional information to students (e.g. a reminder that grades are provisional until confirmed at a board).

image-20241107-151427.png

...

  1. In your editable rubrics area, click the grade scaler button.

    An editable rubric in WISEflow. The grade scaler button is highlighted.

  2. Select the appropriate grading scale (Pass/ Fail, Percentage or (A-F) letter grades). Pass/Fail and A-F formats have sliders that can be dragged and adjusted or have a numeric value entered into their input fields.

    image-20241106-151354.png

    The Percentage option does not require adjustment.

  3. For all options, click Save grade scaler to finish.

  4. The grade scaler button will update with a number, indicating how many types of grading scale are accommodated.

    image-20241106-151718.png

Note

Important: Making changes to a rubric after you have added a grade scaler will delete the grade scaler data (this does not impact existing published versions). It’s easy to just add a grade scaler to your editable rubric again afterwards, but aiming to make all necessary edits beforehand and adding a grade scaler as the final step before publishing will save time.

...

It is not possible to edit a published rubric. However, you can always make changes to the editable copy of your rubric and publish a new version.

Tip: making use of tags or consistent naming conventions can make it easier to keep track of the latest versions of your rubrics.

...

  1. Create a standard or custom rubric as normal. Click the option to add an item or a matrix as appropriate and then select From Content Bank.

    image-20241111-152715.png

  2. This will bring up the content bank where any pre-existing items or matrices that are available can be added to your rubric. Template content will be clearly labelled as such and you can preview any material before you select it to add to your rubric.
    For custom rubrics: the templates also list the weighting of each individual item and can be searched for by format (e.g. drop-down, mark entry, grid).

  3. For custom rubrics: use the + and - buttons to add as much content as you like, normally until the total weighting for all items is 100% (this can be ignored if the entire rubric is zero-weighted).
    For standard rubrics: use the radial button to select a matrix to add.
    In both cases: click Import to finish.

    A screenshot of the content bank for custom rubrics. There are a number of templates that have been selected and the Import button is highlighted.

Tip: for best results, avoid combining template formats in a custom rubric if the content is weighted (e.g. using a 25% drop-down question and a 30% mark entry question in the same rubric). This ensures that the rubric looks clear and consistent both to staff and students.

...