Skip to end of metadata
Go to start of metadata

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 4 Next »

Overview

You can create a rubric in WISEflow at any time, without needing to have an assessment (flow) set up first. The rubric will need to be published and then attached to a flow in order to be used by markers. Rubrics are created via the Authoring role:

A screenshot of the Author overview in WISEflow. The Authoring role and the Rubrics button are highlighted.

A labelled screenshot of the rubrics area in WISEflow.

  1. Editable rubrics.

  2. Published rubrics, which can be shared with other (staff) users and attached to flows for markers to use.

  3. The content bank, which can store different elements of rubrics to be used in future rubric creation.

  4. Import and export WISEflow rubrics.

  5. Create a new rubric.

Which kind of rubric should I use?

There are two types of rubric in WISEflow: standard and custom rubrics. The comparison table below may help you decide which is the best fit for your assessment:

Standard Rubric

Custom Rubric

Simple and quick to set up

More complex and can take more time to set up (but can be sped up using templates)

Does not support zero weighted criteria

Can support zero weighted criteria

Can enable optional audio and/ or written feedback for each criteria

If audio and/ or written feedback is enabled, this is compulsory to complete

Does not support decimal values

Can support decimal values

Can only calculate a rough, overall grade (which can be edited afterwards)

Can offer more granular, precise grading (which can be edited afterwards)

Can only set up a grid layout

Can be created from a variety of different question types, more versatile/ flexible appearance

Good for creating analytic rubrics

Can be used for creating analytic and holistic rubrics

Tip: Still need help deciding which type of rubric is right for you? Contact the Digital Assessment Team at assessment-advisory@ucl.ac.uk or book a drop-in session with us.

Creating a Standard Rubric

  1. In the rubrics area of the Authoring role, click +New Rubric.

  2. Enter a title for your rubric, optionally add a description and/ or tags. Click Next, then select Standard rubric and click Create.

    image-20241106-120026.png

  3. You will now be returned to the rubrics area where the editable shell of your standard rubric is visible. Click +Add rubric matrix and select +New.

    image-20241106-120354.png

  4. This opens the matrix editor. Criteria can be seen in rows and ratings are in the column headers. Click Adjust matrix (1) to add more criteria and ratings (2) or remove them (3) as needed.

    image-20241106-122603.png

  5. Add titles to your criteria and ratings headers (max. 100 characters).

  6. Adjust the score for each of your ratings using the input fields underneath the rating headers.

    A screenshot of the standard rubric matrix editor. The numeric fields used to assign a score to each rating are highlighted.

Note: Decimal values are not supported in standard rubric scoring and the value for each rating is fixed (i.e. in this example “Fair” gives a base score of 60 and “Good” gives 70, however you cannot pick an inbetween value of 61, 62, 63, etc.).

Standard rubrics will only be able to calculate a rough overall grade for a submission; however the overall calculated grade can be overwritten with a more specific or decimal value if required.

  1. Adjust the weightings for each of your criterion using the input fields underneath the weighting column.

    A screenshot of the matrix editor for a standard rubric in WISEflow. The numeric fields used to indicate each criterion's weighting are highlighted.

Important: Weightings must add up to a total of 100%. Zero weighted (0%) criteria are not supported in standard rubrics.

  1. Add descriptions for each criterion and rating (performance descriptors) in the appropriate cells (max. 1300 characters).

    image-20241106-130153.png

Tip: if you have the same or similar descriptors for a given rating across every criteria, you can use the lightning bolt button underneath each rating header to add this to all cells:

A screenshot of the matrix editor for a standard rubric in WISEflow. The lightning bolt button underneath a rating header with a description of 'Poor' is highlighted.
  1. Enable audio and/ or written feedback on your standard rubric by selecting these options from the Text and Audio columns. Cells will turn light blue when feedback is enabled.

    image-20241106-131539.png


    You can enable a space for audio or written feedback per criterion or add this only to the last criterion to have a single space for feedback at the end of the rubric. In the example above, text feedback is enabled for the first criterion and audio feedback is enabled for the second.

Tip: You can click on the Text and/ or Audio column headers to quickly enable or disable these feedback options for all criteria.

  1. Click Save in the lower right corner of the matrix editor to finish. You will see the shell of your standard rubric, which now contains the matrix you have built:

    An editable version of a standard rubric.

Next Steps

After creating your standard rubric, you have the following options:

  • Preview button Preview your rubric as it would appear to a marker. (Note that this does not include calculation and entry of the overall grade)

  • Edit button Edit the title, description and tags of your rubric

  • Copy button Create a copy of your rubric

  • Grade scaler button Add a grade scaler. See Adding a Grade Scaler to your rubric for more information.

  • Delete button Delete the entire rubric

You can also:

  • Edit matrix button Edit the rubric matrix

  • Add to content bank button Add the rubric matrix to your content bank.

  • Delete button Delete the rubric matrix (but keep the shell of the rubric)

Once you are satisfied with your rubric, you will need to publish it so that it can be attached to a flow (assessment) and used for marking. See Publishing and sharing your rubric for more information.

Creating a Custom Rubric

  1. In the rubrics area of the Authoring role, click +New Rubric.

  2. Enter a title for your rubric, optionally add a description and/ or tags. Click Next, then select Custom rubric and click Create.

    image-20241107-091635.png

  3. You will now be returned to the rubrics area where the editable shell of your custom rubric is visible. Click +Add an item and select +With custom question.

    A screenshot of a newly created editable custom rubric. The Add an item button and With custom question option are both highlighted.

  4. This brings up the Question editor, which contains all the same question types you would normally use to create a FLOWmulti exam.

    A screenshot of the question editor in WISEflow.

Which question(s) you choose to use in your custom rubric will depend on your criteria and how you’d like to format and design your rubric. The table below provides several options which may be useful but is not an exhaustive list:

Category

Question type

Example uses

Notes

Multiple choice

Block UI

Select a level of performance for criteria, provide generic feedback

This could be a simple yes/no response or include a link to an external resource

Written and recorded

Audio recorder

Provide audio feedback

Written and recorded

Essay

Provide written feedback

Fill in the blanks

Fill in text with drop-down

Select a score or a generic comment from a drop-down field

If being used for scoring, this question type will likely require the use of alternative answers

Highlight

Highlight text

Create a zero weighted grid of criteria and ratings/ performance levels

It’s recommended that you edit the tokens (define highlightable content) after adding all your text. If replacing existing text, pasting as plain text (CTRL+SHIFT+V) will preserve highlightable tokens.

Other

Range scoring

Select a score

Tip: using rubric template questions can take a lot of the work out of building a custom rubric from scratch. See Rubric templates for more information.

  1. Select a question to create. In this example, a range scoring question has been used. The rubric criterion and description should be entered in the question text field and the maximum score for the question has been defined.

    image-20241107-100742.png

    Depending on which question type you select, you may have more complex scoring options or choose to set it as a practice or unscored question. Click Create question to finish.

  2. You will now see an item (page) containing your created question inside your custom rubric. The scoring of the question is visible at several points: next to the question (1), on the item header (2) and on the rubric header (3).

    A labelled screenshot of an editable custom rubric. The rubric contains 1 question worth a maximum of 15 marks, as indicated by the scoring seen next to the question and on the item and rubric headers.

  3. Continue to add questions to your custom rubric as needed either by clicking +Add content to the item to add new questions to your existing item (page) or clicking +Add an item to create a new item and question. In most cases, it is preferable to keep all of your rubric questions in a single item. You can also use the dark grey tabs at the end of each question to drag and reorder them in the rubric.

    The total number of questions in your rubric and the maximum achievable score can be seen underneath the rubric header.

    image-20241107-151031.png

Tip: You can also add text blocks without any scoring to an existing item by clicking +Add content to the item > Add text. This can be a useful way to denote different sections of the rubric on the same page (e.g. if the rubric is marking an exam that is separated into Part A and Part B), to provide additional instructions to markers or additional information to students (e.g. a reminder that grades are provisional until confirmed at a board).

image-20241107-151427.png

Next Steps

After creating your custom rubric, you have the following options:

  • Preview button Preview your rubric as it would appear to a marker. (Note that this does not include calculation and entry of the overall grade)

  • Edit button Edit the title, description and tags of your rubric

  • Copy button Create a copy of your rubric

  • Grade scaler button Add a grade scaler. See Adding a Grade Scaler to your rubric for more information.

  • Delete button Delete the entire rubric

You can also:

  • image-20241111-102252.png Preview or edit a question, along with options to copy it, convert it to a new item (page), or delete it

  • Add to content bank button Add an item/ questions to your content bank

  • Delete button Delete the rubric matrix (but keep the shell of the rubric)

Once you are satisfied with your rubric, you will need to publish it so that it can be attached to a flow (assessment) and used for marking. See Publishing and sharing your rubric for more information.

Adding a Grade Scaler to your rubric

Building a grade scaler into your rubric before publishing it is optional but helps save time for the administrative teams that attach your rubrics to flows (assessments).

  1. In your editable rubrics area, click the grade scaler button.

    An editable rubric in WISEflow. The grade scaler button is highlighted.

  2. Select the appropriate grading scale (Pass/ Fail, Percentage or (A-F) letter grades). Pass/Fail and A-F formats have sliders that can be dragged and adjusted or have a numeric value entered into their input fields.

    image-20241106-151354.png

    The Percentage option does not require adjustment.

  3. For all options, click Save grade scaler to finish.

  4. The grade scaler button will update with a number, indicating how many types of grading scale are accommodated.

    image-20241106-151718.png

Important: Making changes to a rubric after you have added a grade scaler will delete the grade scaler data (this does not impact existing published versions). It’s easy to just add a grade scaler to your editable rubric again afterwards, but aiming to make all necessary edits beforehand and adding a grade scaler as the final step before publishing will save time.

Publishing and sharing your rubric

Publishing a rubric

  1. In your editable rubric, click Publish.

    A screenshot of an editable rubric in WISEflow. The Publish button is highlighted.

  2. You will be shown a preview of your rubric as it would appear to markers. You can also preview any grade scaling on a separate tab.

    A preview of a standard rubric.

  3. At the bottom of the preview page, click Approve.

    A preview of a standard rubric in WISEflow. The Approve button is highlighted.

  4. After a few seconds, a published version of your rubric will be available in the Published rubrics area. (Note: you may need to refresh the page to view this)

    A published rubric in WISEflow.

Sharing a rubric

Changing sharing settings on a rubric

By default, published rubrics are private and only visible to their creator.

  1. Click on the sharing settings for a published rubric you have created and then click Search for author.

    A screenshot of a published rubric. The sharing settings are highlighted, along with the option to search for author.

  2. Search for the user you want to share with and tick the box next to their details in the search results. You can repeat this step to search for and select multiple users before you share the rubric.

    A screenshot of sharing options for a published rubric. A box next to a user's details is ticked.

  3. Click Share with selected to finish.

    A screenshot of sharing options for a published rubric. The Share with selected button is highlighted.

    The published rubric will now be available to the selected users in their published rubrics area.

You can continue to add or remove people from the shared list of users by repeating these steps.

Sharing rubrics via a reference code (with Managers only)

All published rubrics have a unique 8 digit reference code.

A screenshot of a published rubric. The 8 digit code underneath the rubric title is highlighted.

You can click on this code to copy it to your clipboard. Rubric reference codes can be provided to users with Manager access, who can attach it to a flow even if the rubric has not been shared with them in WISEflow.

Editing a published rubric

It is not possible to edit a published rubric. However, you can always make changes to the editable copy of your rubric and publish a new version.

Tip: making use of tags or consistent naming conventions can make it easier to keep track of the latest versions of your rubrics.

If you are not the owner of the rubric but it has been shared with you, you can still make an editable copy. See Copying an existing published rubric for more information.

Using rubric templates or copying an existing published rubric

Rubric templates

  1. Create a standard or custom rubric as normal. Click the option to add an item or a matrix as appropriate and then select From Content Bank.

    image-20241111-152715.png

  2. This will bring up the content bank where any pre-existing items or matrices that are available can be added to your rubric. Template content will be clearly labelled as such and you can preview any material before you select it to add to your rubric.
    For custom rubrics: the templates also list the weighting of each individual item and can be searched for by format (e.g. drop-down, mark entry, grid).

  3. For custom rubrics: use the + and - buttons to add as much content as you like, normally until the total weighting for all items is 100% (this can be ignored if the entire rubric is zero-weighted).
    For standard rubrics: use the radial button to select a matrix to add.
    In both cases: click Import to finish.

    A screenshot of the content bank for custom rubrics. There are a number of templates that have been selected and the Import button is highlighted.

Tip: for best results, avoid combining template formats in a custom rubric if the content is weighted (e.g. using a 25% drop-down question and a 30% mark entry question in the same rubric). This ensures that the rubric looks clear and consistent both to staff and students.

  1. For custom rubrics: your selected content will have been added to the rubric as separate items (pages). To combine them all into a single item, scroll down to the bottom of your rubric and tick the checkbox to select all items. From the Actions drop-down that appears, choose Merge the selected items to a single item.

    An editable custom rubric with lots of separate items. All items have been selected and the option to merge them into a single item has been highlighted.

  2. You can now edit the template and add your own written content to it as normal.

Copying an existing published rubric

  1. In the Published rubrics area, find the rubric you want to copy. Click the burger button on the right and select Make a copy to edit from the list of actions.

    A screenshot of the published rubics area in the Authoring role. The burger button on a published rubric has been highlighted, along with the option to make an editable copy.

  2. You will now have an editable copy of this rubric in your editable rubrics area.

    image-20241106-150130.png

Deleting a published rubric

You cannot delete a published rubric if it has been attached to a flow for marking. If the rubric was only published recently and has not been used yet, it may be possible for a Manager to remove the rubric from the flow first - the original creator of the rubric can then delete it via the Authoring role.

If it is not possible to remove the published rubric from any flow(s) it was attached to (e.g. because marking is underway or has already finished), these alternatives may be helpful:

  1. Click the sharing settings of the rubric and select Remove sharing from all so that it is private and other users can no longer access or attach it.

    image-20241106-231734.png

  2. Click the burger button on the rubric and select the option to Hide it.

    A screenshot of a published rubric in WISEflow. The burger button and option to hide the rubric are highlighted.

    The rubric will initially be greyed out but will no longer display in your list of published rubrics when the webpage is refreshed. Hidden rubrics can be shown again by clicking the filtering button and selecting the Hidden option.

    A screenshot of the published rubrics area. The filtering button and option to display hidden rubrics are highlighted.

    A hidden rubric can be made to display in your published rubrics list again by clicking the burger button and selecting the Show option.

  • No labels