Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Clarified some settings; added some case studies

...

...

...

...

...

...

...

...

...

...

...

...

...

...

...

...

Using PeerMark - guidance for staff

Contents

Table of Contents
minLevel2

...

Info
Edinburgh University has made a number of PeerMark case studies  available, including the experiences and thinking of staff setting up peer assessment for the first time. Nb you may need to allow the media in your web browser security settings. For general design principles and case studies of peer assessment / peer review, see the University of Strathclyde's PEER Toolkit.

 

Setting up a new PeerMark Assignment

...

The 'PeerMark Questions' tab of the PeerMark Manager allows you create the questions you want the peer reviewers to answer. To add a question, click 'Add question'

Enter your question text, the question type. There are two types of question you can use;
a 'Free Response' question - for example "What is the thesis of the paper?" and a 'Scale' question – for example "How well does the introduction pull you in as a reader? Scale, Not very well to
Really well"

 

For a 'Free response' question, enter the minimum answer length (this counts words).

For a 'Scale' question, enter the scale size and the lowest and highest values

You can also use libraries to manage your Peermark questions. Clicking on Library Settings allows you to create and delete libraries, and to save and retrieve questions from those libraries. There is also a 'Sample Library' which you can add pre-made questions from.

 

Short ped considerationsConsiderations

 

 

 

Distribution

In the 'Distribution' tab of the PeerMark Manager you can see all the student accounts associated with this assignment and how they will be allocated reviews. If you want to, this is where you can get involved with who reviews whose work.

If you can't see all the accounts you are expecting, click outside of the Peermark Manager to return to your Turnitin assignment page; then click its 'Turnitin Students' tab. From there you can click 'Enrol all students', which will bring in all students 'enrolled' in that Moodle course area.

 

If you need to exempt student from the PeerMark activity, you can do so exclude them by clicking their adjacent red minus icon. Similarly you can add exempted students by clicking their green plus iconMinus icon; their name displays greyed-out and they gain a green Plus icon, which you can click if you need to reinstate them.

If you want to pair students (so that a particular student is allocated the work of another particular student to review, overriding any other distribution settings) you can do so by clicking the blue plus Plus icon and then selecting a student to pair with from the dropdown list. Paired students are then required to review the work they are allocated.

Note

Please note that after reviewing has started you won't be able to pair students - so be sure to do make any allocations in advance.

 

 

...

On the 'Peermark Assignment' tab there is a link for additional settings. Here's some explanation of the less obvious ones.

'Award full points if review is written' 

If ticked this means tutors will not be able to mark the reviews and a student will need to meet set requirements for every part of the review in order to get the available marks, on an all-or-nothing basis. If unticked, tutors can assign and differentiate marks for each student's review. 

'Allow students to view author and reviewer names'

If left unticked, you probably need to remind students not to put any identifying information in the title, filename, or body of their work.

'Paper(s) automatically distributed by Peermark'

This sets the number of randomly allocated papers each student has to review.

'Papers(s) selected by the student'

This sets the number of papers a student can choose to review. Students can review a combination of allocated and selected papers.

'Require self-review'

If checked, a student has to review their own paper before they can review anyone else's. It isn't currently possible to select self review only - the number allocated by PeerMark has to be at least one.

 

 

 

Accessing Peermark reviews

In the 'Submission Inbox' you can see details of all the PeerMark assignments set up for that Turnitin assignment.

Click on the 'Launch Peermark Reviews' icon

If there is more than one Peermark assignment set up for this Turnitin assignment you can select the one you want .

The 'Reviews' tab shows you a list of the students.

Students that have submitted a paper will have an icon next to them under the 'Review' column. The 'Received' column shows how many reviews a student's submission has received.The 'Submitted' column shows how many reviews a student has submitted. Clicking on the numbers with a grey background takes you to either the 'Received Reviews' or the 'Submitted Reviews' tab, and from there, clicking on the blue 'tick' icon launches the document viewer.

 

Tutors can also write reviews. Clicking on the blue 'Write instructor review' icon in the 'Review' column allows you to write an additional review as the assignment tutor.

If you have left a review for a submission it will show display a green 'Edit instructor review' icon.

 

 

 

The document viewer

At the top of the document you will see details of which paper you are viewing, and which student has reviewed it.

On the right hand column you will see a column with two tabs.
The questions tab shows you all the questions you set up for this PeerMark assignment, plus the reviewers answers.
The comments tab will show any comments if the reviewer has added them.

 

 

...