Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Using PeerMark - guidance for staff

Contents

Table of Contents
minLevel2

...

In the 'Peermark Assignment' tab of the PeerMark Manager you enter basic information about the activity.

Title

This will appear for students and should be distinctive and descriptive.

Point value (required)

The marks available for the peer review itself - i.e. not for the reviewed work. This reflects research findings that asking students to assign numeric marks to their peers exacerbates any sense of risk and brings undue complications and pressure to peer review without bringing any particular learning benefits.

Instructions to students

Brief guidance about what students should do and why.

Start date, Due date, Post date

 

Info
titleAdvice

Although ther is no linking between the Peermark dates and the 'parent' Turnitin assignment dates, ELE recommend that you set the start date of the Peermark Assignment AFTER the due date of the Turnitin assignment. This avoids the situation where a student can re-submit a paper that has alreadt received a peer review.

 

Make sure you click the 'Save & Continue' button to proceed to the next tab.


 

Info

Considerations

Instructions. Students tend to prefer tutor marking, and may assume that there is a correct mark for their work which is not open to interpretation (McConlogue, 2012). Most researchers into peer assessment (including Bloxham and West, 2007; McConologue, 2014; Nicol, 2010; Orsmond, 2004; Topping, 2009) stress the need to involve students in discussing - and ideally negotiating - the yardstick against which they will measure themselves and others, rather than relying on textual instructions alone. They recommend discussing the rationale, criteria and expectations for peer and/or self review before, during and after the activity. Discussing or negotiating expectations could clarify how much time students were expected to spend on each review and indicate how much feedback should be given, which will help even out the quality and quantity of peer feedback and avoid perceptions of unfairness (Cartney, 2010).

Dates.The fact that PeerMark is for formative feedback only raises possibilities for students reviewing draft work at an early relatively unpolished stage which remains open to rewriting on the basis of feedback (Colvill, 2010). In which case, set the Feedback Release Date to allow time for students to make changes in advance of their final credit-bearing submission. The time allowance for the PeerMark activity (i.e. between Start Date and Due Date) should reflect the time students are expected to spend, and allow for their other commitments.

 

 

PeerMark Assigment - Additional Settings

On the 'Peermark Assignment' tab there is a link for additional settings. Here's some explanation for the less obvious ones.

'Award full points if review is written' 

If ticked this means tutors will not be able to mark the reviews and a student will need to meet set requirements for every part of the review in order to get the available marks, on an all-or-nothing basis. If unticked, tutors can assign and differentiate marks for each student's review. 

'Allow students to view author and reviewer names'

If left unticked, you probably need to remind students not to put any identifying information in the title, filename, or body of their work.

'Paper(s) automatically distributed by Peermark'

This sets the number of randomly allocated papers each student has to review.

'Papers(s) selected by the student'

This sets the number of papers a student can choose to review. Students can review a combination of allocated and selected papers.

'Require self-review'

If checked, a student has to review their own paper. It isn't currently possible to select self review only - the number allocated by PeerMark has to be at least one.

Info

Considerations

Award full points if the review is written. Where this all-or-nothing setting is deployed as an incentive to participate, keep in mind the importance of dialogue at all stages.

Allow students to view author and reviewer names. Setting the peer review to be anonymous will prevent friendship, enmity or power processes determining the review and forestall collusion. Clear criteria and an ethos which encourages mutual constructive criticism while discouraging platitudes are other measures to allay the social comfort students may feel about commenting on others' work. It may be necessary work out with students a convention for referencing each others' work in the absence of names, should they want to do so.

Allow submitters to read all papers after the Start Date. As well as allowing students to compare different work, this allows students to select work to review, if this has been enabled in the settings.

Allow students to read ALL papers and ALL reviews after the Feedback Release Date. Again, this communicates to students that they are welcome and encouraged to benchmark both their submissions and their reviews, and opens up the possibility of conversations which outlast the PeerMark activity.

Distribution of papers. Keep in mind boredom, tiredness and time pressures when deciding how many submissions each student should review. Falchikov and Goldfinch (2009) found that larger numbers of reviewers did not bring any validity gains and may reduce reliability due to the 'diffusion of responsibility effect' whereby students are less likely to perceive their own review as mattering. (Falchikov and Goldfinch were comparing peer and tutor marks rather than feedback, though).

Require self-review. Since one of the aims of peer-assessment is to help students use the criteria in their own work, self-review is likely to be a helpful exercise. However, it may pose a distinct idiosyncratic or cultural set of complications related to self-esteem, self-confidence, modesty, and how students habitually estimate their own ability (Saito and Fujita, 2004). For this reason PeerMark requires at least one peer review, whether or not there is a self review.

 

...

In the 'Distribution' tab of the PeerMark Manager you can see all the student accounts associated with this assignment and how they will be allocated reviews. If you want to, this is where you can get involved with who reviews whose work.

If you can't see all the accounts you are expecting, click outside of the Peermark Manager to return to your Turnitin assignment page; then click its 'Turnitin Students' tab. From there you can click 'Enrol all students', which will bring in all students 'enrolled' in that Moodle course area.

 

If you need to exempt student from the PeerMark activity, you can exclude them by clicking their adjacent red Minus icon; their name displays greyed-out and they gain a green Plus icon, which you can click if you need to reinstate them.

If you want to pair students (so that a particular student is allocated the work of another particular student to review, overriding any other distribution settings) you can do so by clicking the blue Plus icon and then selecting a student to pair with from the dropdown list. Paired students are then required to review the work they are allocated.

Info

Considerations.

Does it matter which students review which other students' work? Tutors may want to connect students on the basis of interest. As well as matching students through PeerMark, another way to achieve this is to set up groups in your Moodle area and apply these to the Turnitin assignment. Alternatively, PeerMark has the option of letting students choose the work they review (though this introduces the possibility that some students will receive more feedback than others - usually contentious).

 

 

 

Accessing Peermark reviews

In the 'Submission Inbox' you can see details of all the PeerMark assignments set up for that Turnitin assignment.

Click on the 'Launch Peermark Reviews' icon

If there is more than one Peermark assignment set up for this Turnitin assignment you can select the one you want .

The 'Reviews' tab shows you a list of the students.

Students that have submitted a paper will have an icon next to them under the 'Review' column. The 'Received' column shows how many reviews a student's submission has received.The 'Submitted' column shows how many reviews a student has submitted. Clicking on the numbers with a grey background takes you to either the 'Received Reviews' or the 'Submitted Reviews' tab, and from there, clicking on the blue 'tick' icon launches the document viewer.

Tutors can also write reviews. Clicking on the blue 'Write instructor review' icon in the 'Review' column allows you to write an additional review as the assignment tutor. Can reviewed students distinguish the tutor review?

If you have left a review for a submission it will display a green 'Edit instructor review' icon.

 

 

 

The document viewer

At the top of the document you will see details of which paper you are viewing, and which student has reviewed it.

On the right hand column you will see a column with two tabs.
The questions tab shows you all the questions you set up for this PeerMark assignment, plus the reviewers answers.
The comments tab will show any comments if the reviewer has added them.

 

 

 

Marking reviews

Once the due date has passed, you can go into the document viewer for a particular review and enter a grade in the in the top right of the screen.

HOW are grades released????

 

...