Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Guidance for staff

Note
titleWarning

17th Sep 2015 - at the current time we do not recommend using PeerMark due to an unresolved bug where the PeerMark reviews summary page and the downloadable excel spreadsheet don't reflect actual numbers of reviews received/submitted. ELE are investigating a resolution. Meanwhile, apologies for this.

 

Contents

Table of Contents
minLevel2

...

First set up your Turnitin assignment as normal.

 

In the Submission inbox for your assignment, click on the 'Launch Peermark Manager' icon

Image RemovedImage to come - green cog.

If this is your first PeerMark assignment you can click on the 'create a new Create PeerMark assignment' linkAssignment' (Plus - icon).
Otherwise you can use the green 'plus' icon at the top left of the window; a settings screen displays.

Image RemovedImage to come

 

PeerMark Assignment settings

In the 'Peermark Assignment' tab of the PeerMark Manager you enter basic information about the activity.

Title

This will appear

- displays for students and should be distinctive and descriptive.

Point value (required)

This

- Turnitin PeerMark requires students to give feedback only i.e. no numeric mark from students, so Point Value refers to the number of marks available for the

peer

review itself

- i.e. not for the reviewed work. This reflects research findings that asking students to assign numeric marks to their peers exacerbates a sense of risk, causes anxiety and sometimes resentment, and brings undue complications and pressure to peer review without bringing any particular learning benefits.

Instructions to students

Brief guidance about what students should do and why.

Start date, Due date, Post date

 .

Instructions to students - brief guidance about what students should do and why.

Start date,

Due date,

Feedback release date

Then click Additional Settings.

  • Award fulll points if review is written -
  • Allow students to view author and reviewer names -
  • Allow students without a paper to review -
  • Allow submitters to read ALL papers after Start date -
  • All students to read ALL papers and ALL reviews after feedback release date -
  • Papers automatically distributed by PeerMark - by default this is just 1.
  • Papers selected by the student -
  • Require self-review -

Make sure you click the 'Save & Continue' button to proceed to the next tab.

Info
titleAdvice

Although there is no linking between the Peermark dates and the 'parent' Turnitin assignment dates, ELE recommend that you set the start date of the Peermark Assignment AFTER the due date of the Turnitin assignment. This avoids the situation where a student can re-submit a paper that has alreadt received a peer review.

...

On the 'Peermark Assignment' tab there is a link for additional settings. Here's some explanation for the less obvious ones.

'Award full points if review is written' 

If ticked this means tutors will not be able to mark the reviews and a student will need to meet set requirements for every part of the review in order to get the available marks, on an all-or-nothing basis. If unticked, tutors can assign and differentiate marks for each student's review.  

'Allow students to view author and reviewer names'

If left unticked, you probably need to remind students not to put any identifying information in the title, filename, or body of their work.

'Paper(s) automatically distributed by Peermark'

This sets the number of randomly allocated papers each student has to review.

'Papers(s) selected by the student'

This sets the number of papers a student can choose to review. Students can review a combination of allocated and selected papers.

'Require self-review'

If checked, a student has to review their own paper. It isn't currently possible to select self review only - the number allocated by PeerMark has to be at least one.

...

References

  • Bloxham, S., & West, A. (2007). Learning to write in higher education: students’ perceptions of an intervention in developing understanding of assessment criteria. Teaching in Higher Education, 12(1), 77–89.
  • Cartney, P. (2010). Exploring the use of peer assessment as a vehicle for closing the gap between feedback given and feedback used. Assessment & Evaluation in Higher Education, 35(5), 551–564. 
  • Covill, A. (2010). Comparing Peer Review and Self-Review as Ways to Improve College Students’ Writing. Journal of Literacy Research, 42(2), 199–226.
  • Falchikov, N., & Goldfinch, J. (2000). Student Peer Assessment in Higher Education: A Meta-Analysis Comparing Peer and Teacher Marks. Review of Educational Research, 70(3), 287–322.
  • McConlogue, T. (2012). But is it fair? Developing students’ understanding of grading complex written work through peer assessment. Assessment & Evaluation in Higher Education, 37(1), 113–123.
  • M.cConlogue, T. (2014). Making judgements: investigating the process of composing and receiving peer feedback. Studies in Higher Education, 1–12. 
  • Milne, R., (2013). Peer review of virology essays. Available from: https://www.ucl.ac.uk/teaching-learning/case-studies-news/assessment-feedback/peer-review-of-virology-essays
  • Nicol, D., (2007). Peer Evaluation in Assessment Review project. Available from http://www.reap.ac.uk/PEER.aspx
  • Nicol, D., (2010). From monologue to dialogue: improving written feedback processes in mass higher education. Assessment & Evaluation in Higher Education, 35(5), 501–517.
  • Orsmond, P. (2004). Self- and peer-assessment: guidance on practice in the biosciences. Leeds: Centre for Bioscience, Higher Education Academy.
  • Sadler, D. (2010) Beyond feedback: developing student capability in complex appraisal. Assessment & Evaluation in Higher Education, 35(5), 535-550.

  • Saito, H., & Fujita, T. (2004). Characteristics and user acceptance of peer rating in EFL writing classrooms. Language Teaching Research, 8(1), 31–54..
  • Schommer, M. (1990). Effects of beliefs about the nature of knowledge on comprehension. Journal of Educational Psychology, 82(3), 498–504.
  • Sorensen, E. (2013). Experiences of using peer assessment in a 4th year design module. Available from:  http://www.ucl.ac.uk/teaching-learning/case-studies-news/assessment-feedback/peer-assessment-chemical-engineering
  • Topping, K. J. (2009). Peer Assessment. Theory Into Practice, 48(1), 20–27.
  • Yorke, M. (2003). Formative assessment in higher education: moves towards theory and the enhancement of pedagogic practice. Higher Education, 45, 477–501.