M22 - Questionnaire

Keywords: survey, student feedback, module, programme, lecture

What is it?

Moodle questionnaires enable staff to obtain anonymous feedback from students. To help with consistency and reduce repetitive tasks template questionnaires to be constructed and deployed across any number of modules.

Why use it?

Responses are available electronically and can be downloaded to excel and shared amongst staff. Compared to hand-written feedback, there is no delay in getting feedback, it is legible and it doesn't require someone to spend time transferring the hand-written results into an electronic format.

Who can use it?

• Students can respond to questionnaires.
• Staff can create, edit and view responses of questionnaires (unless a public questionnaire is used, in which case only staff on the course where the questionnaire originates can edit it and see the responses).

Before I start...

Decide whether you will use a Quesionnaire or a Feedback activity.

Questionnaires:

• allow students to save and resume answering later.
• can collate feedback into a single questionnaire, meaning an entire programme can collate student responses in one place.

The Feedback activity:

• can automatically insert information about the course into the responses.
• has better anonymity, however, there are ways to make Questionnaire responses anonymous too. See Caution below.

Decide the type of Questionnaire you want to create

If you would like to use a Questionnaire, there are three questionnaire types which define how response data is collated and who can edit and view responses. Decide which best meets your needs:

1. Publicquestionnairesmay be used across multiple Moodle courses and the responses are returned to the Moodle course where the questionnaire originates. Students within the Moodle course where the public questionnaire is created cannot answer and only those staff on the course where it originates can view the responses.
   If you construct a public questionnaire template remember all UCL Moodle editors will see it so it's best to give it an unambiguous title to prevent other users inadvertently using it – e.g. 'feedback questionnaire' is too vague – 'Module feedback for all 1st Year ChemXXXX courses' is better.
2. Templatequestionnaires can be copied to any number of courses and then redefined in the course as a Privatequestionnaire.
3. Privatequestionnaires allow course owners and administrators to see the data collated and also tailor the questions to a specific module or programme. This is useful where some new activities/resources have been introduced to a specific module and tutors are keen to get feedback on these. One disadvantage is that Private questionnaires make it harder (but not impossible) to collate and analyse data across a number of modules. This can be done by exporting each questionnaire's feedback to excel and collating manually. We recommend using this type of questionnaire when undertaking individual module feedback.

Meeting the baseline

The UCL E-Learning Baseline suggests the following for Quality Assurance:

• 10.1 Students can evaluate the module anonymously, including its online elements, e.g. via an End of module questionnaire.
• 10.2 All stakeholders, including tutors, administrators and support staff, can contribute to the module/programme evaluation, including its online elements, at regular intervals (e.g. yearly, or at major reviews).

How do I set one up?

1. Add a questionnaire

1. To add a new questionnaire, click the Turn editing on button in the top-right of your page.
2. In the topic area where you wish the questionnaire to appear, choose Questionnaire from the Add an activity drop down menu.
3. Fill in the Name field which is compulsory. We recommend adding information to the Description field.
4. Set the dates in the Timing section which is when the questionnaire will be available to students. You should only use the dates in the Restrict access area if you want to impose activity completion on the question. For instructions on how to do this, please see M34 - Activity completion

5. Respondent Type: full name or anonymous.

6. Students can view ALL responses: after answering the questionnaire, after the questionnaire is closed, or always.

7. Allow branching questions: Choose yes if you want one the answer from one question to determine whether the following question is asked or not (they must be on separate pages).

8. Save/Resume answers: Choose yes if you want to allow students to save and then resume later (recommended for long questionnaires).

9. Auto numbering: choose whether to auto-number the questions and/or pages.

10. Submission grade: if you want to assign a grade for completing the questionnaire select this here - the default is no grade.

11. Under content options you can choose to use:
    1.  an existing public questionnaire (all results from other courses will feedback to this);
    2. a template, which you can personalise for your course; or
    3. create a new empty questionnaire. For the latter leave the 'create new' radio button selected. If in doubt choose this option.
12. The remaining settings are standard across Moodle activities.
    • If you need more information regarding the meaning of each choice then click on the associated question mark on the Moodle questionnaire setup page.

13. At the bottom of the page click Save and display.

2. Configure the questionnaire type.

1. Click on the Advanced settings tab to take you to the Questionnaires settings page.
2. Choose the relevant Questionnaire Type:
   • Private. This will ensure the questionnaire will be available to your students.
   • If you choose Template students in this course will not be able to respond, but it can be added to other Moodle courses for students to answer. This is useful for providing a uniform questionnaire across multiple courses within a department, while still enabling staff to tweak the survey for their own course. 
   • The Public option is used to allow questionnaires in other Moodle courses to be linked to this one, so all the data feeds back into the Public questionnaire.
3. **Note: if you are using a Public questionnaire (rather than creating a new questionnaire), you will not be able to select a questionnaire type.

3. Add questions (if relevant).

If you are using an existing public questionnaire you will not be able to add or edit questions, but if you are creating a new public, private or template questionnaire you can edit or add questions.

1. To add questions go to the Administration Block
   Select Questions
   Select Question Bank
   Select Create a New Question
2. Choose the type of question you would like to ad from the drop-down menu. The most common question types are:
   1. Essay Box - allows students to submit multiple lines of text (good for obtaining general feedback).
   2. Text Box - allows students to submit a single line of text (good for names, email addresses etc.)'click on Questions in the Administration block menu
   3. Radio buttons - allows students to choose a single response from multiple options.
   4. Check boxes - allows students to choose multiple responses from multiple options.
   5. For details on the other question types click the question mark icon alongside Question.

4. Preview the questionnaire.

1. You should preview the questionnaire before releasing it to students to check you've chosen the correct template or public questionnaire, or if creating a new questionnaire it displays as intended.

Caution

Although questionnaire responses can be set to anonymous, Moodle records when a student answers a question in the course log, so you may wish to use the Feedback tool instead, as this doesn't record when a student responds in the Moodle logs. Using the Feedback tool ensures staff cannot see who responded at a particular time using the Moodle course reports. The alternative is to set the questionnaire up in one centralised course as a public questionnaire and then link to it from the courses where students will answer the questions. The responses will only be available from the centralised course where the questionnaire was initially set up and therefore, only staff with access to this course will be able to see the responses, meaning they will be anonymous, providing the staff on the course where students answer the questionnaire, don't also have access to the course where the questionnaire data is held.

Another option is to use Opinio, which is a fully anonymous survey tool separate to Moodle.

If you use a public questionnaire make sure you include a question that captures which Moodle course the responses refer to. E.g. by asking students to select or fill in the module code and/or name.

Examples and case studies

- None at this time

Questions & Answers

Q. How can programme leaders view student feedback from multiple modules in one place?

A. Staff can create a public questionnaire in a Moodle course with those programme leaders assigned - students won't be able to answer directly in this course.

Student feedback can then be collected by creating questionnaires in each module's course that point to the public questionnaire. Staff in these courses will not be able to edit the questionnaire or see results unless they have tutor (or course admin) access to the Moodle course where the public questionnaire originates.

Note: you will need to ensure a question captures which Moodle course the responses refer to. E.g. by asking students to select or fill in the module code and/or name.

Q. How can I encourage students to complete a questionnaire electronically?

A. A common problem with electronic questionnaires is low response rates compared to handing out paper copies. Some proven ways to encourage students to complete questionnaires online include:

• Ask them to complete it in class, using their mobile device or laptop.
• Use the conditional release feature in Moodle to release extra information that students will value - e.g. exam tips, study guide etc. However, avoid withholding essential information.
• Send reminders to those who haven't completed the questionnaire using Moodle's course participation report.

Further information

• There are a number of different options available within the questionnaire visible to staff via the tabs including view All responses, access Advanced settings, edit the Questions and Preview.
  • If you are linking to a public questionnaire you may not have all of these options (such as viewing responses and editing questions).

• You may wish to use groups to filter the feedback submissions or groupings to show different surveys to different groups of students on the same course. See Moodle Miniguide M13: Groups and groupings for more information and instructions on how to do this.