Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Keywords: quiz, question, true, false, exam, multiple choice, e-exam, e-assessment, summative, formative, instant feedback

Table of Contents
maxLevel3
minLevel2

What is it


CodeRunner is a Moodle question type that allows teachers to run a program in order to grade a student's answer. By far the most common use of CodeRunner is in programming courses where students are asked to write program code to some specification and that code is then graded by running it in a series of tests. CodeRunner questions have also been used in other areas of computer science and engineering to grade questions in which a program must be used to assess correctness.

UCL has support for the following common coding languages: Python, Java, C, SQL, PHP. To request a language please contact IT Services.

Info

CodeRunner questions are an advanced question type. You should always run practice and formative assessments with students prior to any summative assessments to ensure your questions are working properly and that students are familiar with answering CodeRunner questions.

Why use it?

  • Allows for students to write code within a quiz or exam setting.
  • Allows for automatic marking of student responses based on predefined tests.

...

  • Do I want to apply a penalty for wrong answers?
  • Do I want to randomise my questions?
  • How can I prepare students to complete a coding quiz?

The following overview video provide by Bath University provides an excellent overview of how CodeRunner works. Please note that UCL does not currently support all the programming languages shown in the video. 

...

You can also try out some test questions on the Coderunner test site.

Meeting the baseline

The UCL Connected Learning Baseline suggests the following for Orientation

...

Expand
  • 4.1 Provide an assessment outline with a clear description of the module assessment, including schedule, criteria and submission details. To avoid duplication this might include a link to a module webpage.

How do I set one up?

CodeRunner is an advanced question type. You should consult with the following too resources before creating any questions.

  1. Watch the Bath University Introducing CodeRunner video to learn more about how CodeRunner works. Please note that UCL does not currently support all the programming languages shown in the video.
  2. Try out some test questions on the Coderunner test site.


When you are ready, you can then create a CodeRunner question on UCL Moodle.

Step 1: Create a quiz 

Expand

You can find further videos and guidance in the Moodle guides and we recommend reading Guidance on Building a Quiz before creating your first quiz on UCL Moodle. 

Step 2: Add a 

...

CodeRunner question

Within a question bank or quiz:

  • Click Create a New Question or Add a new question.
  • Select CodeRunner
  • CodeRunner is an advanced question type. You should consult the in-line documentation while authoring CodeRunner questions - just click the help icons (question mark in blue circle).
  • At the very minimum you will need to complete Question text, Answer, Test Case and Expected Output

  • You should also be aware that CodeRunner questions allow students to check their responses at the cost of a penalty if their solution answer fails. As explained in the CodeRunner documentation:

...

Click Save changes and continue editing to add more questions.

Caution

Students will need to be instructed on how to answer questions correctly. Digital Education recommends having a formative or practice quiz to familiarise students with the process of completing and submitting a quiz attempt. 


Info
titleFurther help

Further guidance on the CodeRunner Question Type is available on the official documentation page.

If you find any inaccurate or missing information you can even update this yourself (it's a communal wiki).

If you have a specific question about the tool please contact the Digital Education team.

...