Once your students have started submitting attempts for the quiz, you will want to check on how they’ve performed.
There are a number of reports available ranging from a table listing all quiz attempts through to statistical reports on specific questions. In this post, I will explain the difference between the various reports and suggest how they might be used.
This is the default report that can be accessed either from the dropdown menu behind the ‘gear’ icon (illustrated above) or by clicking on the number of attempts link on the main Quiz page (highlighted below):
As seen in previous posts, the Quiz ‘Grades’ report lists each attempt in a table with columns for each of the questions containing the mark achieved during an attempt for that specific question.
The table/report can be filtered on group (A, below), on specific types of users (B, below) and also on students’ first name and surname (C, below):
It’s also possible to export the results to a file for further analysis (D, below), and sort on a variety of columns simply by clicking on the column headings (E, below):
For each attempt, you have the ability to Review attempt (F, above) meaning that you will see a student’s full quiz attempt including the student’s answers, marking and feedback that will have been shared with the student.
As covered in a previous post, you also have the ability to delete attempts and regrade attempts.
The ‘Responses’ report again displays a table with a row for each quiz attempt but, rather than display the awarded grade for each question, there are two columns for each question: one displaying the question itself, and the other displaying the student’s submitted answer for that question.
Once again it can be filtered, sorted and exported in the same way as the ‘Grades’ report.
The ‘Statistics’ report provides statistical analysis of both the quiz as a whole and also individual questions.
The report is initially presented in three sections:
- Quiz information – basic information about the quiz as a whole eg. number of attempts, average grades.
- Quiz structure analysis – a table listing all the questions that have been used within the quiz activity.
- Statistics for question positions – a bar chart showing the perecentage of correct answers (Facility index) and the ‘Discriminative efficiency index’ (a correlation between the score for this question and the score for the whole quiz).
I’m going to focus on the ‘Quiz structure analysis’ section of the report as, from my experience, this has proved the most useful part of the report:
This section can be used to analyse student performance on each question; a question that is being answered incorrectly on a regular basis suggests that the topic on which the question is being tested may need to be revisited in class or there is perhaps a common misconception amongst students.
Equally, a poorly-worded question might result in incorrect answers too so the report may also flag up these questions.
Any question highlighted in red suggests there may be a problem with that question – in the above example, the two “red” questions have a negative ‘Discrimination index‘ (A, above), suggesting that that the students who performed best on these questions were those with the lowest grades overall so this is highlighted by the report.
A high ‘Standard deviation‘ (B, above) for a question indicates that students submitted a large range of answers for that question (0% would indicate that all students gave the same answer).
It’s also possible to “drill down” for detailed analysis of individual questions by clicking on the name of the specific question (C, above).
By accessing the detailed analysis for an individual question, you are again presented with statistics for the question itself (D, below) but also analysis of the responses (E, below); for a multiple choice question, it can be useful to see how many times each option is being selected (F, below) by the student as it may help to identify misconceptions amongst students:
For more details about the Quiz Statistics report, visit the official Moodle page: Quiz statistics report (Moodle Docs)
4. Manual grading
Although this option is listed under reports, it’s function is to provide a way of displaying all those questions that require manual grading (e.g. ‘essay’ type questions) in one place allowing for you to work through the marking in one place.
Even if you don’t have any questions requiring manual grading, it’s still useful as you can also choose to list automatically graded questions too:
The benefit of this is that you’re able to re-mark/override the grade for each attempt to a particular question in one place:
The Quiz reports listed above offer granularity around the Quiz attempt and how questions are answered but if you just want to check on an overall grade or whether a student has submitted an attempt then the ‘Grader report’ and the ‘Activity completion report’, respectively, can provide that information.
The Grader report (accessed by clicking Grades in the ‘Navigation drawer’ on the left-hand side) shows all the grades for the students for each of the activities in the course; therefore in the context of this post, for a Quiz activity it just shows the final grade that has been awarded to each student for that Quiz. For quizzes where multiple attempts to the Quiz are permitted, this final grade is determined by the Quiz setting: ‘Grading method’.
If you’ve entered a ‘Grade to pass’ in the Quiz Settings …
… the grade in the Grader report will be presented in green if the student has achieved a pass, or red if the student has not achieved a pass, providing a quick visual clue as to how your students have performed:
You’ll also notice at the bottom of the column, there is an ‘Overall average’ grade so you compare a student’s performance against the “class” as a whole.
Activity completion report
The ‘Activity completion report’ can be used as a quick check for how your students have engaged with the quiz.
For example, you might simply want to know which of your students have – and haven’t! – submitted a quiz attempt; for this, configure the ‘Activity completion’ within the Quiz settings to automatically mark as complete (1, below) when a student has submitted a quiz attempt (2, below):
This configuration is quite a useful one as, if you’ve set a pass grade, the completion status is set to a ‘green tick’ if the student has achieved a pass in their quiz attempt, or a ‘red cross’ if the student’s attempt did not score enough to pass (if the student has not submitted an attempt then this is indicated by an empty checkbox):