Skip to navigation Skip to navigation Skip to search form Skip to login form Skip to footer Skip to main content

Quizzes

Site: College of the Rockies - Online
Course: COTROnline Faculty Help Manual
Book: Quizzes
Printed by: Guest user ,
Date: Thursday, 7 November 2024, 5:42 AM

  • The Quiz is a versatile tool designed to fulfill various teaching requirements, ranging from straightforward multiple-choice assessments to intricate self-evaluation assignments with comprehensive feedback. 
  • Questions are generated and stored independently in a Question bank, enabling their reuse across different quizzes. 
  • When constructing a Quiz, you have the option to either generate the questions first and then incorporate them into the Quiz or begin by adding a Quiz activity and crafting the questions as you progress

  • Enable editing in your course, then select Quiz from the activity chooser. 

  • Assign a name and, if necessary, a description. Expand other sections to customize your preferred settings. 

  • By default, students can retake the quiz, navigating freely through questions on separate pages. There's no time restriction, and scores along with feedback appear upon quiz completion. To modify defaults or gather more information on configuring your quiz, refer to Quiz settings. 

  • Save and display your choices. Navigate to Edit quiz, and then select Add, followed by '+ a new question' (If you've already generated questions in the question bank, choose '+ from question bank,' or opt for '+ a random question' to add a question randomly selected from a category). 

  • Select the desired question type and click 'Add' at the bottom. Enter your question; for assistance, consult the documentation on Question types. Save changes and repeat the process for additional questions. Finally, click 'Save changes' once your questions are entered. Adjust the maximum grade if needed to align with the number of questions in your quiz.

Problems of Exams as an Assessment

Article looking at some of the problems created by the use of proctoring software, as well as problems created more generally by the use of exams as an assessment method:  https://bccampus.ca/2020/07/21/exams-who-are-we-leaving-out/ link to open resource.

Not Just for Assessment Workshop

Sample Quiz

Provides examples of some less frequently used question types and examples of how images and video can be used with more commonly used question types.


If you are interested in investigating options to using exams for assessment or teaching, please connect with the Learning Specialist.  The COTROnline Help Desk will be pleased to help you connect.  Contact information and availability for the COTROnline Help Desk can be found at the bottom of all COTROnline pages.



Generating a new quiz involves a two-step procedure. Initially, you create the quiz activity and configure its options, outlining the guidelines for engaging with the quiz. Subsequently, you incorporate questions into the quiz. This section outlines the configurable options for the quiz activity. The subsequent page elucidates the process of configuring questions for the quiz. All settings may be expanded by clicking the "Expand all" link top right.

General



Insert a title (which students will click to enter the quiz) and provide a description (for eg, what this quiz is about, instructions for students, any multimedia or may be any supporting material) of the required actions.


Timing

  • Open the Quiz
    You have the option to set specific times during which the quiz is accessible for participants to attempt. 
    Prior to the opening time, the quiz remains inaccessible to students. While they can view the quiz introduction, the questions themselves remain hidden.
    Quizzes with future start times display both the open and close dates to students.

  • Close the Quiz
    After the closing time, students cannot initiate new attempts. Responses submitted after the quiz closing date are saved but remain ungraded.
    Even after closure, students can still access the quiz description and review their attempts.

  • Time Limit

    By default, quizzes have no time limit, allowing students ample time for completion. If you choose to set a time limit, several measures are implemented to encourage completion within that timeframe:

    • A navigation block displays a quiz timer.
    • Upon timer expiration, the quiz is automatically submitted with the filled-in answers up to that point.
    • If a student attempts to exceed the allocated time through cheating, no marks are awarded for answers entered after the time limit.

  • When time expires
    You have three choices regarding the outcome when the time limit elapses. Simply make your selection from the dropdown menu:

    1. Automatically submit open attempts (This is the default setting).
    2. Allow a grace period for submitting open attempts but prohibit answering additional questions (this option enables you to activate the "Submission grace period" checkbox. You can then define a specific timeframe within which learners can still submit the quiz after the designated time has passed.
    3. Mandate submission before the time expires; otherwise, the attempts will not be considered.



Grade

  • Grade Category
    If your gradebook includes categories, choose the specific category in which you want the quiz to be placed.
  • Grade to Pass
    you can establish the minimum grade required to pass the quiz. This setting may be linked to Activity completion, ensuring that students cannot proceed to a subsequent activity until they have successfully passed the quiz.

  • Attempts allowed
    Students can be granted the option for multiple quiz attempts. Allowing this flexibility can transform the quiz experience into a more educational activity rather than a mere assessment.


Layout

  • New Page 
  • To optimize longer quizzes, it's practical to distribute the quiz across multiple pages by restricting the number of questions on each page. As you incorporate questions into the quiz, page breaks will be automatically inserted based on your chosen settings. Additionally, you retain the flexibility to manually adjust the placement of page breaks later on the editing page.

    Navigation Method (accessible by selecting "Show More")
    Opt for Sequential over Free if you prefer to compel students to advance through questions in a specific order, preventing them from revisiting previous questions or jumping ahead to later ones.



Question Behavior

Shuffle Within Questions - applies to multiple choice, matching, cloze questions with drop-down lists, etc. Answer options are displayed in a different order for a question each time it is offered (example: student 1 - options A, B, C, D; student 2 - options B, A, D, C; student 3 - options D, B, C, A; etc.). 

Note: cannot use "all/none of the above" or "A and B are correct" type options; can use "all/none of these".

How Questions Behave - determines when students get feedback for the questions they answer.  To see the options, click the blue question mark

Each Attempt Builds on the Last (Attempts Allowed must be set to 2 or more) - if the quiz questions are not being pulled randomly, this allows students to repeat a quiz or continue it if the quiz was interrupted without loosing their previous responses.

Note:  if Deferred Feedback is set, students will not see which questions they have already answered when they get their additional attempt(s).

Review Options


During the Attempt - the attempt itself is always seen, but how much else can be made available to students during a quiz attempt is determined largely by the How Questions Behave settings under Question Behaviour.

Immediately After the Attempt - applies to the 2 minutes directly after a student submits a quiz attempt. 

Later, While the Quiz is Still Open - applies to the time between a quiz attempt being submitted and the close date and time specified under the Timing.

After the Quiz is Closed - applies to the time after the close date and time specified under the Timing.


If ticked,
  • The Attempt - provides access to the quiz questions and students' own specific answers, but the students cannot change their answers, though they can share both their answers and the questions.
  • Whether correct - identifies which questions a student answered correctly and which have been answered incorrectly.
  • Marks - the mark for any self-marking question
  • Specific feedback - not all questions have an option for specific feedback, but some such as multiple choice questions do.  The feedback received by a student is dependent on the answer they selected:
                                            
  • General feedback - seen by all students regardless of the answer selected.  Useful for providing a full answer or links to additional information.
  • Right answer - shows the correct answer.
  • Overall feedback - shows overall feedback if any has been set.

Appearance




Show the User's Picture - images currently used on COTROnline are added by students themselves, so there is no guarantee that the picture displayed is the student in question.  Recommend using MS Teams and an official piece of government photo identification such as a driver's license or passport.

Decimal Places in Grades / Decimal Places in Question Grades - affects how grades display for a quiz, but not overall grade calculation.

Show Blocks During Quiz Attempts - whether or not quiz blocks are displayed for students.
Set to Yes (left image) and No (right image):
example of quiz blocks Quiz block display set to no


Safe Exam Browser - DO NOT use.  Not supported on college computers.  Use Respondus instead.


Extra Restrictions on Attempts

Require Password - useful when exam is invigilated or in conjunction with group or user overrides.

Require Network Address - DO NOT use. Creates conflicts due to how college IP addresses are assigned and lack of consistency for remote students.

Enforce Delay - provides the ability to force students to go review materials between attempts.

Browser Security - DO NOT use.  Not supported on college computers and creates conflict on remote computers.  Use Respondus instead.

Allow Quiz to be Attempted Offline Using the Mobile App - DO NOT use.  Not currently supported.




Similarly explore rest of the setting (common module setting, Restrict Access, Activity Completion, Complentencies) as these are similar to other activities.

If you need help or have questions, please contact the COTROnline Help Desk; contact information and hours of availability can be found at the bottom of all site pages.

From multiple-choice to essay questions, Moodle Quiz provides a versatile platform for you to assess and evaluate students' understanding of course material. This FAQ guide offers insights into setting up quizzes, customizing settings, and interpreting results.


Option 1: Utilize the Preview feature provided to you while building the quiz. This allows you to test the quiz's functionality and appearance before making it available to students.
For this, with editing turned on, go to the quiz that you just built and on the left side, drop down the 'Quiz administration'>Preview.


Option 2: Create a practice quiz mirroring the settings of the original one. Include a small number of sample questions and encourage students to attempt this practice quiz. This option is particularly useful before important exams, such as mid-terms or finals, to ensure a seamless experience, especially when employing features like Lockdown Browser in the quiz.

  • To generate a quiz that randomly selects X questions from a larger large question bank, follow these steps: 

    1. In your course, with editing turned on, navigate to the Quiz and the 'Couse Administration'>'Questions.



    2. Choose the "Add" option and then select "+ a random question."

    3. Specify the number of questions you want to include (X) and the category from which the questions should be randomly drawn.
    4. If desired, you can further filter random questions by tags.


      If you gave a set of questions in your question bank, you could incorporate random questions into your quiz by selecting 'Add' followed by '+ a random question.' This feature proves valuable when administering quizzes to a class simultaneously, ensuring that students are presented with distinct sets of questions. Additionally, the system prevents the repetition of the same question within a quiz, ensuring variety. 

      It's essential to have a sufficient number of questions in the category from which random questions are drawn to avoid error messages for students. The inclusion of both random and non-random questions ensures that random questions do not duplicate non-random ones. The quantity of questions provided influences the likelihood of students encountering different questions in each attempt. Upon retaking a quiz with random questions, the system generates new random questions, and their grades are rescaled to match the predetermined grade for random questions.

  • If you find yourself in this situation, it is likely because of existing quiz attempts. To address this, you can delete all previous attempts by selecting and deleting them. If you are working on a new quiz with only trial attempts, deleting previous entries won't affect the grade book.
  •  To access and delete previous attempts, locate the "attempts #" on the quiz page. If you encounter a message stating, "You cannot add or remove questions because the quiz has been attempted (attempts #)," click on "attempts #."


  • If you've navigated away, go to the Settings block > Quiz Administration > Question.



  • Once on the "attempts #" page, use the dropdown menu to select "all users who have attempted the quiz." Choose other relevant options, click "Show Report," select all, and then click "Delete selected attempts." Confirm your selection.
  • After this, return to Quiz Administration > Edit Quiz, and you should now have the ability to add or remove questions.

Once a quiz has been taken by one or more students, you cannot directly remove a problematic question. However, you have the option to address the issue by adjusting the score and flagging the question for identification.

To mitigate the impact of the problematic question:

  1. Set the score for that specific question to 0.
    For this, navigate to Quiz>Quiz Administration> Questions.
    Choose the problematic question and click 'Pencil Icon' on the right of the question to set the marks to 0.



  2. Flag the question for easy recognition and future review. This way, you can identify and address the issue while ensuring transparency about the question's status.


Within the Quiz administration, you'll find a link labeled "User overrides." Clicking on this link grants you the ability to select one or more users and modify quiz dates, times, or the number of attempts allowed.

For instance, imagine a one-hour quiz scheduled for December 9, 2023, between 9:00 and 10:00. If you wish to provide a 15-minute extension for a specific student, navigate to the quiz settings under "Timing." Adjust the "Open the quiz" to December 9, 2023, 9:00 and "Close the quiz" to December 9, 2023, 10:00.


Simultaneously, in the "User overrides" section, create an override for the targeted student with the "Close the quiz" set to December 9, 2023, 10:15.  This configuration should function seamlessly."

However, it's important to note that if you have set "Date" restrictions under "Restrict access," limiting quiz access to the period from "December 9, 2023,9:00, "until" December 9, 2023, 10:00, a warning will be presented when implementing the override.

Despite adjusting the "Close the quiz" time to 10:15 in user override for the student, the quiz will, in reality, become inaccessible for them after 15:00 because of the limitations in 'restrict access'. To enable the student to access the quiz beyond 10:00, the only solution is to either eliminate the "until" date restriction in the quiz settings or modify it to extend until 10:15.



  • You can insert section headings on every new page by taking these steps:
    1. With editing turned on, Quiz administration>Questions.

    2. On the initial page, select the 'pencil' icon at the top and input your heading, and click enter.



    3. On subsequent pages, (look onto the page break) click the 'Add' link, opt for 'a new section heading,' and then include your heading as you did on Page 1. These section headings will be visible in the Quiz navigation block.



Creating conditional connection between questions is achievable when utilizing the Interactive with multiple tries or Immediate Feedback behavior, along with the 'Free' navigation method. This functionality allows you to make the visibility of a question depend upon the prior question being answered.

On the question editing page, you'll notice padlock icons positioned to the right of each question. For instance, if you wish to establish a condition where Q2 depends on the completion of Q1, simply click the padlock just above Q2. 

When a student enters the quiz, they will encounter a notification indicating that Q2 is inaccessible until they respond to Q1. In the Quiz navigation block, Q2 will appear greyed out.

It's essential to be mindful of certain scenarios where conditional dependencies may not be applicable where the answer type is essay or description.



tinymce-kalturamedia-embed||Adding Questions to Quizzes - 2018 May 10 04:25:16 (03:14)||400||285

 

To add questions to a Quiz

Go to Quiz Administration > Question.  

Important: Once someone has attempted a quiz, you cannot add or remove questions.  You can edit questions to correct spelling, replace images that aren't displaying, update an incorrectly identified answer, or change the value of a question.

 Before you add questions to a Quiz, it will look like this, and you will click Add to start. From the drop-down menu, you have three options.

From the drop-down menu, you have three options.

Note: random questions give your exam the greatest security, but if a student gets bumped out of the quiz, while you set another attempt for the student, you cannot set it to build on the previous attempt.

If you need help or have questions, please contact the COTROnline Help Desk; contact information and hours of availability can be found at the bottom of all site pages.

To add a specific question or set of questions From the Question Bank you set up, go to the Administration block > Quiz Administration > Questions> Add > select From Question Bank.

The default category of questions will display, but you can change the category in the Select a Category drop-down list.

Remove the tick from Also Show Questions from Subcategories if you only want to see the questions in the selected category.

Tick the radial buttons beside the questions you want to use in your quiz.

Once you are ready, click Add Selected Questions to the Quiz.

Repeat this process if you want to add questions from multiple categories until you have all the questions you want.

If you need help or have questions, please contact the COTROnline Help Desk; contact information and hours of availability can be found at the bottom of all site pages.

Before you add random questions to a quiz, a couple of things to keep in mind:

  • Questions pulled from within a specific category must have the same value.  If you want to include questions with different values, they must be in separate categories.
  • Questions pulled from different categories can be set to shuffle once they have been added to a quiz.
  • If a student is bumped out of a quiz, you cannot set a second attempt to build on the first attempt, though you can provide the student with second attempt at the full quiz.


To add a random question or set of questions From the Question Bank you set up, go to the Administration block > Quiz Administration > Questions > Add > select A Random Question.

The default category of questions will display, but you can change the category in the Select a Category drop-down list.

Add a tick to Include Questions from Subcategories if you only want to pull questions from subcategories. Note: if questions have different values, the system will return an error.

Select the Number of Random Questions you want to add to your quiz (1 to 100) from the selected category.

Once you are ready, click Add Random Questions.

Repeat this process if you want to add questions from multiple categories until you have all the questions you want.

 

If you need help or have questions, please contact the COTROnline Help Desk; contact information and hours of availability can be found at the bottom of all site pages.

Once your questions have been added to your quiz, you have some options to organize them. To organize, go to Quiz administration>Question.

Maximum Grade

Set you Maximum Grade to match the automatically generated Total of Marks.  Things will still calculate correctly if you don't, but you will get some strange numbers (e.g. .82 instead of 1) which confuse students and generate lots of questions for you.

Shuffle

For greater exam security, you can shuffle all your questions or some of your questions.  This increases exam security with randomized questions only when you are pulling questions from more than one category (e.g. Chapters 1, 3, and 4).

To Shuffle all the questions in a quiz, tick the Shuffle at the top right of the page.

To Shuffle some of your questions, you will need to add a Page Break and create Section Headers. Each section has an option to Shuffle which only applies to the questions within that section.

Page Breaks

You can create regular page breaks every so many questions (recommend no more than 4 or 5 questions per page because student answers save each time they click Next to move to the next page) using Repaginate.

repaginate pop-up

Or you can use the page break optionspage break icon  to set more controlled breaks (e.g. between multiple choice and essay questions).

Section Headings

The top section header can be added by clicking the edit pencil found below the Repaginate button.

top Section Header edit

To add a Section Header further down in the quiz, go to the page break where you want the header to be added, then click the Add

From the drop-down list, select A New Section Heading

To edit the New Heading, click the edit pencil, type your new heading label, then press Enter to save it.

Editing section header


Select Multiple Items

If you have questions you wish to remove from the quiz, you can use the Select Multiple Items to remove sets of questions.

Select multiple quiz questions


 

 

If you need help or have questions, please contact the COTROnline Help Desk; contact information and hours of availability can be found at the bottom of all site pages.

Overrides are used when you have individuals or groups of students who are writing their quizzes/exams at different times or who require more/less time to complete a quiz/exam.

  • To use an override, create your quiz.
  • Once the quiz has been created, go to the Administration block > Quiz Administration (must have the quiz open to see this)
  • Click on Overrides, then from the drop-down, select User Overrides or Group Overrides(the only difference is the drop-down list for selecting individual students vs a group of students).
  • click Add User Override/Add Group Override.

Setting:

  • Override User or Override Group- Select student name or group name from the drop-down.

  • Password - recommended if your exam is invigilated.

  • Open the Quiz / Close the Quiz date and time.  For continuous intake courses or when students are allowed multiple attempts for practice purposes, this can be left with the Enable unticked.

  • Time Limit - this is where you would allow extra time for students with accommodations or limit the time if a student is being put back into a quiz to answer missed questions after being bumped out of the quiz. 

  • Attempts Allowed - set to 2 (or more) if student or group is being allowed an additional attempt; most common when a student has been bumped out of a quiz.




IMPORTANT:

If you create a User Override for an individual in a Group, there will be a conflict if there is also a Group Override for that specific Group.

If you want to offer different quizzes/exams for different groups of students, you will need to add multiple exams to your course page, then Restrict by Groups.

If you need help or have questions, please contact the COTROnline Help Desk; contact information and hours of availability can be found at the bottom of all site pages.

Directions for setting up the Respondus Lockdown Browser

 

 

If you need help or have questions, please contact the COTROnline Help Desk; contact information and hours of availability can be found at the bottom of all site pages.

We recommend adding the following to your exam directions:

Prior to your final exam:

  • Check to see if your computer, smartphone, tablet, etc. and internet connection that will allow you to complete an exam (go here to check https://mdl-cotr-dev.tru.ca/mod/quiz/view.php?id=616498 – self enrollment key is:  welcome).

  • If you encounter problems when you attempt to complete the sample exam, please contact the COTROnline Help Desk as soon as possible.

  • Find a quiet corner that can be used when you write the exam.

At the time of the exam:

  • Log into www.cotronline.ca at least 5 minutes prior to your exam starting to ensure that there are no last minute connection difficulties. 

  • Use either FireFox or Google Chrome if possible; Internet Edge and Internet Explorer may cause problems with the exam.

  • Once you start your exam, DO NOT attempt to open www.cotronline.ca in another internet browser.  If you do, you will be dropped out of your exam and will not be able to complete it.
  • If your exam is open for an extended period (example: from 8 am until 10 pm) and is two hours long, make sure you start early enough that you can finish before the exam closes (example:  if you are allowed two hours to complete the exam and it closes at 10 pm, you need to start by 7:50 pm to have the full two hours).

  • If the exam is open book, right-click on the exam link and open the exam in a new tab.  This will allow you to access the rest of your course and other internet websites during the exam.  Do not attempt to open the www.cotronline.ca website in another browser; if you do, you will be dropped out of your exam.

During the exam – your connect to the exam is lost

  • If your internet connection is interrupted and you get dropped from your exam, go back into the exam as soon as you are able.  If you go back in directly, you will be able to continue from where you left off.

  • If your internet outage is extended or you are not able to return to your exam, please either send an email to your instructor and COTROnline@cotr.bc.ca or call 250-489-2751 local 3737 immediately and leave a message with your name, course, phone number and the information that you have been dropped from your exam; someone will get back to you as soon as possible.
  • If you get dropped out of the exam, your questions will be saved up to the page/question you were working on at the time you were dropped.

At the end of the exam

  • Mark sure you have answered all the questions; even a partial answer or a guess has the potential to be an extra mark.

  • Make sure you submit your exam when you are finished.


If you need help or have questions, please contact the COTROnline Help Desk; contact information and hours of availability can be found at the bottom of all site pages.