Questionmark OnDemand (QM OnDemand) is a cloud-based Assessment Management System that enables you to author, deliver and report on tests, exams, quizzes and surveys.
This system is initially only available for the Faculty of Medicine to replace Questionmark Perception (QMP). It will be run as a pilot for the rest of the University. If any of the Faculty or Schools wish to be a part of the pilot, they can do so by completing the TELT Pilot Expression of Interest form.
The main features of QM OnDemand include,
Collaborative Authoring: QM OnDemand provides a collaborative authoring environment for instructors and other academics to create surveys, quizzes, tests and exams. Questionmark Live provides collaborative browser-based authoring environment, complete with version tracking and roll-back features. Further details on how to use different collaborative feature within QM OnDemand can be found here.
Blended Delivery: Assessments created using QM OnDemand can be delivered on various platforms, over the web, on local devices or even on prints. Further details on different delivery options is available here.
Reporting and Analytics: Questionmark has a broad range of predefined reporting and analytics tools. These reports and analytics can help instructors in determine the accessibility and reliability of their assessments. This can also help in determining learning outcomes and methods to improve course delivery. These reports can also be used to compare results of different groups of students.Further support documents on analysing various reports can be found here.
The basic structure in QM OnDemand has two sections, Assessments and Topics. Assessment section is a set of Assessment Folders which replicates the category structure set on Moodle. Assessments can be created within these folders using preset questions within topics. Topics are basic questions banks used to categorise questions based on subjects, priority or purpose. Topics can also be exported or imported as a Qpack.
Adding a QM OnDemand Activity
Currently, this tool is can only be added via Manual LTI configuration. The configuration details will be sent to the Pilot users separately once their access has been set by the administrators.
On the course home page, click Turn editing on
In the appropriate topic or week section, click Add an activity or resource. In the resulting pop-up, select External tool from the list and click Add.
On the ‘Adding a new External tool’ page, type a name for your activity and Select Show more.
The below details will be provided to the pilot users with their confirmation email. Enter these details and other default activity settings and then select Save and display.
You can now access the QM OnDemand activity from your course home page.
To select the assessment to be published, select the QM OnDemand activity from the course page.
In the next screen, select the assessment to be published from the list. The best way to is to search for the Assessment in the top right search bar.
Please note, the Assessment will only show up in the list if you have Published in on the main QM OnDemand portal.
Once the correct assessment has been selected, click Save Change. The assessment will then be available for Students.
Questionmark Authoring Guide
The Authoring section of QM OnDemand allows you to create questions and assessments.
Please use this link to access the Authoring Section of QM OnDemand.
The Questionmark Authoring Guide provides resources with step-by-step instructions on using different features of Authoring. This includes creating Topics and Questions, Assessments and additional Knowledge documents.
Create an Assessment
Assessments are a set of question blocks which in turn contain a set of questions. Assessments can be set as Test, Exam, Quiz or Survey.
To create a new assessment:
- From the Authoring drop-down list select assessment.
- Select the appropriate faculty/ School Assessment Folder in which you want to create an assessment and click New on The top bar.
- From the list select the appropriate assessment format as needed.
- In the next page, select appropriate Title and Description and /or Introduction for the Assessment.
- The Create as many Question Blocks as needed and add the Questions either from a pre-set topic or manually creating a new question.
- Once the Assignment is created, please select Save+Exit as the bottom.
Please note, Before an assessment can be saved all Question Blocks should have at least one question.
- Once you are done creating the Assessment and are ready to publish it on Questionmark public list, select the Assessment from the list and select Publish from the Top bar.
- The Assessment should then be visible on the Assessment list of QM OnDemand in Moodle.
Further details on Editing an Assessment can be found Here.
Create a Topic
A topic consists of a set of questions created based on a specific course or knowledge article. Questions can also be divided into topics based or their importance.
To create a topic:
- From the Authoring drop-down list on your Questiomark dashboard select Topics.
- On the Topic screen select the main Topic folder or the parent Topic folder from the list if you want the new topic as a sub-topic. Once the Parent folder is selected click on Topic and select new.
- Type-in the Topic name and click enter.
- Now you can add new questions to this topic.
Additional details on using the Topic Screen can be found within the Questionmark guide here.
List of Available Question Types
- Drag-and-Drop: Click and drag up to ten images into position.
- Essay question: Students can submit their answer within a text box and can be scored based on predefined rubrics. There is also options to setup list of acceptable answers or required keywords.
- Explanation screens: Students some text or a video before answering a set of questions.
- File Upload: Answers to these questions can be submitted as file upload.
- Fill-in-the-blank: As the name suggests, students fill in the missing words which can be compared against a list of acceptable answers.
- Hotspot: Students select a point on an image a based on their choice, certain feedback and grades will be assigned.
- Knowledge Matrix: Students are provide with several multiple-choice questions together where they have to select one answer for each statement or question.
- Multiple choice/ Multiple Response: Questions can be set for students to provide single or multiple response to a multiple choice question. There is also option set up score per choice.
- Pull-Down List (selection question): a series of statements are presented and students can match these statements with a pull-down list.
- Ranking (Rank in Order): Students can rank a list of choices based on the order stated in the question
- Select-a-blank: Students can fill in the blanks using words from a pre-set pull-down list.
- Text Match: Students response can be compared to pre-defined key word or phrase to decide if the answer is correct.
- Yes/No or True/ False: Students selects "Yes" or "No" or “True” or “False” in response to the question.
QM OnDemand also has some assistive Accessibility functions for instructors to assist students with disability.
Some sample use of accessibility features include:
- Format templates with “text sizing” and “contrast controls”
- Access for instructors to "override" exam time limits
- Support for students that need to use alternate pointing devices
- Support for students using screen-readers
QM OnDemand has built-in assessment screens that supports 36 languages including support for right-to-left languages.