Questionmark Computing Ltd

Questionmark OnDemand

The Questionmark assessment platform empowers industry leaders to create, deliver, and analyze assessments, driving better decision-making. Ideal for compliance, certification, and L&D, it offers proctoring, translation, and observational assessment tools. Secure, inclusive, and designed for seamless integration with your existing learning ecosystem, Questionmark is your expert assessment solution.

Features

• Comprehensive item banking with easy search functionality
• Deliver assessments via browser, secure browser, mobile devices and paper
• Robust reporting and analytics suite
• Collaborative authoring environment complete with version tracking and roll-back features
• Author once, deliver to multiple devices simultaneously
• Accessibility features such as text sizing and contrast controls
• Available in 36 different languages
• Secure and robust service that is ISO 27001 certified
• Scalable, flexible solution with rapid deployment
• 99.9%+ uptime

Benefits

• Create and deliver certification assessments and advancement exams
• Create and deliver post-course tests for distance learning
• Create, deliver and report on surveys and course evaluations
• Tracking changes to questions means legal defensibility
• Blended delivery allows mobile/onsite workers to still take assessments
• Observational assessments allow measuring performance on practical tasks
• Create valid and reliable assessments to make trustworthy decisions
• Assessments that document training and understanding for compliance purposes
• Improve test validity by running job task analysis surveys
• Assess skills of technical staff, engineers and equipment maintainers

£6,235 to £316,800 a licence a year

• Free trial available

Service documents

• Pricing document

  PDF

• Service definition document

  PDF

• Terms and conditions

  PDF

Request an accessible format

If you use assistive technology (such as a screen reader) and need versions of these documents in a more accessible format, email the supplier at qmbusinessdevelopment@learnosity.com. Tell them what format you need. It will help if you say what assistive technology you use.

Framework

G-Cloud 14

Service ID

143658958369899

Contact

Joe Oliver
02072637575
qmbusinessdevelopment@learnosity.com

Service scope

• Software add-on or extension: Yes, but can also be used as a standalone service
• What software services is the service an extension to: Questionmark OnDemand works with any LMS that supports SCORM, LTI or AICC including SuccessFactors, Workday Learning and Moodle. It can also load people data from HR Solutions like workday
• Cloud deployment model: Private cloud
• Service constraints: Questionmark OnDemand is available 24/7 365 days a year. There is scheduled maintenance on the 3rd Saturday of each month that rarely involves some downtime.
• System requirements: Questionmark OnDemand simply requires a standard browser

User support

• Email or online ticketing support: Email or online ticketing
• Support response times: Response time SLAs are set out in our terms and conditions. Severity one issues are responded to within 4 hours. See our terms and conditions for fuller SLAs.
• User can manage status and priority of support tickets: Yes
• Online ticketing support accessibility: WCAG 2.1 A
• Phone support: Yes
• Phone support availability: 9 to 5 (UK time), Monday to Friday
• Web chat support: Web chat
• Web chat support availability: 9 to 5 (UK time), Monday to Friday
• Web chat support accessibility standard: WCAG 2.1 A
• Web chat accessibility testing: None.
• Onsite support: Yes, at extra cost
• Support levels: Questionmark provides extensive technical support and email, phone and chat support is included for a number of different designated contacts within the service. There is also comprehensive documentation. ; ; Support has response time SLAs set out in our terms and conditions.
• Support available to third parties: Yes

Onboarding and offboarding

• Getting started: Questionmark offers onboarding and implementation packages to fit a customer's needs. The Standard package is excuted in five phases: 1)Kickoff, 2)Configuration Workshop, 3)Implementation, 4)User Acceptance Testing, and 5)Go-live. The customer team works with a dedicated Questionmark implementation team team comprised of a Project Manager, a Trainer/Consultant, and a Programmer/Consultant.; ; Each cusotmer is provided with a development tenant and a production tenant by default. The implemenation is carried out first in the development tenant, and then once approved by the customer, the configuration is applied to the customer's production tenant for go-live.; ; The Standard implementation includes the following deliverables:; - Configuration Workshop; - Branded Questionmark portal and assessment delivery templates; - Configured Coaching report template; - Six hours of instructor-led, virtual software training; - Setup and testing of standards-based integrations (AICC, SCORM, LTI, xAPI); - Changes to necessary server settings; - Guidance on how to conduct user acceptance testing
• Service documentation: Yes
• Documentation formats:
  • HTML
  • PDF
• End-of-contract data extraction: If the customer decides to terminate rather than renew their use of Questionmark OnDemand, an export of data in a standard format can be made available at no charge.
• End-of-contract process: If the customer chooses not to renew and decides to terminate their use of Questionmark OnDemand, an export of data in a standard format can be made available at no charge.

Using the service

• Web browser interface: Yes
• Supported browsers:
  • Microsoft Edge
  • Firefox
  • Chrome
  • Safari
  • Opera
• Application to install: No
• Designed for use on mobile devices: Yes
• Differences between the mobile and desktop service: We use responsive design, and there is very little difference in the mobile service and desktop service. Questionmark OnDemand adapts itself to fit the screen size required, with all elements of the portal still easily accessible on the screen.
• Service interface: No
• User support accessibility: WCAG 2.1 A
• API: Yes
• What users can and can't do using the API: Questionmark supports several APIs with full details at https://help.questionmark.com/hc/en-us/sections/12001387179035-Platform-Configuration-and-Integration-Options . Questionmark's Application Programming Interfaces (APIs) allow rich integrations between Questionmark technologies and third-party applications. Results API: Based on the Open Data Protocol, Questionmark's Results API is a REST-ful data service that can be used to retrieve result data from a user's Results Warehouse. The Results API allows customers to import result data into statistical analysis tools like Microsoft Excel and create reportlets to help them analyse their data. QMWISe (Questionmark Web Integration Services environment): QMWISe is a web-service interface to Questionmark based on SOAP messaging. QMWISe provides a secure interface to the Questionmark database. PIP (Perception Integration Protocol): PIP is a lightweight interface to Questionmark's delivery system. PIP files provide assessment launch and callback capabilities using HTTP query strings and Questionmark variables. PIP is also used to enable support for SCORM and AICC protocols. Delivery OData API and xApi endpoint SAML integration SSO
• API documentation: Yes
• API documentation formats:
  • HTML
  • PDF
• API sandbox or test environment: Yes
• Customisation available: Yes
• Description of customisation: Questionmark OnDemand can be customised for a variety of needs. The template can be altered graphically to reflect the company using OnDemand, and there are a multitude of reporting and analytics that are customisable through OData and APIs.

Scaling

• Independence of resources: Questionmark uses redundant load balancers to ensure the availability of their service. Additionally, Questionmark service resources are monitored and dynamically allotted as needed.

Analytics

• Service usage metrics: Yes
• Metrics types: We have a number of different reports that can be used for service usage metrics, including but not limited to Annual / Quarterly / Monthly Activity Dashboards containing: Results Overview, Participants Overview, Assessments Overview, Participant Groups, Results Outcomes, Usage Report.
• Reporting types:
  • API access
  • Real-time dashboards
  • Regular reports
  • Reports on request

Resellers

• Supplier type: Not a reseller

Staff security

• Staff security clearance: Conforms to BS7858:2019
• Government security clearance: Up to Developed Vetting (DV)

Asset protection

• Knowledge of data storage and processing locations: Yes
• Data storage and processing locations: United Kingdom
• User control over data storage and processing locations: No
• Datacentre security standards: Complies with a recognised standard (for example CSA CCM version 3.0)
• Penetration testing frequency: At least once a year
• Penetration testing approach: Another external penetration testing organisation
• Protecting data at rest:
  • Physical access control, complying with CSA CCM v3.0
  • Physical access control, complying with another standard
  • Other
• Other data at rest protection approach: The service is protected by redundant firewalls and each server in the various tiers is protected by a host-level firewall. A Bastion Host is used to allow system maintenance without damaging system security or integrity.
• Data sanitisation process: Yes
• Data sanitisation type: Deleted data can’t be directly accessed
• Equipment disposal approach: Complying with a recognised standard, for example CSA CCM v.30, CAS (Sanitisation) or ISO/IEC 27001

Data importing and exporting

• Data export approach: There are a variety of export capabilities within the software including in Excel, CSV and PDF formats.
• Data export formats:
  • CSV
  • Other
• Other data export formats:
  • Excel
  • PDF
  • Feed
• Data import formats:
  • CSV
  • Other
• Other data import formats:
  • ASCII
  • Blackboard
  • LXR Merge
  • Moodle XML
  • QTI 1.2 XML
  • Excel
  • QML

Data-in-transit protection

• Data protection between buyer and supplier networks: TLS (version 1.2 or above)
• Data protection within supplier network:
  • TLS (version 1.2 or above)
  • Other
• Other protection within supplier network: Firewall, Antivirus, Intrusion Prevention System. Additionally, the service is hosted in a data centre isolated from corporate systems.

Availability and resilience

• Guaranteed availability: Using all the systems and security we have in place, we target a 99.9% uptime of Questionmark OnDemand. During 2023, our actual uptime was about 99.99%.
• Approach to resilience: "Questionmark is hpsted in data centers that provide the following features and safeguards:; Physical security measures: ; The physical security of the building and servers are maintained by 24-hour manned security & intruder/security breach alarms, Smart Card access policies and internal and external CCTV systems. The data center does not include signage that could identify it as a data center. Environmental monitoring: The Network Operation Center (NOC) monitors alerts (visual, audible and via email) and engages the personnel at the data center to resolve issues. There are 24 x 7 environmental monitoring systems, fire alarm status and FM200 fire suppression equipment, N+1 redundant Heating Ventilation Air Conditioning (HVAC) system and a controlled environment with room temperature 24°C +/- 2°C. ; Data Center Certifications: The data centers are compliant with the ISO 9001 Quality Management System standard and the ISO 27001 Information Security Management System standard"
• Outage reporting: Learnosity provides notification of service outages via email notifications. Additionally, the status of the Questionmark service is available at http://status.questionmark.com/.

Identity and authentication

• User authentication needed: Yes
• User authentication:
  • Username or password
  • Other
• Other user authentication: Customers could set up a number of requirements around login integrated with LMS supporting SAML 2.0 or the portal provided. This can support 2 factor authentication and works with third party identity providers.
• Access restrictions in management interfaces and support channels: Questionmark uses Role Based Access Controls to enforce the rule of least privilege.
• Access restriction testing frequency: At least every 6 months
• Management access authentication:
  • 2-factor authentication
  • Identity federation with existing provider (for example Google Apps)
  • Dedicated link (for example VPN)
  • Username or password

Audit information for users

• Access to user activity audit information: Users contact the support team to get audit information
• How long user audit data is stored for: Between 6 months and 12 months
• Access to supplier activity audit information: Users contact the support team to get audit information
• How long supplier audit data is stored for: Between 6 months and 12 months
• How long system logs are stored for: Between 6 months and 12 months

Standards and certifications

• ISO/IEC 27001 certification: Yes
• Who accredited the ISO/IEC 27001: BSI
• ISO/IEC 27001 accreditation date: 16/02/2023
• What the ISO/IEC 27001 doesn’t cover: Our scope is broad and covers all our operations under G-Cloud. See certificate at https://www.questionmark.com/app/uploads/2023/07/BSI-Learnosity-ISO-Certificate.pdf
• ISO 28000:2007 certification: No
• CSA STAR certification: Yes
• CSA STAR accreditation date: 20/12/2019
• CSA STAR certification level: Level 1: CSA STAR Self-Assessment
• What the CSA STAR doesn’t cover: Our entire Questionmark service is covered by our CSA STAR self-assessment.
• PCI certification: No
• Cyber essentials: Yes
• Cyber essentials plus: No
• Other security certifications: No

Security governance

• Named board-level person responsible for service security: Yes
• Security governance certified: Yes
• Security governance standards:
  • ISO/IEC 27001
  • Other
• Other security governance standards: Questionmark is also Cyber Essentials certified.
• Information security policies and processes: Learnosity's Information Security Policy is reviewed and approved by executive leadership at least annually. Learnosityhas a comprehensive Data Security Policy in place that applies to all employees and a small number of authorized contractors (quasi-employees). Here is a summary of the policy regarding employees: • Background checks are carried out on all new employees. • Employees are required to sign a confidentiality agreement and commit to Learnosity’s Data Security Policy • Data Security training is given to each new employee. • Data security and information security awareness briefings are given to all employees regularly. • Learnosity's Information Security Officer is responsible for compliance and recording breaches if and when they occur. • All employees must pass annual tests on Learnosity’s Data Security Policy. • GDPR Compliance Procedure

Operational security

• Configuration and change management standard: Conforms to a recognised standard, for example CSA CCM v3.0 or SSAE-16 / ISAE 3402
• Configuration and change management approach: All releases are tested in a development setup, then moved to staging and tested there before being moved to production. There is an automated deployment mechanism with sign-off at each stage. Further information is available in our description of Questionmark security, available under NDA.
• Vulnerability management type: Conforms to a recognised standard, for example CSA CCM v3.0 or SSAE-16 / ISAE 3402
• Vulnerability management approach: Learnosity triages vulnerabilities and remediates them in a timeline based on risk. Additionally, the Security Team monitors supplier and industry security feeds for security issues in system software. These issues are triaged for applicability and severity then tested, patches or remediation’s are applied immediately or within the monthly release cycle, based on risk.
• Protective monitoring type: Conforms to a recognised standard, for example CSA CCM v3.0 or SSAE-16 / ISAE 3402
• Protective monitoring approach: The Questionmark service is monitored 24/7.We have a comprehensive Incident Response Plan which that regularly tested by table top testing.
• Incident management type: Conforms to a recognised standard, for example, CSA CCM v3.0 or ISO/IEC 27035:2011 or SSAE-16 / ISAE 3402
• Incident management approach: Learnosity maintains a robust and well-tested Security Incident Response Plan to address all potential security incidents. Users can report incidents to technical support.

Secure development

• Approach to secure software development best practice: Independent review of processes (for example CESG CPA Build Standard, ISO/IEC 27034, ISO/IEC 27001 or CSA CCM v3.0)

Public sector networks

• Connection to public sector networks: No

Social Value

• Social Value:

  Social Value

  • Fighting climate change
  • Covid-19 recovery
  • Tackling economic inequality
  • Equal opportunity
  • Wellbeing

  Fighting climate change

  Online education and assessment can positively impact climate change by significantly reducing carbon emissions associated with traditional education settings. By minimizing the need for physical transportation of students and educators to and from educational facilities, online learning decreases fuel consumption and exhaust emissions. Additionally, virtual classrooms reduce the demand for heating, cooling, and lighting vast physical spaces, which further lowers energy usage and contributes to a smaller carbon footprint.

  Covid-19 recovery

  online education can significantly assist with COVID-19 recovery. During the pandemic, the shift to online platforms helped maintain educational continuity when physical classrooms were inaccessible. Studies suggest that not only can these platforms support ongoing educational delivery, but they also offer flexible, scalable solutions for recovery efforts by reaching students who might still face disruptions due to the pandemic. The integration of online learning can help address learning losses by providing access to tailored educational resources and recovery programs, making education more resilient and adaptable to students' needs across diverse contexts. Furthermore, it facilitates ongoing reform in teaching strategies, which is essential for both immediate recovery and future preparedness.

  Tackling economic inequality

  Online education can positively impact economic inequality by providing broader access to quality education, which is crucial for sustainable economic development. By enabling internet access for education, more individuals in low-income and remote areas can gain skills and knowledge that are essential for economic mobility. This access helps to level the playing field between the economically advantaged and disadvantaged, thus reducing educational disparities. Studies have shown that improving internet access leads to a reduction in educational inequality, which in turn can foster greater economic equality. Furthermore, the ability to participate in online learning can lead to better job opportunities and higher income levels, contributing to the economic growth of a country and lessening the gap between different socio-economic groups

  Equal opportunity

  universal access to high-quality education, regardless of geographical location or socio-economic status. Digital platforms allow for the delivery of educational content that can be tailored to meet diverse learning needs, promoting inclusivity. Additionally, technology-driven solutions can bridge the digital divide by ensuring all students have access to the necessary tools and internet connectivity, thereby leveling the educational playing field. This democratizes education, enabling learners from marginalized or remote communities to participate fully and benefit equally from educational resources and assessments .

  Wellbeing

  Online education and assessment can positively impact student wellbeing by offering more flexible learning environments that cater to individual needs and schedules. This flexibility often leads to increased time efficiency and reduced stress, as students can learn at their own pace and in more comfortable settings. Additionally, online education can enhance student-friendliness, provide unlimited attention from teachers due to digital accessibility, and foster a sense of autonomy and self-confidence. Such environments also allow for more personalized feedback during assessments, which can be crucial for learning and emotional support.

Pricing

• Price: £6,235 to £316,800 a licence a year
• Discount for educational organisations: No
• Free trial available: Yes
• Description of free trial: Questionmark provides a 30-day free trial to allow evaluation of the service. Upon request for a free trial, the propsective client will be contacted by a member of the Questionmark team briefly, and set up with a demonstration area that meets the client's requirements.

Service documents

• Pricing document

  PDF

• Service definition document

  PDF

• Terms and conditions

  PDF

Request an accessible format

If you use assistive technology (such as a screen reader) and need versions of these documents in a more accessible format, email the supplier at qmbusinessdevelopment@learnosity.com. Tell them what format you need. It will help if you say what assistive technology you use.