IBM Engineering Test Management SaaS
IBM® Engineering Test Management SaaS is a web-based centralized test management environment that allows quality professionals to effectively collaborate on all aspects of testing including test planning, construction, implementation, lab management and execution.
Features
- Manage Test Plans, Cases, Scripts, Environments and Results
- Real-time dashboards and near real time reporting
- Powerful self-service reporting
- Built-in manual test execution capability
- Traceability between tests and other lifecycle artifacts
- Built on Jazz technology allowing integration with other lifecycle tools
- Integration with IBM, open source and comptitive automated test tools
- Project scalability, regardless of size or number of users
- Offline test execution via Excel or mobile application
- Comprehensive activity management and planning
Benefits
- Improve collaboration across Systems and software engineering teams
- Increase traceability and visibility of changes across the product lifecycle
- Faster impact assessment of proposed requirements changes and better quality
- Quickly identify gaps in test coverage
- Built on Jazz technology allowing integration with other lifecycle tools
- Open and vibrant Jazz user community
Pricing
£134 to £325 a user a month
- Free trial available
Service documents
Request an accessible format
Framework
G-Cloud 13
Service ID
9 2 6 3 2 7 8 8 3 1 9 9 5 4 5
Contact
IBM United Kingdom Ltd
Anne-Marie Wheeler
Telephone: 0207 202 3000
Email: ukcat@uk.ibm.com
Service scope
- Software add-on or extension
- Yes, but can also be used as a standalone service
- What software services is the service an extension to
- IBM Engineering Test Management (ETM) is part of IBM's Engineering Lifecycle Management solution, allowing test cases to be traced to other lifecycle assets such as requirements and development tasks.
- Cloud deployment model
-
- Public cloud
- Private cloud
- Hybrid cloud
- Service constraints
- Service constraints Upgrades will be applied equivalent to on-premise product GA. The SaaS operations team will test a number of test scenarios to ensure a smooth upgrade, before conducting production upgrades. Customers will be given 7 days notice for major upgrades. For minor releases, customers will be automatically upgraded. OS patches are applied weekly. If there are product security patch alerts, IBM will notify the customer and apply the patches as soon as the customer can accept the outage.
- System requirements
-
- Modern browsers including Chrome, Firefox and Safari are supported
- A list of supported browsers and their versions is available
User support
- Email or online ticketing support
- Email or online ticketing
- Support response times
-
IBM’s software support is available 24/7 basis globally. Response time coverage is 24/7 to Severity 1 incidents and Monday to Friday Business hours for Severity 2-4 incidents.
See also IBM Support Guide https://www-01.ibm.com/support/docview.wss?uid=ibm10733923" - User can manage status and priority of support tickets
- Yes
- Online ticketing support accessibility
- None or don’t know
- Phone support
- Yes
- Phone support availability
- 9 to 5 (UK time), Monday to Friday
- Web chat support
- Web chat
- Web chat support availability
- 9 to 5 (UK time), Monday to Friday
- Web chat support accessibility standard
- None or don’t know
- How the web chat support is accessible
- There are two options for Web Chat; Chat with Watson (AI) or Chat with agent. Live chat is accessible when a new support case is created or from the records of an existing support case. Web chat is available for the exchange of text commands and is particularly useful in noisy environments or when calls or screen sharing are not allowed.
- Web chat accessibility testing
- Not aware of any tests performed
- Onsite support
- Yes, at extra cost
- Support levels
- Product and service support are included in the SaaS offering, depending on the severity of the issue raised, support will be 24x7 for severity 1 or local business hours for severities 2 - 4.
- Support available to third parties
- Yes
Onboarding and offboarding
- Getting started
- A welcome pack is provided instructing the customer how to access the system, create new users and report issues to support. User documentation is available online. The account team selling the solution would always recommend services days are taken to cover user training, this can be onsite, online or classroom based. Services will be chargable.
- Service documentation
- Yes
- Documentation formats
- HTML
- End-of-contract data extraction
- IBM will return the Client Data within a reasonable period in a reasonable and common format upon receiving written instructions from the Client prior to termination or expiration.
- End-of-contract process
-
The infrastructure is based on the VMWare images and once a customer terminates contract and transfers data, IBM decommission the images and data is gone at that point.
The SaaS offering consists of an IBM Engineering Test Management environment accessed via the cloud for an agreed number of users. The charging metric is based on the number of unique logins per month. The contract includes 2 upgrades per year and technical support.
Using the service
- Web browser interface
- Yes
- Supported browsers
-
- Microsoft Edge
- Firefox
- Chrome
- Safari
- Application to install
- No
- Designed for use on mobile devices
- No
- Service interface
- No
- User support accessibility
- None or don’t know
- API
- Yes
- What users can and can't do using the API
- IBM Engineering Test Management provides a REST API
- API documentation
- Yes
- API documentation formats
- HTML
- API sandbox or test environment
- No
- Customisation available
- Yes
- Description of customisation
- IBM Engineering Test Management includes industry recognised test assets such as Test Plans, Test Cases, Test Scripts, Test Environments and Test Results. Users are able to customise these and other assets by adding user defined sections, attributes and categories. These could be text, integer or user defined drop down lists for items such as priority, risk or release. These are typically incorporated into templates used by the test team and ensure the correct information is being captured. Users can also define the work flow used by these test assets, ensuring a test plans, cases and scripts get reviewed and approved before being executed. These and other changes are performed in the projects properties by a project administrator.
Scaling
- Independence of resources
- The architecture of IBM cloud services maintains logical separation of client data. Internal rules and measures separate data processing, such as inserting, modifying, deleting, and transferring data, according to the contracted purposes.
Analytics
- Service usage metrics
- Yes
- Metrics types
-
Available on request
- Unique user logins per month
- Concurrent peak users per month - Reporting types
-
- Real-time dashboards
- Reports on request
Resellers
- Supplier type
- Not a reseller
Staff security
- Staff security clearance
- Other security clearance
- Government security clearance
- Up to Developed Vetting (DV)
Asset protection
- Knowledge of data storage and processing locations
- Yes
- Data storage and processing locations
- United Kingdom
- User control over data storage and processing locations
- No
- Datacentre security standards
- Complies with a recognised standard (for example CSA CCM version 3.0)
- Penetration testing frequency
- At least once a year
- Penetration testing approach
- ‘IT Health Check’ performed by a Tigerscheme qualified provider or a CREST-approved service provider
- Protecting data at rest
-
- Physical access control, complying with CSA CCM v3.0
- Physical access control, complying with SSAE-16 / ISAE 3402
- Physical access control, complying with another standard
- Encryption of all physical media
- Scale, obfuscating techniques, or data storage sharding
- Data sanitisation process
- Yes
- Data sanitisation type
- Explicit overwriting of storage before reallocation
- Equipment disposal approach
- Complying with a recognised standard, for example CSA CCM v.30, CAS (Sanitisation) or ISO/IEC 27001
Data importing and exporting
- Data export approach
- The IBM Engineering Test Management product provides various reporting and export options from the user interface. These include exporting to PDF or reporting using PDF, HTML or XLS/XLSX formats
- Data export formats
-
- CSV
- Other
- Other data export formats
-
- HTML
- Excel
- Data import formats
-
- CSV
- Other
- Other data import formats
-
- Excel
- XML
- Word
Data-in-transit protection
- Data protection between buyer and supplier networks
-
- TLS (version 1.2 or above)
- IPsec or TLS VPN gateway
- Other
- Other protection between networks
- IBM will encrypt content not intended for public or unauthenticated viewing when transferring content over public networks. Further, unless excluded by a TD, IBM will enable use of a cryptographic protocol, such as HTTPS, SFTP, and FTPS, for Client’s secure transfer of content to and from the Cloud Service over public networks.
- Data protection within supplier network
-
- TLS (version 1.2 or above)
- IPsec or TLS VPN gateway
Availability and resilience
- Guaranteed availability
- IBM Service Level Objectives (SLO) is 99.9%
- Approach to resilience
- Available on Request
- Outage reporting
- Email notification of planned outages.
Identity and authentication
- User authentication needed
- Yes
- User authentication
-
- Public key authentication (including by TLS client certificate)
- Username or password
- Access restrictions in management interfaces and support channels
- IBM maintains individual role-based authorization of privileged accounts that is subject to regular validation. A privileged account is a duly authorized IBM user identity with administrative access to a Cloud Service, including associated infrastructure, networks, systems, applications, databases and file systems.
- Access restriction testing frequency
- At least every 6 months
- Management access authentication
-
- Public key authentication (including by TLS client certificate)
- Username or password
Audit information for users
- Access to user activity audit information
- Users contact the support team to get audit information
- How long user audit data is stored for
- Between 1 month and 6 months
- Access to supplier activity audit information
- Users contact the support team to get audit information
- How long supplier audit data is stored for
- Between 1 month and 6 months
- How long system logs are stored for
- Between 1 month and 6 months
Standards and certifications
- ISO/IEC 27001 certification
- Yes
- Who accredited the ISO/IEC 27001
- Bureau Veritas
- ISO/IEC 27001 accreditation date
- 21/12/2021
- What the ISO/IEC 27001 doesn’t cover
- The infrastructure and platform this offering is run on is ISO/IEC 27001 compliant. The current SaaS application is not compliant, but does have an ISO 27001 Attestation.
- ISO 28000:2007 certification
- No
- CSA STAR certification
- Yes
- CSA STAR accreditation date
- 20/04/2016
- CSA STAR certification level
- Level 1: CSA STAR Self-Assessment
- What the CSA STAR doesn’t cover
- The infrastructure and platform this offering is run on has a CSA STAR Self-Assessment certificate. The SaaS side of this offering currently does not have this. The IBM CSA Star Self-Assessment can be viewed here https://cloudsecurityalliance.org/star-registrant/softlayer/
- PCI certification
- No
- Cyber essentials
- No
- Cyber essentials plus
- Yes
- Other security certifications
- Yes
- Any other security certifications
- ISO 27001 Attestation
Security governance
- Named board-level person responsible for service security
- Yes
- Security governance certified
- Yes
- Security governance standards
- ISO/IEC 27001
- Information security policies and processes
-
IBM has an Information Technology (IT) Security policy that establishes the requirements for the protection of IBM's worldwide IT systems and the information assets they contain, including networks and computing devices such as servers, workstations, host computers, application programs, web services, and telephone systems within the IBM infrastructure. IBM’s IT Security policy is supplemented by standards and guidelines, such as the Security Standards for IBM's Infrastructure, the Security and Use Standards for IBM Employees and the Security Guidelines for Outsourced Business Services. Such are reviewed by a cross-company team led by the IT Risk organization every six months.
IBM has a dedicated Vice President of IT Security who leads a team responsible for IBM's own enterprise data security standards and practices. Responsibility and accountability for executing internal security programs is established through formal documented policies. IBM Services teams also have dedicated executives and teams who are responsible for information and physical security in the delivery of our client services.
Operational security
- Configuration and change management standard
- Conforms to a recognised standard, for example CSA CCM v3.0 or SSAE-16 / ISAE 3402
- Configuration and change management approach
- IBM maintains policies and procedures to manage risks associated with the application of changes to its Cloud Services. Prior to implementation, all changes to a Cloud Service, including its systems, networks and underlying components, will be documented in a registered change request that includes a description and reason for the change, implementation details and schedule, a risk statement addressing impact to the Cloud Service and its clients, expected outcome, rollback plan, and documented approval by IBM management or its authorized delegate.
- Vulnerability management type
- Conforms to a recognised standard, for example CSA CCM v3.0 or SSAE-16 / ISAE 3402
- Vulnerability management approach
- With each Cloud Service, as applicable and commercially reasonable, IBM will a) perform penetration testing and vulnerability assessments before production release and routinely thereafter, b) enlist a qualified and reputable independent third-party to perform penetration testing and ethical hacking at least annually, c) perform automated management and routine verification of underlying components’ compliance with security configuration requirements, and d) remediate any identified vulnerability or noncompliance with its security configuration requirements based on associated risk, exploitability, and impact. IBM takes reasonable care to avoid Cloud Service disruption when performing its tests, assessments, scans, and execution of remediation activities.
- Protective monitoring type
- Conforms to a recognised standard, for example CSA CCM v3.0 or SSAE-16 / ISAE 3402
- Protective monitoring approach
- IBM maintains and follows policies requiring administrative access and activity in its Cloud Services’ computing environments to be logged and monitored, and the logs to be archived and retained in compliance with IBM’s worldwide records management plan. IBM monitors privileged account use and maintain security information and event management policies and measures designed to a) identify unauthorized administrative access and activity, b) facilitate a timely and appropriate response, and c) enable internal and independent third party audits of compliance with such policies. IBM systematically monitors the health and availability of production Cloud Service systems and infrastructure at all times.
- Incident management type
- Conforms to a recognised standard, for example, CSA CCM v3.0 or ISO/IEC 27035:2011 or SSAE-16 / ISAE 3402
- Incident management approach
-
IBM:
- maintains and follows incident response policies aligned with NIST guidelines for computer security incident handling, will comply with data breach notification requirements under applicable law.
- investigates incidents, including unauthorised access, use of content or the Cloud Service, of which IBM becomes aware, and, if warranted, define and execute an appropriate response plan.
- promptly notifies Client upon determining that a security incident known or reasonably suspected by IBM to affect Client has occurred.
- provides Client with reasonably requested information about such security incident and status of applicable remediation and restoration activities performed or directed by IBM.
Secure development
- Approach to secure software development best practice
- Supplier-defined process
Public sector networks
- Connection to public sector networks
- No
Social Value
- Fighting climate change
-
Fighting climate change
In February 2021, IBM committed to achieving net zero greenhouse gas emissions globally by 2030. On this path, IBM are on track to have reduced greenhouse gas emissions by 65% (against 2010 base) in 2025, and 75% of our global electricity consumption will be from renewables by 2025. The IBM UK Carbon Reduction Plan (CRP) is published annually in which we report progress in achieving Net Zero.
In fulfilling our responsibilities under our contracts, our staff operate in line with our IBM Environmental Policy and implemented through our worldwide Environmental Management System (EMS), which covers objectives including achieving our net zero greenhouse gas commitment, reduction in water use, reduction in waste going to landfill, creating green space, enhancing the natural environment and improving air quality. Local initiatives are in place around IBM locations, including on shared or zero-carbon travel, with various cycle-to-work and car-share initiatives and incentives, and through environmentally focused volunteering.
To influence staff, suppliers, customers and communities through the delivery of the contract to support environmental protection and improvement, we include Social Responsibility and Environmental Management requirements in subcontracts, and encourage staff to work with the wider teams on improvements. In some locations, a ‘Environmental Business Resource Group’ promotes sustainability and plans community-based volunteer work.
In 2020 IBM launched the responsible.computing() initiative, which addresses modern computing challenges and integrates aspects of sustainability, climate, ethics, openness, privacy and security. We assess proposed technical solutions against efficient energy usage.
IBM began detailed tracking and monitoring of our environmental footprint in 1990 - being forthright and transparent in our impact long before it was fashionable or required. We have made significant improvements over the last 30 years and will continue to always report transparently on impacts and our progress. - Covid-19 recovery
-
Covid-19 recovery
To help local communities manage and recover from the impacts of COVID-19 IBM have created employment and re-training opportunities. IBM provide a free, fully online offering called SkillsBuild Reignite, tailored for job seekers, and those needing to grow their digital skills. Once an initial 30-hours of online learning is completed, Reignite offers free one-on-one coaching, seminars and facilitated discussions from IBM volunteers.
IBM encourage our staff, suppliers and customers to support our communities. The IBM.org Volunteer’s Portal manages over 1.3 million hours of volunteering by IBM employees.
We support our extensive ecosystem of external SME's manage and recover from the impacts of COVID-19. IBM has invested to help reduce barriers to entry that may preclude participation in delivery by SMEs. This could relate to financial standing, ability to accept risk, invest in bids, or ability to supply sufficient volumes of resources.
We have several initiatives to support staff with the impact of the COVID-19 pandemic and extend those initiatives to the clients we partner with. Mental health support is available at all times to all of our staff and their families, and we train volunteering staff as mental health first aiders. We have many programmes in place to tailor a gradual return to health and work following illness.
IBM reimagined many of our workplaces and policies to support COVID-19 recovery and are committed to ongoing safe working to reduce demand on health and care services. We have also implemented our Work from Home Pledge & Hybrid Working Pledge for all staff, which ensures we establish and respect new boundaries and support each other in this new way of working and living. We published our ‘Return to Workplace Playbook’ to manage the safe return to both IBM and client workplaces. IBM is promoting an ongoing Hybrid working approach. - Tackling economic inequality
-
Tackling economic inequality
IBM invest to understand of the causes and effects of inequality. We run multiple initiatives to attempt to level opportunity, focused on our stated social-responsibility goal to support education and skills development in Science and Technology, with a specific focus on those who may not otherwise be attracted, or have the opportunity, to develop those skills.
The ‘IBM Ignite’ scheme, a national Movement to Work programme, offers vocational traineeships and work experience to disadvantaged youth unemployed. Together with City Gateway, our London charity partner, IBM offer 5-week, onsite, workplace programmes to break the cycle of ‘no work experience, no job’.
IBM are proud to have created skillsbuild.org. This is a global programme, and for the UK offering IBM have partnered with ACH.org.uk, a social enterprise working to resettle refugees through labour market and social integration, City Gateway, a London charity working with disadvantaged young people, women and families in deprived areas to build skills and ambition, and SaluteMyJob, a charity creating opportunities for ex-Servicemen and women under the armed forces covenant. The SkillsBuild programmes offer training, in-person support, credentials and opportunities to put the learning into practice. In addition to the direct training through charity partners, SkillsBuild Reignite is now also available free to all online. The SkillsBuild training gives recognised qualifications to those searching for employment in a digital economy. In addition, the programme gives job-search skills, teaches agile methods and design thinking, and has specific training in growing IT fields, such as cybersecurity, big data, artificial intelligence.
IBM UK employ over 250 school-leaver apprentices every year. Our award-winning programme offers apprenticeships ranging from Level 3 to Level 6, with more than half of the apprentices applying and continuing their employment with IBM. - Equal opportunity
-
Equal opportunity
In 1942, IBM hired blind psychologist Michael Supa to create a programme for hiring and training people with disabilities. Supa then worked in IBM institutionalising disability representation and equality for 37 years, and 80 years after he was hired IBM continue to lead in Accessibility, Inclusive hiring and Representation to reduce the disability employment gap. The Accessible Workplace Connection portal makes it easy for managers to accommodate IBMers who consider themselves to have disabilities, and all recruitment activities are accessible and open. IBM support all employees in training and developing new skills relevant to them, with at least 40 hours of structured training required every year. The training can link to recognised, external qualifications, building skills relevant to the contract. IBM is accommodating of those with additional needs, ensuring all training is inclusive.
IBM believes that a diverse and inclusive work environment drives higher quality delivery. We have created employment and training opportunities for those with protected characteristics in the UK since 1912. Our 300+ employee-led communities support ethnic minorities, neurodiversity, LGBTQ+, females, veterans and more through regular events within their communities. Every IBMer completes regular mandatory Diversity & Inclusion training, and 88.3% of colleagues said that they felt that they could be their authentic selves in work. IBM run a “BeEqual” campaign and programmes, with tens of thousands of employees making a BeEqual pledge of allyship to colleagues from minority groups and 6000 IBMers globally are certified as LGBT+ Allies. In 2020, 250+ IBM employees completed apprenticeships within the UK with 42% identifying as BAME and 58% as female (supporting our Women in Technology initiatives). IBM have a culture of promotion and recruitment aiming to addresses workforce inequality for all to have the opportunity to fulfil their potential. - Wellbeing
-
Wellbeing
IBM has an advanced Health and Wellbeing Programme, recognising the criticality and benefits of a healthy and supported workforce. A wide-ranging Employee Assistance Program is provided confidentially to all employees 24/7, at no cost to them, backed up by medical insurance with annual health assessments available. IBM operate a Mental Health First Aid Programme, with over 200 qualified mental health first-aiders volunteering in the UK. These colleagues make themselves approachable as a first step. IBM UK have Disability Confident status, winning in 2021 the Best Employer for Diversity and Inclusion award from WM UK, due to the broad focus on D&I throughout the pandemic, including hidden disabilities and neurodiversity. IBM has a global neurodiversity hiring program (ND@IBM).
In the new model of home and hybrid working since 2020, various initiatives have been created to maintain and improve both mental and physical health when working remotely. The IBM Working from Home Pledge includes commitments to take time out for yourself, and to check-in regularly on colleagues. It was recognised that working alone can be challenging for some, and regular sessions, support programmes and training is now in place to keep people connected. Managers have undertaken training to recognise those struggling and have tools of early support. A “2020 health challenge” was taken up by 20% of the permanent employee population, with 69% of participants reported being less stressed, 74% exceeded 10,000 steps a day. Ergonomic equipment to create a better working-from-home environment is available to all.
Within projects and programmes, and as part of contract delivery, IBM seek to make these various initiatives available to the entire, joint team of staff, suppliers, customers and communities. Project and colleague-based support and health initiatives are expanded where possible to all.
Pricing
- Price
- £134 to £325 a user a month
- Discount for educational organisations
- No
- Free trial available
- Yes
- Description of free trial
- A fully functional trial of the IBM Engineering Test Management product is available. The time period for the evaluation can be discussed with the the IBM account team.
- Link to free trial
- Trials are available from jazz.net