Software AG (UK) Limited

StreamSets Data Integration

Data Integration for On Premise, Hybrid and Multi Cloud Environments.
StreamSets Data Collector Engine is an easy-to-use data pipeline engine for streaming, ETL, ELT, Reverse ETL, CDC and batch ingestion from any source to any destination. Data Transformation for Spark, Databricks and Snowflake .

Features

• Build pipelines for streaming, batch and CDC
• Drag and Drop low code/no code development
• Port data pipelines to new data platforms without rewrites
• Leverage Apache Spark for ETL and ML with Streamsets Transformer
• Perform complex processing in Snowflake without SQL queries or templates
• Python SDK for automated pipelines and repeatability
• Observability over entire data landscape with Control Hub
• Observe and alert for Performance, Schema Drift, Quality, Data SLAs
• Enable AI through clean data from disparate sources

Benefits

• Eliminate 90% of break-fix and maintenance time
• Up to 10x faster than legacy ETL approaches
• Significant reduction in onboarding time for new data sources
• Up to 60% reduction in pipeline deployment time
• Up to 10x reduction in developer effort
• Enable Data, BI and AI at the speed of business
• Up to 10x confidence throughout the data lifecycle

£48,230 a unit a year

• Free trial available

Service documents

• Pricing document

  PDF

• Skills Framework for the Information Age rate card

  PDF

• Service definition document

  PDF

• Terms and conditions

  PDF

Request an accessible format

If you use assistive technology (such as a screen reader) and need versions of these documents in a more accessible format, email the supplier at maurice.hancock@softwareag.com. Tell them what format you need. It will help if you say what assistive technology you use.

Framework

G-Cloud 14

Service ID

384201183911953

Contact

Maurice Hancock
07964 244563
maurice.hancock@softwareag.com

Service scope

• Software add-on or extension: No
• Cloud deployment model:
  • Public cloud
  • Private cloud
  • Community cloud
  • Hybrid cloud
• Service constraints: Requires an Outbound connection to StreamSets Control Hub
• System requirements:
  • Minimum 2 CPU Cores
  • Minimum 1GB Memory
  • Minimum 6 GB Storage
  • Linux based OS or Running within a Docker type instance

User support

• Email or online ticketing support: Email or online ticketing
• Support response times: P1 - 2 Hrs, P2 = 24 Hrs, P3 & P4 = 3 Days.
• User can manage status and priority of support tickets: Yes
• Online ticketing support accessibility: None or don’t know
• Phone support: Yes
• Phone support availability: 24 hours, 7 days a week
• Web chat support: No
• Onsite support: Yes, at extra cost
• Support levels: Our Standard offering is Gold Support; You can opt for Platinum at additional fee or reduce to Silver.; Enterprise customers receive a Customer success engineer as part of the service offering; ; Silver Support. (a) Support hours from 8:00 a.m. to 5:00 p.m. Pacific Time or Central European Time (as determined by StreamSets based on Customer’s location) on Monday through Friday (excluding StreamSets holidays); (b) Issue submission from up to four (4) Technical Contacts and (c) StreamSets Support personnel assign a priority level to each Issue in their sole discretion and seek to provide responses to Issues during support hours in accordance with the table published at https://streamsets.com/legal/support-policy/.; Gold Support. (a) Support 24 hours per day, 7 days per week; (b) Issue submission from up to eight (8) Technical Contacts and (c) StreamSets Support personnel assign a priority level to each Issue in their sole discretion and seek to provide responses to Issues during support hours in accordance with the table from the previous link.; Platinum Support. Same as Gold Support but includes Issue submission from up to sixteen (16) Technical Contacts.
• Support available to third parties: Yes

Onboarding and offboarding

• Getting started: We have extensive online training and enablement options including a quick start wizard in the Control Hub, Our online training system called Academy gives new users a guided walkthrough on how to build assets in a safe environment. We also have solution accelerators and packaged service offerings.; ; We provide proof of value and guided assistance from our Solution Engineering team where required also.; ; We also have a open set of documentation which you can access without a platform login
• Service documentation: Yes
• Documentation formats: HTML
• End-of-contract data extraction: We do not hold actual data, The Pipeline designs can be exported from the platfrom from the UI, API or SDK.
• End-of-contract process: StreamSets services will cease; the institution using StreamSets will be informed to cease using their engines and uninstall the application.

Using the service

• Web browser interface: Yes
• Supported browsers:
  • Microsoft Edge
  • Firefox
  • Chrome
  • Safari
• Application to install: No
• Designed for use on mobile devices: No
• Service interface: Yes
• User support accessibility: None or don’t know
• Description of service interface: Streamsets has a service portal for access to service and support
• Accessibility standards: None or don’t know
• Description of accessibility: Accessibility is through HTML forms
• Accessibility testing: None
• API: Yes
• What users can and can't do using the API: From within the platform there is a API microsite that offers users the ability to control their experience, generating API Credentials is also done from within the control hub. The APIs allow control of the pipelines, jobs, engines and many other aspects of the platform
• API documentation: Yes
• API documentation formats:
  • Open API (also known as Swagger)
  • HTML
• API sandbox or test environment: No
• Customisation available: No

Scaling

• Independence of resources: Whilst we operate a multi-tenanted environment, this is only the control plane; this is run on Kubernetes and scales to demand. Specific local demand will be related to the deployed data collectors, which are to customer configuration. This could be Kubernetes or specific compute instances

Analytics

• Service usage metrics: Yes
• Metrics types: We can provide metrics on the pipeline performance, the records throughput, errors and a whole range of audit extracts
• Reporting types:
  • API access
  • Real-time dashboards
  • Regular reports
  • Reports on request

Resellers

• Supplier type: Not a reseller

Staff security

• Staff security clearance: Other security clearance
• Government security clearance: Up to Security Clearance (SC)

Asset protection

• Knowledge of data storage and processing locations: Yes
• Data storage and processing locations: European Economic Area (EEA)
• User control over data storage and processing locations: Yes
• Datacentre security standards: Supplier-defined controls
• Penetration testing frequency: At least every 6 months
• Penetration testing approach: Another external penetration testing organisation
• Protecting data at rest: Encryption of all physical media
• Data sanitisation process: No
• Equipment disposal approach: Complying with a recognised standard, for example CSA CCM v.30, CAS (Sanitisation) or ISO/IEC 27001

Data importing and exporting

• Data export approach: We do not hold the actual data of the customer, We do hold metadata on the pipeline designs, These can be exported via the UI, SDK or upon request to Support
• Data export formats: Other
• Other data export formats: JSON
• Data import formats:
  • CSV
  • ODF
  • Other
• Other data import formats:
  • JSON
  • XML
  • Binary
  • Protobuf
  • Parquet

Data-in-transit protection

• Data protection between buyer and supplier networks:
  • Private network or public sector network
  • TLS (version 1.2 or above)
• Data protection within supplier network:
  • TLS (version 1.2 or above)
  • IPsec or TLS VPN gateway

Availability and resilience

• Guaranteed availability: https://streamsets.com/legal/sla/ gives a full overview of our SLAs, an extract is included; Target Availability. StreamSets will use commercially reasonable efforts to make the Service available with an uptime of 99.9% of each calendar month (“Target Availability“).; Exclusions apply; Service Credits. If there is a verified failure of the Service to meet Target Availability in a particular month and Customer makes a request for service credits within thirty (30) days after the end of such month, Customer will be entitled to a credit based on the monthly fees due for the affected Service in such month (“Service Credit”). The Service Credit will calculated as follows:
• Approach to resilience: Available on request
• Outage reporting: We issue email alerts and have a public dashboard for any outages https://status.streamsets.com/

Identity and authentication

• User authentication needed: Yes
• User authentication:
  • Identity federation with existing provider (for example Google Apps)
  • Username or password
• Access restrictions in management interfaces and support channels: The product has the concept of user levels and groups depending on these access levels depend on the range of settings exposed to a user. in addition we have a list of authorised personel allowed to raise support tickets in order to ensure controls are appropriately governed
• Access restriction testing frequency: At least every 6 months
• Management access authentication:
  • Identity federation with existing provider (for example Google Apps)
  • Username or password

Audit information for users

• Access to user activity audit information: Users have access to real-time audit information
• How long user audit data is stored for: Between 6 months and 12 months
• Access to supplier activity audit information: Users have access to real-time audit information
• How long supplier audit data is stored for: Between 6 months and 12 months
• How long system logs are stored for: User-defined

Standards and certifications

• ISO/IEC 27001 certification: Yes
• Who accredited the ISO/IEC 27001: DQS GmbH
• ISO/IEC 27001 accreditation date: 26/01/2021
• What the ISO/IEC 27001 doesn’t cover: Software AG has certification for compliance with ISO/IEC 27001:2013, ISO/IEC 27017:2015, and ISO/IEC 27018:2019. Software AG Standard and Managed Cloud Services as listed in the certification scope statement delivered by Cloud Operations and PS Managed Services including supporting operation functions. https://www.softwareag.com/en_corporate/company/iso-certified.html
• ISO 28000:2007 certification: No
• CSA STAR certification: No
• PCI certification: No
• Cyber essentials: Yes
• Cyber essentials plus: No
• Other security certifications: Yes
• Any other security certifications:
  • ISO/IEC 27001:2013, ISO/IEC 27017:2015, ISO/IEC 27018:2019
  • Complies with SOC 2 standards
  • Complies with SOC 3 standards

Security governance

• Named board-level person responsible for service security: Yes
• Security governance certified: Yes
• Security governance standards: ISO/IEC 27001
• Information security policies and processes: Security testing and policies (SOC) Type II, independent third-party auditor certification AICPA Trust Services Implement and maintain a standards based ISMS Comply with (IaaS) provider, Amazon Web Services security policy Cloud Security Alliance (CSA) CSA Consensus Assessment Initiative Questionnaire (CAIQ) Security testing type Penetration testing IT Health Checks Risk analysis Other

Operational security

• Configuration and change management standard: Conforms to a recognised standard, for example CSA CCM v3.0 or SSAE-16 / ISAE 3402
• Configuration and change management approach: Components of the service are tracked through the lifetime via standard services which include regular upgrades to latest software versions (following release cycle); seamless patching during maintenance windows to minimize vulnerabilities or bug impact; performance monitoring and service continuity and recovery procedures for high up-time. Changes are assessed for potential security impact through security testing performed after each release or change to the cloud environment. A standard release process is used to manage the changes and track through to completion.
• Vulnerability management type: Supplier-defined controls
• Vulnerability management approach: A formal risk management program is used to identify potential new threats, vulnerabilities or exploitation techniques which could affect the service. These are assessed and corrective action is taken. Depending on severity, Critical patches are assessed and installed within 48 hours, Important patches in the next maintenance release and moderate patches in the next general release. Relevant sources of information relating to threat, vulnerability and exploitation techniques are monitored by the service provider. This includes threat/security awareness systems, vulnerability databases, security bulletins/advisories/RSS feeds. Service provider timescales for implementing mitigation's are understood and are deemed acceptable.
• Protective monitoring type: Supplier-defined controls
• Protective monitoring approach: Our auditor’s SOC 2 Type II report certifies the operational effectiveness of our systems that keep your sensitive data secure. This provides a high level of transparency into our controls that mitigate operational and compliance risks. Because it requires an attestation by an independent and objective CPA who bears professional liability for his or her opinion, the SOC 2 is more stringent and credible than other types of reporting on information security controls.
• Incident management type: Undisclosed
• Incident management approach: Our auditor’s SOC 2 Type II report certifies the operational effectiveness of our systems that keep your sensitive data secure. This provides a high level of transparency into our controls that mitigate operational and compliance risks. Because it requires an attestation by an independent and objective CPA who bears professional liability for his or her opinion, the SOC 2 is more stringent and credible than other types of reporting on information security controls.

Secure development

• Approach to secure software development best practice: Conforms to a recognised standard, but self-assessed

Public sector networks

• Connection to public sector networks: No

Social Value

• Social Value:

  Social Value

  • Fighting climate change
  • Covid-19 recovery
  • Tackling economic inequality
  • Equal opportunity
  • Wellbeing

  Fighting climate change

  Sustainability and responsible action are guiding principles in Software AG’s business operations. We are certain that ethically correct behaviour and economic success belong together. To protect future generations and our planet, Software AG is committed to creating not only economic, but also ecological and social value.; Software AG is actively striving to reduce its environmental footprint. To mitigate the effects of its business activities on the planet, we are working toward a plan to become climate-neutral as quickly as possible by setting targets in the environmental area. With the help of its technology and solutions, Software AG will join forces with its customers and partners to tackle the most significant environmental challenges of the modern world and help mitigate the climate crisis, ultimately shaping a more sustainable future.

  Covid-19 recovery

  Since the beginning of the COVID-19 pandemic in 2020, four years have passed, and the global economy is still recovering from the adverse effects of multiple lockdowns in most countries of the world. Fortunately, the freezing of companies, postponed or extended investment activities, and extensive restrictions on business travel only had minor effects on Software AG’s business operations. We implemented a hybrid working model with many business meetings, trainings, and other operations being conducted online. Today, this has become the default working model, which not only has not hindered business operations but allowed for greater flexibility and increased efficiency for employees and business partners alike.; The COVID-19 crisis shed light on the lack of digitalization in business processes worldwide. This resulted in additional business opportunities for Software AG, particularly in the Digital Business segment, which would compensate, or even overcompensate, for the negative effects on the global economy.

  Tackling economic inequality

  Sustainable economic growth is of key significance to Software AG's business since it contributes to our long-term stability and positive impact on our employees, investors, and customers. Software AG’s leadership is convinced that having a sustainable business strategy not only promotes economic growth but is also essential to live up to the Company's own requirements pertaining to ESG matters.; Software AG recognizes the need to address economic inequality on a global scale and within the UK. We are committed to tackling the issue through various initiatives aimed at creating new jobs and business opportunities, while simultaneously increasing the resilience of its supply chain and sustainable practices therein. To achieve this goal, Software AG would prioritize job creation initiatives, training and development of employees’ skills, and vital partnerships with local communities and organizations to enhance the development of less privileged individuals. To enhance its supply chain, we would work towards expanding our sourcing options and fostering partnerships with local suppliers in the UK.

  Equal opportunity

  A company’s corporate culture, encompassing its values and norms, serves as the glue that holds it together. This culture not only influences employee performance, but also facilitates the achievement of business objectives. It is supported by a framework that outlines the expectations for individual behaviour, beliefs, actions, and decisions. In March 2022, Software AG introduced its Culture Framework, which is focused around three core Ps: people, passion, and products, serving as the backbone of Software AG’s operations. The Culture Framework establishes inclusion, integrity, and innovation as the fundamental values guiding leadership practices. These values unite Software AG as a company and offer practical guidance on communication, interaction, and decision-making. Diversity, equity, and inclusion (DE&I) are an integral part of Software AG’s Culture Framework. Recognizing the interconnectedness of corporate culture, employee satisfaction, and engagement, Software AG has implemented a variety of initiatives to better understand these principles and positively influence its corporate culture. The dedication shown by Software AG's employees, coupled with their professional and personal abilities, decisively contributes to our success. Overlooking employee concerns poses a fundamental risk of (generally indirect) negative impacts on business performance. Examples of this include situations when low employee satisfaction leads to attrition and a loss of company-specific expertise, or when a lack of diversity in the corporate environment hampers innovation. For this reason, Software AG deploys a variety of initiatives aimed at fostering high employee satisfaction and nurturing an innovative and diverse corporate culture while actively monitoring employee engagement. Since 2020, Software AG has been a member of The Valuable 500, a global business collective of companies dedicated to innovation in disability inclusion. Software AG is also a member of the Initiative Women into Leadership (IWiL), a non-profit association that facilitates long-term mentoring and promotion of women at the top level.

  Wellbeing

  Software AG is committed to fostering a corporate culture grounded in respect, transparency, and inclusion. The company continues to focus on attracting and retaining the best talent, nurtured through employee engagement and an inclusive and equitable working environment— where all employees can thrive and unleash their full potential. ; Software AG offers an Employee Assistance Program (EAP), which provides employees with around-the-clock professional counselling free of charge. Yet, Software AG not only takes care of its own employees but is actively involved in improving community integration. For instance, our own Give Back to the World initiatives engages in several projects in the UK with an environmental or social value, tackling issues such as prevention of domestic violence, mitigation of deforestation, and promoting a healthy and active lifestyle.

Pricing

• Price: £48,230 a unit a year
• Discount for educational organisations: No
• Free trial available: Yes
• Description of free trial: We provide access to the software for the duration of a trial period which is typically for 30 days
• Link to free trial: https://cloud.login.streamsets.com/signup

Service documents

• Pricing document

  PDF

• Skills Framework for the Information Age rate card

  PDF

• Service definition document

  PDF

• Terms and conditions

  PDF

Request an accessible format

If you use assistive technology (such as a screen reader) and need versions of these documents in a more accessible format, email the supplier at maurice.hancock@softwareag.com. Tell them what format you need. It will help if you say what assistive technology you use.