Datavault Builder
Datavault Builder is a business-driven data warehouse automation tool that reliably powers (Self-Service) Business Intelligence, Data Analytics, and AI Applications. It streamlines decision-making processes with robust governance and effortless auditability. Supporting the full data warehouse lifecycle, it includes data modeling, code generation, integration, deployment, scheduling, and operations.
Features
- Data Warehouse Automation: Code Generation including ETL / ELT jobs
- Visual Data Modeling together with business (conceptual, logical data models)
- Data Profiling: Analyze value distributions and address data quality problems.
- Design historised core Data Vault and any output data format
- GIT code versioning based distributed development: branch, merge, deploy code
- Continuous Integration and Deployment: APIs to setup a CI/CD workflow
- Ensure stable operations: Automatically create, schedule, run and log jobs
- High Availability: Blue-/Green-Deployment, Hot-/Cold-Stand By
- Bi-Temporality: Historise and report bi-temporal data
- Real-time Reporting with Change Data Capture (CDC) streams
Benefits
- Enhances productivity through automation.
- Swiftly integrates new data sources, boosting agility.
- Reduces manual effort through automation and standardization
- Simplifies data modeling for non-technical users.
- Automatically upholds governance and compliance standards.
- Automatically generates documentation, increasing transparency.
- Synchronizes data model with implementation in real-time.
- Employs a business-driven approach with direct validation.
- Manages large data volumes efficiently, supports scalable growth.
- Whole Data Warehouse Lifecycle Coverage: Replaces up to nine tools.
Pricing
£990 to £1,990 a licence
- Education pricing available
- Free trial available
Service documents
Request an accessible format
Framework
G-Cloud 14
Service ID
7 7 9 5 8 0 6 2 8 1 4 6 4 0 6
Contact
Datavault
Samatha Cole
Telephone: 023 92 637171
Email: samantha.cole@data-vault.com
Service scope
- Software add-on or extension
- No
- Cloud deployment model
-
- Public cloud
- Private cloud
- Community cloud
- Hybrid cloud
- Service constraints
-
Beginning of 2024 we support the following target databases (more are following)
- Oracle
- MS SQL
- MS Azure SQL database
- Synapse
- EXASOL
- Postgres
- Snowflake - System requirements
-
- Datavault Builder is shipped as a set of docker images.
- Chromium based browser for frontend (e.g. Google Chrome, MS Edge)
- Disk Space: 50 GB (+ Target DB Disk Space)
- Memory: 16-32 GB
- CPU: 4-8 x86_64 Cores
- Any of the Linux based OS supported by Docker
- Docker: min 20.10.13+
- Docker Compose Plugin: min 2.3.3+
User support
- Email or online ticketing support
- Email or online ticketing
- Support response times
- Within one business day
- User can manage status and priority of support tickets
- Yes
- Online ticketing support accessibility
- WCAG 2.1 AA or EN 301 549
- Phone support
- No
- Web chat support
- No
- Onsite support
- Yes, at extra cost
- Support levels
- Support from 9 AM to 5 PM CET on working days is included. Other support levels can be negotiated.
- Support available to third parties
- Yes
Onboarding and offboarding
- Getting started
-
We offer the following onboarding / knowledge-sharing formats:
- Datavault Builder Online Training Environment: A web-based, hands-on, in-tool training platform that enables you to learn at your own pace. Dive into a fictitious Use Case, visually design the data model, and implement data structures and loads without writing a single line of code.
- Detailed Datavault Builder User Manual: online and up-to-date, it includes the following chapters: Navigation, Description of all modules, Initial Setup, Configuration, Maintenance, Metadata, Release Notes.
- Online Knowledge Base Wiki including API Documentation, Modeling Best Practices, Manuals, Troubleshooting, Videos, and much more
- On-demand training, consulting, and support by our partners and us - Service documentation
- Yes
- Documentation formats
-
- HTML
- Other
- Other documentation formats
-
- User Manual (HTML website)
- Knowledge Base Wiki (HTML Confluence website)
- Videos
- End-of-contract data extraction
- All metadata is accessible as database views even if the software is not running. All SQLs statements to create or load database objects are accessible in the log schema on your database even if the product is not running.
- End-of-contract process
- The product requires an active subscription for use. If you decide not to renew the subscription, please inform us within the agreed notice period. At the end of your subscription period, the front end of the application will no longer be accessible. However, you will always have direct access to all metadata, data, and structures at the database level.
Using the service
- Web browser interface
- Yes
- Supported browsers
-
- Microsoft Edge
- Chrome
- Application to install
- No
- Designed for use on mobile devices
- No
- Service interface
- Yes
- User support accessibility
- WCAG 2.1 AA or EN 301 549
- Description of service interface
- Browser-based application
- Accessibility standards
- WCAG 2.1 A
- Accessibility testing
- We have collaborated with the 'Arbeitnehmervertretungen' (employee representation boards) of larger corporations to meet as many WCAG 2.1 requirements as possible. However, the tool includes a visual data modeling element, which requires at least a minimal level of vision.
- API
- Yes
- What users can and can't do using the API
-
Datavault Builder's documented REST API provides a range of integration and automation capabilities. Anything that can be manually done in the user interface can be scripted with API calls. Key features available through the Datavault Builder API include:
- Automating operations like creating, updating, and deleting elements within the Data Vault.
- Conducting data loads and transformations.
- Managing and scheduling jobs, and setting up triggers for jobs.
- Managing delta and full loads.
For detailed API endpoints and functionalities, please refer to the specific API documentation provided in the Datavault Builder knowledge base . - API documentation
- Yes
- API documentation formats
- HTML
- API sandbox or test environment
- Yes
- Customisation available
- Yes
- Description of customisation
-
The following elements can be customized:
- Conceptual and Logical Data Model according to business needs.
- Information delivery: individual output data interfaces and data products in any granularity and format.
- Customize namings and comments of all conceptual and logical elements (hubs, links), output interfaces, and field names according to your business terminologies.
- Define your customized Business Logic for output interfaces.
- Store the calculated results in the historized Business Vault.
- Job Control: Schedule jobs, define triggers for jobs, pre- or post-job actions, delta, and full loads.
- Include custom queries in Data Staging.
- Customize the Data Warehouse Layer Architecture according to your needs (use a PSA - Persistent Staging Area and/or a Business Vault).
Scaling
- Independence of resources
- Every developer has their own Docker-based environments which are completely independent. The hosting could be on-premise, in private or public clouds. Every data consumer is accessing the data at the database level not using any application resources at all.
Analytics
- Service usage metrics
- Yes
- Metrics types
-
Datavault Builder provides comprehensive service usage metrics. The features available for service usage metrics include:
Data and Model Manipulation Logs: Datavault Builder logs any data or model manipulation, automatically capturing these logs in the database under specific schema log tables.
Execution Monitoring: This includes tracking the duration of jobs and loads, as well as rows processed.
Automated Documentation and Data Lineage: Datavault Builder supports automated documentation and data lineage, enabling traceability of data from its source to its usage in reports, which is crucial for governance and compliance.
All metrics can be accessed through database views and API calls. - Reporting types
-
- API access
- Real-time dashboards
Resellers
- Supplier type
- Not a reseller
Staff security
- Staff security clearance
- Other security clearance
- Government security clearance
- Up to Security Clearance (SC)
Asset protection
- Knowledge of data storage and processing locations
- Yes
- Data storage and processing locations
- United Kingdom
- User control over data storage and processing locations
- Yes
- Datacentre security standards
- Complies with a recognised standard (for example CSA CCM version 3.0)
- Penetration testing frequency
- At least every 6 months
- Penetration testing approach
- Another external penetration testing organisation
- Protecting data at rest
-
- Physical access control, complying with CSA CCM v3.0
- Other
- Other data at rest protection approach
- Not applicable: We do not store any data at rest. All data is stored in your designated database.
- Data sanitisation process
- Yes
- Data sanitisation type
- Explicit overwriting of storage before reallocation
- Equipment disposal approach
- Complying with a recognised standard, for example CSA CCM v.30, CAS (Sanitisation) or ISO/IEC 27001
Data importing and exporting
- Data export approach
- Datavault Builder is a data warehouse automation tool. All data is persisted in the client database (target database). The format of the data can be customized individually. Typically, the data is pulled into reporting applications. If the database offers export functionality for files, these functionalities can be triggered by the Datavault Builder.
- Data export formats
-
- CSV
- Other
- Other data export formats
- Parquet Files
- Data import formats
-
- CSV
- Other
- Other data import formats
-
- SAP data
- Specialized connectors like Theobald Software’s connector
Data-in-transit protection
- Data protection between buyer and supplier networks
-
- Private network or public sector network
- Other
- Other protection between networks
- There is no connection to other networks needed. Our software is installed in the customer environment and does not need to communicate with other networks.
- Data protection within supplier network
-
- TLS (version 1.2 or above)
- Other
- Other protection within supplier network
- The front-end communication is secured by at least TLS 1.2 by default. TLS 1.3 can be configured as well. It can also be configured to use your own TLS certificates.
Availability and resilience
- Guaranteed availability
- We guarantee that features work in accordance with the documentation. We also offer a support process to resolve issues in this regard in a timely manner.
- Approach to resilience
- The application includes the permission for hot-hot and hot-cold stand-by setups.
- Outage reporting
- We do offer sample setups of Prometheus / Grafana to monitor service availability. Grafana allows different ways of alerting.
Identity and authentication
- User authentication needed
- Yes
- User authentication
-
- Identity federation with existing provider (for example Google Apps)
- Other
- Other user authentication
-
2-factor authentication can be configured if using Azure AD (Entrata ID). Other Identity providers on request.
Username and password is also available. - Access restrictions in management interfaces and support channels
- In the application we do have a role based access configuration. For the support channels users need to be registered on our support portal to receive access.
- Access restriction testing frequency
- At least every 6 months
- Management access authentication
-
- Identity federation with existing provider (for example Google Apps)
- Other
- Description of management access authentication
-
2-factor authentication can be configured if using Azure AD (Entrata ID). Other Identity providers on request.
Username and password is also available.
Audit information for users
- Access to user activity audit information
- Users have access to real-time audit information
- How long user audit data is stored for
- User-defined
- Access to supplier activity audit information
- Users have access to real-time audit information
- How long supplier audit data is stored for
- User-defined
- How long system logs are stored for
- User-defined
Standards and certifications
- ISO/IEC 27001 certification
- Yes
- Who accredited the ISO/IEC 27001
- ISO 27001:2022 certification currently in progress
- ISO/IEC 27001 accreditation date
- 30/6/24
- What the ISO/IEC 27001 doesn’t cover
- N/A
- ISO 28000:2007 certification
- No
- CSA STAR certification
- No
- PCI certification
- No
- Cyber essentials
- No
- Cyber essentials plus
- No
- Other security certifications
- Yes
- Any other security certifications
- SOC 2 Type 2 in progress
Security governance
- Named board-level person responsible for service security
- Yes
- Security governance certified
- Yes
- Security governance standards
-
- ISO/IEC 27001
- Other
- Other security governance standards
- ISO 27001 and SOC 2 Typ 2 certification currently in progress
- Information security policies and processes
-
The Information Security Policy is owned by the InfoSec officer and includes different controls:
SDC 399: ISMS Manual
Entity has a documented ISMS Manual which provides a framework that the organization can use to develop, implement, and maintain an effective information security management system.
SDC 69: Digital Security Governance Program
Entity has a documented Information Security Policy that governs the confidentiality, integrity, and availability of information systems
SDC 398: ISMS Scope Document
Entity has a documented ISMS scope that defines which information and information assets the organization intends to protect.
SDC 386: Data Governance
Entity maintains a list of legal, statutory, and regulatory requirements relevant to information security.
SDC 15: Automated Reporting
Entity has provided information to employees, via various Information Security Policies/procedures, on how to report failures, incidents, concerns, or other complaints related to the services or systems provided by the entity in the event there are problems.
SDC 32: Segregates Roles and Responsibilities
Entity's Senior Management segregates responsibilities and duties across the
Operational security
- Configuration and change management standard
- Conforms to a recognised standard, for example CSA CCM v3.0 or SSAE-16 / ISAE 3402
- Configuration and change management approach
-
We are following and monitoring change management recommendations provided by ISO27001 and SOC 2 Type 2 including:
* Code repos are classified
* Branch Protection rules are enforced for admins
* Peer review is enforced for code changes
* Code changes are reviewed by peers before merging
We offer new versions of our software in our Docker repository after automated regression testing and SAST, DAST and Clair Scanning. - Vulnerability management type
- Conforms to a recognised standard, for example CSA CCM v3.0 or SSAE-16 / ISAE 3402
- Vulnerability management approach
-
For the internal resources we use End-Point Security for clients and servers and active 24/7 MDR by Sophos. We do have ISO and SOC controls in place that all clients are mapped to staff and monitored for vulnerabilities.
For the application: We use DAST and Clair Scanning, automatic vulnerability scanning is conducted daily. Critical vulnerabilities are addressed immediately. High and medium vulnerabilities are handled within the defined timelines. For our infrastructure: Sophos not only detects vulnerabilities but also takes active measures 24/7 in the event of critical discoveries. - Protective monitoring type
- Conforms to a recognised standard, for example CSA CCM v3.0 or SSAE-16 / ISAE 3402
- Protective monitoring approach
- We have outsourced this process to Sophos using their MDR service. In the event of a data breach, we inform affected clients within one business day. However, as no client data is stored on our infrastructure, any breach would only affect communications and contracts with the client.
- Incident management type
- Supplier-defined controls
- Incident management approach
-
We are following and monitoring ISO 27001 and SOC 2 Type 2 recommendations.
For application incidents, we use the service management portal provided by Atlassian that can be used by employees and clients. For security incidents, employees utilize the Sprinto portal. (Sprinto is our provider for collecting and reporting evidence for ISO and SOC certifications.)
Secure development
- Approach to secure software development best practice
- Independent review of processes (for example CESG CPA Build Standard, ISO/IEC 27034, ISO/IEC 27001 or CSA CCM v3.0)
Public sector networks
- Connection to public sector networks
- No
Social Value
- Social Value
-
Social Value
- Fighting climate change
- Covid-19 recovery
- Tackling economic inequality
- Equal opportunity
- Wellbeing
Fighting climate change
Datavault supports the move to de-carbonise the economy and is committed to achieving Net Zero by 2050. We have a Carbon Reduction Plan completed in accordance with PPN 06/21 and associated guidance. This commitment is signed off by our CEO and is published on our website. We encourage our employees to cycle to work. We have fitted a cycle rack at our offices and employees have access to the cycle to work scheme. We further encourage the use public transport instead of driving and when driving to carshare whenever possible. We have implemented hybrid working enabling our employees and contractors to work from home. Our entire IT infrastructure, apart from desktop PCs/laptops is hosted in the cloud. Our desk booking system to ensure limited office capacity is used optimally while providing the opportunity to work flexibility in hygienic working conditions. We have no plastic coffee cups and plastic bottles in the office all are reusable China. We focus on using local suppliers where appropriate to minimise the environmental impact. The use of paper and printing is limited with staff being encouraged to think before printing anything. Increasingly documents are being signed and kept electronically where possible. We believe our initiatives, even small ones, are supporting to fight against climate change.
We have made reasonable adjustments to working hours for team members to support their use of public transport, therefore reducing car emissions. We have employed staff in the US in order to manage client engagements there, reducing requirements for team members to travel to the USA. Overnight accommodation is made available to staff who may travel very long journeys to reduce the number of commutes.
We have a cloud first strategy aimed at using innovative technologies improve productivity, allow our business to scale easily and minimise our carbon footprint.Covid-19 recovery
Datavault recognises its responsibility to support people and communities to manage and recover from the impacts of COVID-19, both directly through work for clients and through interactions with the wider community.
Initiatives include:
- Using local suppliers where possible to support the local economy.
- Supporting staff requiring time off to have flu or COVID-19 vaccinations.
- Continued use of hand sanitiser, signage and cleaning products.
- Flexible working and encouraging staff that are not well to stay away from the office.
- Support hybrid working through a defined model that allows staff the benefits of both home-based and office-based working, while meeting client needs.
- Lockdowns have affected different people in different ways, it is only normal for some staff to feel uncertain and apprehensive about going back to the workplace. The company has tasked managers with ensuring that practical support is given to the return to normal working models.
Our benefits package has a wealth of health and well being services, including life support and bereavement assistance.Tackling economic inequality
Datavault is committed to tackling economic inequality by offering job opportunities to young people from a range of backgrounds. The company is headquartered in a borough, Havant, ranked within the most deprived 25% of local authorities in England in terms of the education, skills and training indicator. Our commitment to helping to tackling economic inequality from the root level comes from supporting education and skills locally.
We have created new roles for apprentices, fresh graduates and re-trainers, to diversify our talent pool and support growth in the local economy. Datavault is committed to help our staff to develop their skills. We will also seek to create corporate social value in recruiting staff with a view to developing their skills. Activities facilitating training and skills development include:
- Supporting or sponsoring relevant formal education (through financial contribution and/or study leave)
- Graduate recruitment and development
- Providing internships and placements for students in higher education
- Supporting or sponsoring product or industry specific training and certifications
- Data Vault 2.0 certification for all technical employees within two years of starting
- Internal training platform with dedicated content author, currently over 45 classes developed for use by staff.
In 2022 we introduced Level 3 and 4 apprenticeship programmes to help and to support our drive to tackle economic inequality by providing opportunities particularly for the next generation and improving skills.
We are cognitive of ensuring Diversity and Inclusion issues in our employment and recruitment practises. This includes skills-based assessments, structured interviews, transparent promotions to senior positions by ensuring roles, with full job descriptions are advertised internally.Equal opportunity
Datavault is committed to help our staff to develop their skills. We will also seek to create corporate social value in recruiting staff with a view to developing their skills. Activities facilitating training and skills development include:
Supporting or sponsoring relevant formal education (through financial contribution and/or study leave)
Graduate recruitment and development
Providing internships and placements for students in higher education
Supporting or sponsoring product or industry specific training
Data Vault 2.0 certification for all technical employees within two years of starting
Internal training platform with dedicated content author, currently over 45 classes developed for use by staff and evolving
Product training, for example, on Erwin Data Intelligence, Data Modeller, dbt and Snowflake
We have demonstrated our commitment through the following activities:
Sponsorship of an Open University degree in business and computing
Sponsorship of a professional HR qualification
8-week placements for students under the Sepnet programme
Employing graduates for their first job
Member of a university employers’ liaison group
Guest lecturing on a university MBA course
Two apprenticeships in digital marketing
One software development apprenticeship
Wherever we seek suppliers that align with our social value and equal opportunities policies, their supply chain partners also need to reflect these values and maintain appropriate cyber security standards.
All new technical appointments engage in our ‘Datavault bootcamp’ which is designed to equip new staff with the necessary skills, knowledge, and confidence to seamlessly integrate into our project teams. Mentoring is in place to support the transition from academia to a business environment.
We implement a fair recruitment strategy for external and internal posts and have thorough interview processes that are transparent.
We attend university open days as employer representatives and engage in careers fairs in order to provide opportunities for all university students to understand about careers in the our industry.Wellbeing
Datavault recognises that our strength comes from our people whether they be staff, associates or subcontractors. We want staff to stay with us for the long term and believe that they will stay if we take good care of them and offer training and development opportunities. Therefore, we always seek to support them and be sensitive to their broader family lives. Also:
We help them to enhance their knowledge and career/professional development with training and support to get certifications.
Team leaders have been trained to be aware of and sensitive to mental health, diversity and inclusion issues.
We hold daily stand-up meetings for core teams to share knowledge and experiences, solve problems.
We hold podcasts and monthly hackathons as strategies to encourage engagement across the company in learning activities to build knowledge and collaboration.
Our line managers regularly hold “keeping-in-touch” hold meetings with their team members allowing them to ask for support, not only with work-related issues but also their personal issues.
Staff are encouraged to participate in community volunteering or charity projects (examples include being a school governor and guest lecturing at a university).
We support home-working with office equipment if needed to ensure ergonomically sound working environments.
We have hybrid and flexible working to account for varied staff circumstances.
Mental health is taken seriously, and staff are encouraged to consider the mental health of colleagues and are provided with mental health learning resources.
Employees have access to a range of health and wellbeing options that include an employee assistance programme, a free counselling service provided by fully qualified professionals.
Our HR system allows the rewarding of “Thanks”, which is open to all employees and is a standing agenda item on company days. Company seeks to celebrate work anniversaries, exam results, certifications etc.
Pricing
- Price
- £990 to £1,990 a licence
- Discount for educational organisations
- Yes
- Free trial available
- Yes
- Description of free trial
- Experience Datavault Builder on a web-based, hands-on, in-tool training platform that allows you to learn at your own pace. Dive into the fictitious Willibald Use Case, design the data model visually, and implement data structures and loads without writing a single line of code.
- Link to free trial
- https://datavault-builder.com/contact-us/