Modular Data Product Studio
Modular Data Product Studio enables organisations to create insights from structured and unstructured data.
Comprising a suite of components across data consolidation, metrics, deep learning, embedded analytics and monitoring, it provides complete solutions for achieving insight.
It can be integrated with existing platforms and BI tools to rapidly deliver value.
Features
- Data Federation Hub supporting ETL ingestion and data virtualisation architectures
- Scalable architecture supporting incremental replication, with scalable record storage
- Author, store and manage standardised metrics in a centralised catalogue
- Productionise AI/ML models and integrate into metrics
- Data monitoring for regulatory compliance and governance breaches
- Anomaly detection, quality and predictive monitoring of all data flows
- Comprehensive policy enforcement covering role, row/column, privacy, geofencing and timefencing
- Embed analytics into business processes for immediate data-driven decision making
- Semantic layer and headless BI architecture supports existing BI tools
- Open source cloud agnostic platform (private, public, hybrid cloud)
Benefits
- Integrates with existing data infrastructure, analytics tools and BI platforms
- Reduce application switching through embedded analytics on existing workflows
- Unite complex data landscapes to reduce cost and risk
- Provide data insights to support self-serve decision making
- Modernise data environment with AI/ML, rapid deployment and lower costs
- Accelerated time-to-market and increased ROI through iterative deployment of pipelines
- High performance, high governance data platform with automated maintenance
- Self-serve metrics, report, dashboards with expansive commissioning and creation models
- Self-serve data integration component for rapid data source integration
- Highly configurable, easily managed, low cost data ecosystem
Pricing
£0 a unit
- Free trial available
Service documents
Request an accessible format
Framework
G-Cloud 14
Service ID
3 8 3 6 4 9 3 2 6 7 7 7 7 6 1
Contact
Modular Data Ltd.
Finbarr Murphy
Telephone: 07763205113
Email: finbarr@modulardata.co
Service scope
- Software add-on or extension
- Yes, but can also be used as a standalone service
- What software services is the service an extension to
-
Modular cloud platform works with Snowflake, Databricks, MS Onelake, BigQuery and other data lake architectures.
headless BI works with any BI tool such as PowerBI, Looker, Tableau, QlikSense, Quicksight - Cloud deployment model
-
- Public cloud
- Private cloud
- Hybrid cloud
- Service constraints
-
Support is only available remotely.
Support desk operates in normal office hours from 9am to 5pm although emergency cover can be agreed. - System requirements
-
- Private or public cloud account
- Browser to access cloud virtual machines.
User support
- Email or online ticketing support
- Email or online ticketing
- Support response times
-
Response times are 1 business day for email.
Online ticketing support via Github Issues with response times for bug fixes limited to 5 working days. - User can manage status and priority of support tickets
- No
- Phone support
- No
- Web chat support
- Yes, at an extra cost
- Web chat support availability
- 9 to 5 (UK time), Monday to Friday
- Web chat support accessibility standard
- None or don’t know
- How the web chat support is accessible
- Slack is used for community webchat which is WCAG 2.0 AA
- Web chat accessibility testing
- None
- Onsite support
- No
- Support levels
-
Each client will be assigned a Service Delivery Manager, who will engage with you throughout your engagement with Modular Data. This SDM will work with the buyer and the Modular Data Engineering team to provide a first class service.
Our response times are as follows:
P1: 30 mins;
P2: 1 hour;
P3: 3 business hours;
P4: 1 business day.
All support tickets are triaged by the service delivery team and assigned appropriately to the engineering team to best resolve the issues. - Support available to third parties
- Yes
Onboarding and offboarding
- Getting started
-
Users can download, install and configure the application without specialist knowledge.
Documentation is provided to help users install and configure the applications.
Data Products can be designed and deployed by users self-serving using rich documentation provided. For end users with data product design needs, we can optionally provide onsite training at our standard SFIA rates. - Service documentation
- Yes
- Documentation formats
- HTML
- End-of-contract data extraction
-
Data never leaves the customer cloud environment. Removal of the software does not result in the removal of the data.
Data are stored in open format (parquet, avro, CSV) and encrypted at rest. Data use open source storage formats (Hudi, Iceberg) - End-of-contract process
- Cloud software is open source and can be used beyond the end of the contract under the open source licence
Using the service
- Web browser interface
- Yes
- Supported browsers
-
- Internet Explorer 11
- Microsoft Edge
- Firefox
- Chrome
- Safari
- Opera
- Application to install
- No
- Designed for use on mobile devices
- No
- Service interface
- Yes
- User support accessibility
- WCAG 2.1 A
- Description of service interface
- Service Interface is managed through Cloud Console for public cloud deployments
- Accessibility standards
- WCAG 2.1 AAA
- Accessibility testing
- No testing has been done with users of assistive technologies
- API
- Yes
- What users can and can't do using the API
-
Platform operations can deploy the service using either cloud provisioning (CloudFormation, Azure Resource Manager, GCP Deployment Manager) or Terraform.
Platform users can configure the application using the cloud provider CLI which interacts with the cloud API
Users interact with the service through a browser. Applications can integrate with the service via Open APIs - API documentation
- Yes
- API documentation formats
- Open API (also known as Swagger)
- API sandbox or test environment
- Yes
- Customisation available
- Yes
- Description of customisation
-
All components are open source and can be customised by users.
A metrics UI allows anyone to author standardised and unambiguous metrics and calculations and share them across the organisation.
Users can customise charts and dashboards using dashboard composition tools. users can plug in commercial BI tools for the creation of visualizations.
Scaling
- Independence of resources
- Platform is single tenanted using separate accounts and all components are elastically scaled to handle thousands of concurrent users querying billions of records. Each customer's environment is individually scaled. Test environments are used to determine optimal performance characeristics of the various components in the architecture.
Analytics
- Service usage metrics
- Yes
- Metrics types
- Free memory, incoming events, data latency, network throughput, billing, cluster health status
- Reporting types
- Real-time dashboards
Resellers
- Supplier type
- Not a reseller
Staff security
- Staff security clearance
- Conforms to BS7858:2019
- Government security clearance
- Up to Security Clearance (SC)
Asset protection
- Knowledge of data storage and processing locations
- Yes
- Data storage and processing locations
-
- United Kingdom
- European Economic Area (EEA)
- User control over data storage and processing locations
- Yes
- Datacentre security standards
- Complies with a recognised standard (for example CSA CCM version 3.0)
- Penetration testing frequency
- At least once a year
- Penetration testing approach
- ‘IT Health Check’ performed by a CHECK service provider
- Protecting data at rest
-
- Physical access control, complying with CSA CCM v3.0
- Physical access control, complying with SSAE-16 / ISAE 3402
- Encryption of all physical media
- Data sanitisation process
- Yes
- Data sanitisation type
- Explicit overwriting of storage before reallocation
- Equipment disposal approach
- Complying with a recognised standard, for example CSA CCM v.30, CAS (Sanitisation) or ISO/IEC 27001
Data importing and exporting
- Data export approach
- Data are stored in open format (parquet, acro, CSV) and encrypted at rest in cloud object storage. Users can export their data by using their cloud provider's download functionality or via the Cloud Provider API or CLI.
- Data export formats
-
- CSV
- Other
- Other data export formats
-
- Parquet
- Avro
- JSON
- Data import formats
-
- CSV
- Other
- Other data import formats
-
- Oracle
- Microsoft SQL Server
- PostgreSQL
- MySQL
- MongoDB
- DB2
- Parquet
- Avro
- JSON
Data-in-transit protection
- Data protection between buyer and supplier networks
- TLS (version 1.2 or above)
- Data protection within supplier network
- TLS (version 1.2 or above)
Availability and resilience
- Guaranteed availability
-
Our service runs in the customer's cloud account which provides a level of guaranteed availability and resilience.
All our services are elastic and can deal with intermittent outages by design.
No service credits or refunds are provided. - Approach to resilience
-
Our service runs in the customer's cloud account which provided a level of guaranteed availability and resilience.
Information on the cloud providers' SLAs are available publicly. - Outage reporting
-
Component health is monitored and outages can be reported to ChatOps (eg Slack, Teams) the cloud console, or third party incident response applications such as PagerDuty.
A private dashboard for each component is provided.
Email alerts are configurable, as are ChatOps alerts.
Identity and authentication
- User authentication needed
- Yes
- User authentication
-
- 2-factor authentication
- Identity federation with existing provider (for example Google Apps)
- Limited access network (for example PSN)
- Username or password
- Access restrictions in management interfaces and support channels
- Operations users access via permissions configured using IAM policies in the buyers cloud account.
- Access restriction testing frequency
- At least every 6 months
- Management access authentication
-
- 2-factor authentication
- Identity federation with existing provider (for example Google Apps)
Audit information for users
- Access to user activity audit information
- Users receive audit information on a regular basis
- How long user audit data is stored for
- User-defined
- Access to supplier activity audit information
- Users receive audit information on a regular basis
- How long supplier audit data is stored for
- User-defined
- How long system logs are stored for
- User-defined
Standards and certifications
- ISO/IEC 27001 certification
- No
- ISO 28000:2007 certification
- No
- CSA STAR certification
- No
- PCI certification
- No
- Cyber essentials
- Yes
- Cyber essentials plus
- No
- Other security certifications
- No
Security governance
- Named board-level person responsible for service security
- Yes
- Security governance certified
- No
- Security governance approach
-
User access is delegated to customer's Identity platform, or we can configure an LDAP server to provide authentication and authorisation support.
Security of data is managed through a hierarchy of policies which are enforced through the many layers, allowing governance at scale.
Components are hosted in a VPC with network isolation provided by separate CIDR blocks.
Data is encrypted at rest using key technology. Data is encrypted in transit using TLS 1.2
Data retention policies are automatically applied.
Operations role has a set of configurable permissions. The platform can be configured with new roles.
All systems require regular security - Information security policies and processes
-
We have a range of internal information security policies covering security, data risk, incident management and response plans for data breaches.
Responsibility for identifying risks and raising them is with individuals. Risk assessments are completed for every new system, every change to a system (by utilising DevSecOps practices) the introduction of a new information asset, or following changes to threat environment or detection of new vulnerabilities.
We consider all threats and vulnerabilities. We obtain information about threats and vulnerabilities from specialist organisations and it is the responsibility of the Information Security Team to maintain communications channels with these organisations.
All information security risks are logged on a risk register, and risk treatments and mitigations are recorded. Root cause analysis of risks is performed on a regular basis.
Operational security
- Configuration and change management standard
- Conforms to a recognised standard, for example CSA CCM v3.0 or SSAE-16 / ISAE 3402
- Configuration and change management approach
-
Components in our service are fully version controlled and deployed using secured CI/CD pipelines.
We run regular vulnerability scans on all components and run regular (at least annual) pen tests on all interfaces. - Vulnerability management type
- Conforms to a recognised standard, for example CSA CCM v3.0 or SSAE-16 / ISAE 3402
- Vulnerability management approach
-
The data platform has a fully documented threat model. The platform is activley monitored and all access is audited.
Web application firewalls are used throughout. All data is stored in a secured VPC with network protection. Access to infrastructure is limited to Operations Personnel only.
Code is regularly scanned for vulnerabilities. All code changes are checked for security vulnerabilities and breaches and are not deployed if there are failures (DevSecOps). - Protective monitoring type
- Conforms to a recognised standard, for example CSA CCM v3.0 or SSAE-16 / ISAE 3402
- Protective monitoring approach
-
The Data Platform utilises cloud provider protective monitoring capabilities (eg Amazon Guard Duty, Azure Defender, Security Command Center for GCP).
Threat levels correspond to P1-P4 categories. Response times are:
P1: 30 mins;
P2: 1 hour;
P3: 3 business hours;
P4: 1 business day.
All support tickets are triaged by the service delivery team and assigned appropriately to the engineering team to best resolve the issues. - Incident management type
- Supplier-defined controls
- Incident management approach
-
Response times are:
P1: 30 mins;
P2: 1 hour;
P3: 3 business hours;
P4: 1 business day.
All support tickets are triaged by the service delivery team and assigned appropriately to the engineering team to best resolve the issues.
Secure development
- Approach to secure software development best practice
- Supplier-defined process
Public sector networks
- Connection to public sector networks
- No
Social Value
- Social Value
-
Social Value
- Fighting climate change
- Tackling economic inequality
- Equal opportunity
- Wellbeing
Fighting climate change
At Modular Data, our commitment to fighting climate change is integral to our operations and services. We recognise the urgency of environmental sustainability and actively contribute to this cause by leveraging our expertise in data and technology. Our approach involves developing and implementing data-driven solutions that address our client's needs and align with our environmental responsibilities.
Central to our efforts is developing open-source Environmental Governance Data Products designed to track environmental metrics effectively. This initiative enables organisations, including those in the public sector, to monitor their environmental impact accurately, fostering accountability and informed decision-making towards sustainability goals.
Furthermore, we can prioritise the assessment of Software Carbon Intensity (SCI) within our engagements. By evaluating the carbon footprint of our software solutions, we aim to optimise efficiency and minimise environmental impact. This focus on SCI ensures that our digital products deliver value to our clients and contribute to reducing the tech industry's carbon footprint.
Modular Data promotes sustainable practices within our team, partners, and the wider community. We share knowledge about sustainable technologies and strategies, encouraging a collective effort towards environmental stewardship. Our work on open-source projects advances innovation in environmental governance. It sets a precedent for integrating sustainability into software development and data management.
Our dedication to fighting climate change is reflected in our commitment to delivering solutions that are both technologically advanced and environmentally responsible. Through our work on Environmental Governance Data Products and focus on Software Carbon Intensity, Modular Data stands at the forefront of using data and technology to contribute to a sustainable future.Tackling economic inequality
Modular Data is dedicated to tackling economic inequality by fostering an inclusive and diverse environment within our workforce, partners, and associates. Through transparent and collaborative decision-making, we aim to break down barriers to entry in the digital and data sectors, particularly for individuals from underserved and low socio-economic backgrounds.
We operate an Associate & Partner network comprising small, innovative businesses that share our ethos of collaboration, agility, and a no-blame culture. Our mentorship programs target young technical talent, providing them with the skills and knowledge necessary for modern agile delivery and enterprise data technologies. This initiative not only uplifts individuals but also enhances the collective capability of our network to drive meaningful change.
Our commitment extends to embedding client staff within our teams and offering mentorship in the latest industry practices. This hands-on experience is invaluable for upskilling and empowering participants, allowing them to contribute effectively to their organisations and the wider community.
To support the professional development of our workforce, we allocate budgets for training and certification, encourage attendance at conferences, and promote knowledge sharing through talks, open-source playbooks, and code contributions. This approach ensures our team remains at the cutting edge of technology and best practices.
As an equal-opportunity employer, we enforce family-friendly and dignity-at-work policies, actively working to improve diversity, equality, and inclusion. Our recruitment processes are designed to enhance these areas, supported by unconscious bias training for our recruitment team.
By implementing these strategies, Modular Data aims to tackle economic inequality and enrich the digital and data profession landscape. Our efforts underscore our commitment to driving innovation and creating sustainable business growth, ensuring long-term value for the public sector and beyond.Equal opportunity
Modular Data fosters equal opportunity and promotes diversity within our workforce, partners, and associates. We emphasise open and transparent engagements, ensuring our decision-making processes are collaborative and clearly explained. We cultivate a culture of inclusivity and shared understanding by operating in an environment that values visibility and feedback.
Our approach to encouraging new entrants into digital and data professions includes operating an Associate & Partner network of small, entrepreneurial businesses that share our values of collaboration, agility, and a no-blame culture. We mentor young technical talent, embedding client staff within our teams to mentor them in modern agile delivery, enterprise data paradigms, and technologies. This mentorship extends to onboarding and upskilling individuals from low socio-economic backgrounds, embracing errors as learning opportunities.
To further develop our workforce, we provide training budgets, support certification, encourage conference attendance, and advocate for knowledge sharing through talks, open-source playbooks, and code. This commitment to professional development ensures a continuous elevation of expertise within our teams and network.
As an equal-opportunity employer, we uphold family-friendly and dignity-at-work policies. Our recruitment processes are designed to improve diversity, equality, and inclusion, offering unconscious bias training to our recruitment team. We strive to support individuals with protected characteristics, monitoring our diversity performance to develop annual improvement plans.
By embedding these principles into our operations, Modular Data adheres to the social value of Equal Opportunity and enriches the digital and data profession landscape. Our efforts to nurture a diverse and skilled workforce reflect our commitment to driving innovation and value in the public sector, ensuring that we remain at the forefront of creating sustainable business growth and long-term value.Wellbeing
Modular Data is deeply committed to the wellbeing of our staff, associates and clients, recognising its critical role in fostering a healthy, productive, and innovative workforce. Our holistic approach focuses on the physical and mental wellbeing of our employees, partners, and associates. We understand that wellbeing is a crucial driver for creativity, engagement, and overall performance, thus embedding wellbeing principles into our operational ethos.
We actively promote a work culture that values work-life balance, ensuring our policies and practices support flexible working hours and remote work arrangements. This flexibility allows our team members to manage their professional responsibilities alongside personal commitments, reducing stress and enhancing job satisfaction.
Mental health is a priority at Modular Data. We provide access to mental health resources and support services, encouraging open conversations about mental wellbeing. By fostering an environment where employees feel safe to discuss their challenges, we aim to break down the stigma associated with mental health issues and provide support to those in need.
Furthermore, we prioritise the physical health of our workforce by supporting wellness initiatives and providing resources that encourage a healthy lifestyle. This includes access to fitness programs, nutritional advice, and regular health and wellness workshops.
In line with our commitment to wellbeing, we also focus on professional development and personal growth. Our training and mentorship programs are designed to enhance technical skills and build confidence, resilience, and a sense of accomplishment.
Modular Data aims to cultivate a supportive and enriching environment by integrating these wellbeing-focused practices. Our dedication to the wellbeing of our team reflects our belief that a healthy and happy workforce is essential to achieving our mission of driving innovation and creating sustainable value in the digital and data sectors.
Pricing
- Price
- £0 a unit
- Discount for educational organisations
- No
- Free trial available
- Yes
- Description of free trial
- Free version of the service includes all functionality available. There are no time limits on usage and the licence is an open source licence (MIT Licence)