INSIGHT DIRECT (UK) LTD

Data Lake Architecture & Management Consulting

Expert consulting for organisations to design, implement, and optimise scalable data lake environments, supporting secure, efficient, and business-focused data management strategies.

Features

• End-to-end data lake architecture design and strategy formulation
• Integration of diverse data sources for unified analytics
• Advanced governance and access control framework implementation
• Performance tuning and optimization of data lake systems
• Data lifecycle management and intelligent tiered storage planning
• Automated data ingestion and metadata cataloging solutions
• Customizable security protocols and compliance alignment
• Cost optimization through scalable cloud or hybrid deployments
• Continuous monitoring and proactive maintenance services
• Comprehensive training and knowledge transfer for client teams

Benefits

• Accelerates enterprise analytics and data-driven decision making
• Improves regulatory compliance and data security posture
• Enables seamless integration of structured and unstructured data
• Reduces operational complexity through automation and best practices
• Enhances scalability to support future business growth
• Optimizes storage costs with intelligent data tiering
• Facilitates rapid onboarding of new data sources
• Strengthens governance for enhanced data trust and quality
• Provides robust documentation for ongoing internal operations
• Empowers teams with expert guidance and upskilling

• Education pricing available

Service documents

• Pricing document

  PDF

• Service definition document

  PDF

• Terms and conditions

  PDF

Request an accessible format

If you use assistive technology (such as a screen reader) and need versions of these documents in a more accessible format, email the supplier at pstenderteam@insight.com. Tell them what format you need. It will help if you say what assistive technology you use.

Framework

G-Cloud 15

Service ID

477719287599591

Contact

Public Sector Tender Team
0344 846 3333
pstenderteam@insight.com

About your service

• Service categories:

  Application Development and Deployment

  Data management

  Database management systems

  • Data Lake Management Systems
• Multi cloud support: Yes

Service scope

• Software add-on or extension: No
• Cloud deployment model:
  • Public cloud
  • Private cloud
  • Community cloud
  • Hybrid cloud
• Service constraints: Requires access to client IT stakeholders and selected data sources; cloud provider may limit certain features.
• System requirements: Not applicable

User support

• Email or online ticketing support: Yes, at extra cost
• Support response times: We aim to respond to questions within 4 hours on weekdays. Response times may extend to 8 hours during weekends.
• User can manage status and priority of support tickets: Yes
• Online ticketing support accessibility: WCAG 2.2 AA
• Phone support: Yes
• Phone support availability: 9 to 5 (UK time), Monday to Friday
• Web chat support: Yes, at an extra cost
• Web chat support availability: 9 to 5 (UK time), Monday to Friday
• Web chat support accessibility standard: WCAG 2.2 AA
• Web chat accessibility testing: Our web chat support undergoes rigorous testing to ensure accessibility for users with assistive technologies. We have conducted user testing sessions with individuals who rely on screen readers, magnifiers, and other assistive devices. Feedback from these sessions informs improvements to the chat interface, ensuring it is compatible and easy to navigate for all users. We focus on clear, concise language and logical flow in the chat interactions, which aids comprehension for assistive technology users. Additionally, our web chat adheres to WCAG (Web Content Accessibility Guidelines) standards, ensuring features such as keyboard navigation and screen reader compatibility are effectively implemented. This commitment to accessibility enhances the user experience and ensures equitable access to our support services for all individuals, regardless of their abilities.
• Onsite support: Yes, at extra cost
• Support levels: We provide three support levels: Standard, Enhanced, and Premium. ; ; Standard support includes email and ticket-based assistance during business hours at no additional cost. Enhanced support offers 24/7 email and phone support for £500 per month. Premium support provides dedicated support from a Technical Account Manager and priority response times for £1,000 per month.; ; All levels include access to our knowledge base and community forums. For critical issues, we ensure a response within one hour under Enhanced and Premium tiers. ; ; Yes, we provide a Technical Account Manager for Premium support and a Cloud Support Engineer for Enhanced and Premium tiers.
• Support available to third parties: Yes
• AI chatbot: Yes

Onboarding and offboarding

• Getting started: To help users get started with our services, we offer a comprehensive onboarding process that includes both onsite and online training options tailored to individual user needs. Our expert consultants will conduct initial training sessions to ensure users are familiar with the functionalities and features of the service. Additionally, we provide detailed user documentation that includes step-by-step guides and best practice recommendations for effective use of the service. This documentation is accessible in multiple formats, allowing users to choose the format that best suits their learning preferences. Our approach is designed to facilitate a smooth transition and empower users to leverage our service fully. Continuous support is available during the onboarding phase to address any questions or challenges that users may encounter, ensuring they feel confident and competent as they begin to use the service.
• Service documentation: Yes
• Documentation formats: PDF
• End-of-contract data extraction: At the end of the contract, users can extract their data through a structured process designed to ensure seamless transition and data integrity. We provide comprehensive data extraction services, which include the creation of an extraction plan tailored to the specific needs of the user. Users will have access to all their data in a standard format that is compatible with their future systems, ensuring ease of migration. ; ; Our professional services team will assist in the extraction process, providing guidance on data formats, structures, and any required transformations. Users will also receive documentation detailing the extraction steps and any necessary considerations for future use. Additionally, we conduct a final review to confirm that all required data has been successfully extracted, allowing for a smooth offboarding experience. Our commitment to data security and compliance ensures that all data extraction activities are performed in accordance with relevant regulations and best practices.
• End-of-contract process: At the end of the contract, we will conduct a formal offboarding process to ensure a smooth transition for the client. This includes a final review meeting to discuss project outcomes and gather feedback. All services related to the offboarding, such as data extraction and knowledge transfer, are included in the price of the contract. ; ; Clients will receive assistance in extracting their data, with our professional services team providing guidance on formats and structures. Comprehensive documentation on the offboarding process will also be provided. ; ; Any additional costs that may arise would typically relate to requests for extended support beyond the agreed contract period, bespoke data transformation needs, or additional training sessions requested after the initial agreement has concluded. These would be clearly communicated and agreed upon prior to any additional services being rendered.
• Documentation accessibility standard: WCAG 2.2 AA

Using the service

• Web browser interface: Yes
• Supported browsers:
  • Microsoft Edge
  • Firefox
  • Chrome
  • Safari
  • Opera
• Application to install: Yes
• Compatible operating systems:
  • Linux or Unix
  • MacOS
  • Windows
• Designed for use on mobile devices: Yes
• Differences between the mobile and desktop service: Mobile services may offer a streamlined interface with touch navigation, enabling quick access to essential features. Desktop services typically provide a more comprehensive view with additional functionalities, utilising larger screen real estate for complex tasks. Therefore, while both platforms deliver core functionalities, user interaction and experience differ significantly to cater to their respective environments.
• Service interface: Yes
• User support accessibility: WCAG 2.2 AA
• Description of service interface: The service interface is designed to be intuitive and user-friendly, featuring a cloud-native architecture that ensures seamless access across various devices. It includes a modern, mobile-responsive user interface that adapts to different screen sizes while maintaining core functionalities. The interface supports role-based access control, allowing users to interact with the service according to their permissions. Additionally, we offer RESTful APIs for integration, ensuring that users can automate processes and extend functionality as needed. Regular user feedback, including from those using assistive technologies, informs ongoing enhancements to the interface, prioritising accessibility and usability.
• Accessibility standards: WCAG 2.2 AA
• Accessibility testing: Our service incorporates extensive interface testing with users of assistive technology to ensure accessibility and usability. We engage with individuals using screen readers, voice recognition software, and other assistive tools throughout the development process. This collaboration includes gathering feedback during alpha and beta testing phases, where users provide insights on their experience navigating our platform. ; ; We have implemented adjustments based on user feedback, such as optimising navigation structures, enhancing keyboard accessibility, and ensuring that all content is easily readable and operable through assistive devices. Our commitment to accessibility aligns with WCAG 2.2 AA standards, ensuring that our service is usable for everyone. ; ; By prioritising user involvement, we continuously refine our interface, making it more inclusive and user-friendly. This iterative process not only enhances the overall experience for users with assistive technology but also fosters an environment of ongoing improvement and innovation in our service delivery.
• API: No
• Customisation available: Yes
• Description of customisation: Users can customise our professional services in several ways. First, they can tailor the scope of services provided, selecting specific consulting, design, development, or deployment elements based on their unique needs. Additionally, users may customise the delivery methodology to align with their organisational workflows, opting for agile or waterfall approaches as preferred. Users can also specify the resources allocated to projects, such as choosing between dedicated teams or individual consultants. ; ; Customisation can be initiated by users during the project kickoff phase, where they collaborate with our expert consultants to define their specific requirements. This collaborative approach ensures that the services align perfectly with the user's objectives and desired outcomes. Our consultants, who possess extensive public sector experience, facilitate this process, guiding users through the options and helping to develop a customised service delivery plan that meets their needs effectively.

Scaling

• Independence of resources: We guarantee that users are not affected by the demand of others on our service through robust resource management and scaling strategies. Our platform employs auto-scaling capabilities to dynamically allocate resources based on usage patterns, ensuring optimal performance. Additionally, we implement load balancing to distribute user requests evenly across servers, minimizing bottlenecks. Our monitoring systems continuously assess performance metrics, allowing for proactive adjustments to maintain service quality. Moreover, we have a dedicated support team to swiftly address any issues that may arise, ensuring a consistent and reliable user experience.

Analytics

• Service usage metrics: Yes
• Metrics types: We provide a comprehensive set of service metrics that include usage statistics, performance indicators, and client satisfaction scores. Our metrics focus on critical aspects such as system uptime, response times, and user engagement. We deliver these metrics through regular reports, ensuring transparency and enabling data-driven decision-making. Our professional services also involve ongoing monitoring and analysis to continuously refine and enhance service delivery, aligning with client objectives and improving overall outcomes.
• Reporting types: Regular reports
• Resource tagging: Yes
• FOCUS resource tagging: Yes

Resellers

• Supplier type: Not a reseller

Staff security

• Staff security clearance: Conforms to BS7858:2019
• Government security clearance: Developed Vetting (DV)

Asset protection

• Knowledge of data storage and processing locations: Yes
• Data storage and processing locations: United Kingdom
• User control over data storage and processing locations: Yes
• Datacentre security standards: Complies with a recognised standard (for example CSA CCM version 4.0)
• Penetration testing frequency: At least once a year
• Penetration testing approach: ‘IT Health Check’ performed by a CREST-approved service provider
• Protecting data at rest:
  • Encryption of all physical media
  • Other
• Other data at rest protection approach: We implement multiple layers of protection for data at rest, including robust encryption protocols, access controls, and regular security audits. Data is encrypted using industry-standard algorithms, ensuring that even if physical media is compromised, the data remains secure. We also enforce strict access controls, limiting data access to authorised personnel only. Furthermore, we conduct regular audits to identify and mitigate potential vulnerabilities, ensuring continuous compliance with regulatory requirements. This comprehensive approach safeguards sensitive information and maintains data integrity throughout its lifecycle.
• Data sanitisation process: Yes
• Equipment disposal approach: A third-party destruction service
• Data sanitisation type:
  • Deleted data can’t be directly accessed / Cryptographic Erasure
  • Data Erasure
  • Explicit overwriting of storage before reallocation / Secure Erase
  • Physical Destruction / Hardware containing data is completely destroyed

Data importing and exporting

• Data export approach: Users can export their data through a user-friendly interface that offers multiple options for format selection. The system supports exporting in open formats such as CSV and ODF, alongside other formats including XML, JSON, Excel (XLSX), TXT, SQL, Parquet, Avro, YAML, and HTML. This flexibility ensures that users can easily access and utilize their data in a manner that suits their needs, whether for analysis, reporting, or integration with other systems.
• Data export formats:
  • CSV
  • ODF
  • Other
• Other data export formats:
  • JSON
  • XML
  • XLSX
  • TXT
  • TSV
  • HTML
  • Parquet
  • Avro
  • YML
• Data import formats:
  • CSV
  • ODF
  • Other
• Other data import formats:
  • JSON
  • XML
  • XLSX
  • TXT
  • TSV
  • HTML
  • Parquet
  • Avro
  • YML

Data-in-transit protection

• Data protection between buyer and supplier networks:
  • IPsec or TLS VPN gateway
  • Other
• Other protection between networks: We implement multiple layers of protection for data in transit between the buyer's network and our network. This includes the use of industry-standard encryption protocols such as TLS to safeguard data during transmission. Additionally, we employ secure VPN connections for remote access and ensure that all endpoints are protected through firewalls and intrusion detection systems. Regular monitoring and audits are conducted to identify and mitigate any potential vulnerabilities. Furthermore, we adhere to strict data governance policies to maintain compliance with relevant regulations. These measures collectively ensure robust protection of sensitive data throughout its journey.
• Data protection within supplier network:
  • IPsec or TLS VPN gateway
  • Other
• Other protection within supplier network: We enforce strict access controls and employ network segmentation to protect data within our network. Our data protection strategy includes the use of advanced firewalls, intrusion detection and prevention systems, and regular vulnerability assessments to identify potential threats. Additionally, we implement encryption for sensitive data at rest and utilize multi-factor authentication to enhance access security. Regular staff training on data protection policies and best practices ensures that all employees are aware of their responsibilities in safeguarding information. These measures work together to create a secure environment for our data and maintain compliance with UK regulations.

Availability and resilience

• Guaranteed availability: Our service guarantees a minimum availability of 99.9% as part of our Service Level Agreement (SLA). This commitment ensures that our clients experience minimal disruption and can rely on our services for their critical operations. In instances where we fail to meet this guaranteed level of availability, we provide a refund to users based on the duration of the outage. Specifically, for each hour of downtime beyond the 99.9% threshold, clients are entitled to a credit against their future billing, proportional to the extent of the service interruption. This guarantees accountability and reinforces our commitment to delivering reliable and resilient services to our public sector clients.
• Approach to resilience: Our service is designed with a multi-layered approach to resilience, ensuring continuous availability and minimal downtime. We utilise a robust data centre setup that includes geographically dispersed locations, allowing for redundancy and failover capabilities. Each data centre facility is equipped with redundant power supplies, cooling systems, and high-speed internet connections. This ensures that even in the event of a hardware failure or natural disaster, operations can seamlessly switch to a backup site.; ; Additionally, our infrastructure employs active-active configurations where applicable, providing real-time data replication and load balancing across multiple sites. Regular disaster recovery drills and maintenance checks are conducted to ensure systems are always prepared for unexpected events. ; ; We also implement comprehensive monitoring tools to proactively identify and address potential issues before they impact service availability. Our approach to resilience is continuously reviewed and updated to incorporate the latest industry best practices and technological advancements. For detailed information about our data centre setup and specific resilience strategies, please contact us directly.
• Outage reporting: Our service reports any outages through multiple channels to ensure transparency and timely communication. We provide a public dashboard that displays real-time status updates and historical outage reports, allowing users to monitor service availability. Additionally, we offer an API for integration with client systems, enabling automated tracking of service status and alerts. Users can also subscribe to email alerts that notify them immediately of any service disruptions or maintenance activities. This multi-faceted approach ensures that clients remain informed and can make informed decisions regarding their operations during outages.

Identity and authentication

• User authentication needed: Yes
• User authentication:
  • Multi-Factor Authentication (MFA)
  • Identity federation with existing provider (for example Google Apps)
  • Username or password
  • Other
• Other user authentication: We authenticate users accessing the service primarily through Multi-Factor Authentication (MFA). This process requires users to enter their username and password, followed by a verification code sent to a registered mobile device or email. Additionally, we support identity federation with existing providers, allowing users to authenticate using their established credentials. This layered approach enhances security by ensuring that access is granted only to verified users, protecting sensitive data and resources effectively.
• Access restrictions in management interfaces and support channels: Access to management interfaces and support channels is restricted through multi-factor authentication (MFA), ensuring that only authorised personnel can gain access. Each administrator must complete a secure login process that includes a username, password, and a verification code sent to a registered device. Furthermore, we enforce role-based access controls, allowing users access only to the features necessary for their roles. This strategy safeguards sensitive information and maintains a secure environment for management activities. Regular audits and monitoring are conducted to enhance our security posture and ensure compliance with best practices.
• Access restriction testing frequency: At least every 6 months
• Management access authentication:
  • Multi-Factor Authentication (MFA)
  • Other
• Description of management access authentication: Access to our service is managed through a multi-factor authentication (MFA) process. Administrators must provide a secure username and password, followed by a verification code sent to a registered mobile device or email. Additionally, we implement role-based access controls to ensure that only authorised personnel can access sensitive management features. This layered approach enhances security and ensures that management access is tightly controlled and monitored.

Audit information for users

• Access to user activity audit information: Users have access to real-time audit information
• How long user audit data is stored for: At least 12 months
• Access to supplier activity audit information: Users have access to real-time audit information
• How long supplier audit data is stored for: At least 12 months
• How long system logs are stored for: At least 12 months

Security governance

• Named board-level person responsible for service security: Yes
• Security governance certified: Yes
• Security governance standards:
  • ISO/IEC 27001
  • Other
• Other security governance standards: ISO/IEC 27001, NIST Cybersecurity Framework, GDPR, PCI DSS, and ISO 9001.
• Information security policies and processes: Our information security policies and processes are designed to ensure the protection of sensitive data and compliance with relevant regulations. We adhere to ISO/IEC 27001 standards, providing a framework for systematic risk management and implementing robust security controls. Our policies cover data encryption, access control, incident response, and ongoing risk assessments. ; ; We maintain a clear reporting structure where our Chief Information Security Officer (CISO) oversees the implementation of security policies and ensures compliance across all levels of the organisation. Regular audits and reviews are conducted to assess adherence to these policies, and findings are reported directly to the board. ; ; Training sessions are held to raise awareness among employees regarding security best practices, and we encourage a culture of accountability. Our processes are reviewed periodically to adapt to the evolving security landscape and ensure continuous improvement in our security posture, thereby protecting our clients and their data effectively.
• Software Security Code of Practice: Yes

Operational security

• Configuration and change management standard: Complies with a recognised standard, for example CSA CCM v4.0 or SSAE-18 / ISAE 3402
• Configuration and change management approach: Our configuration and change management processes involve meticulous tracking of service components throughout their lifecycle using a centralised configuration management database (CMDB). Each component is assigned a unique identifier for easy tracking. Changes are evaluated for potential security impact through a structured change assessment process, which includes security reviews, risk assessments, and stakeholder consultations. This ensures that all modifications are documented, approved, and implemented with minimal disruption while maintaining compliance with security protocols and best practices throughout the service delivery.
• Vulnerability management type: Complies with a recognised standard, for example CSA CCM v4.0 or SSAE-18 / ISAE 3402
• Vulnerability management approach: Our vulnerability management process includes regular assessments of potential threats through continuous monitoring and threat intelligence feeds. We deploy patches within 24 hours of identifying a critical vulnerability and within 72 hours for high-risk vulnerabilities. We gather information about emerging threats from reputable sources such as the National Cyber Security Centre (NCSC), vendor notifications, and industry-specific advisories to ensure our services remain secure and compliant with best practices.
• Protective monitoring type: Complies with a recognised standard, for example CSA CCM v4.0 or SSAE-18 / ISAE 3402
• Protective monitoring approach: Our protective monitoring process involves continuous monitoring of system logs and network traffic to identify unusual patterns that may indicate potential compromises. Upon detecting a potential compromise, we initiate an incident response protocol, which includes containment, investigation, and remediation steps. Our response time for critical incidents is within 30 minutes, ensuring swift action to mitigate risks and safeguard sensitive data. Regular reviews and updates of our monitoring tools and processes are conducted to adapt to emerging threats, ensuring a proactive approach to security.
• Incident management type: Complies with a recognised standard, for example, CSA CCM v4.0 or ISO/IEC 27035:2011 or SSAE-18 / ISAE 3402
• Incident management approach: Our incident management process includes predefined workflows for common events, ensuring rapid response and resolution. Users can report incidents through a dedicated support portal, email, or phone, enabling quick logging and tracking. We provide incident reports detailing the nature of the incident, actions taken, and resolution outcomes. These reports are shared with affected users and relevant stakeholders to maintain transparency and facilitate continuous improvement. Our approach aligns with best practices to ensure a structured response that minimises disruption and enhances service reliability.
• Post-quantum cryptography secure: Yes

Secure development

• Approach to secure software development best practice: Independent review of processes (for example CESG CPA Build Standard, ISO/IEC 27034, ISO/IEC 27001 or CSA CCM v4.0)

Public sector networks

• Connection to public sector networks: Yes
• Connected networks: Public Services Network (PSN)

Pricing

• Discount for educational organisations: Yes
• Free trial available: No

Discount percentage by annual call-off contract value (excluding VAT)

• Less than £250,000: 0%
• Between £250,000 and £500,000: 0%
• Between £500,001 and £1,000,000: 0%
• Between £1,000,001 and £2,500,000: 0%
• Between £2,500,001 and £5,000,000: 0%
• Over £5,000,001: 0%

Non-mandatory Standards and certifications

• ISO/IEC 27001 certification: Yes
• Who accredited the ISO/IEC 27001: Atlas
• ISO/IEC 27001 accreditation date: Sunday 13 April 2025
• What the ISO/IEC 27001 doesn’t cover: N/A
• ISO 28000:2022 certification: No
• ISO 9001 certification: Yes
• Who accredited the ISO 9001 certification: Atlas
• ISO 9001 accreditation date: Tuesday 1 April 2025
• What the ISO 9001 doesn’t cover: N/A
• Quality management systems (QMS): Yes
• CSA STAR certification: No
• PCI certification: No
• Cyber essentials: Yes
• Please provide your Cyber Essentials Certificate Number: Be7ce590-de10-486e-8431-2e10891a8979
• Cyber essentials plus: Yes
• Please provide your Cyber Essentials Plus Certificate Number: Cd8b1a78-44c7-4bb0-84d6-59a7506f3bba
• Other security certifications: No

Social value

• Section B - Commitment for Future: Delivery:

  • Mission: Kick start economic growth. To secure the highest sustained growth in the G7 - with good jobs and productivity growth in every part of the country making everyone, not just a few, better off.

    Policy Outcome 1: Fair work: That offers fair wages and good working conditions. Help people get a job, stay in work, and progress in their careers, with good employment opportunities across the country. Notes: Where there is a large proportion of labour costs in the contract, commercial teams should consider MAC in Outcome 1 as a priority

    • Providing opportunities for, and measuring and monitoring of, staff workforce conditions over time, including employee engagement, involvement in decision-making and satisfaction and adapting to any changes in the results, with clear processes for acting on issues identified
    • Plans to engage the contract workforce in deciding the most important workplace issues to address
    • Ensuring new workers are informed of their right to join a trade union
    • Monitoring of employee engagement rates (by protected characteristic) and, where necessary, the development of actions to ensure all voices are heard across the diversity of the workforce
    • Employment contracts that reflect actual hours worked; steps taken to ensure employees understand their contracts and have the ability to review and adjust them if actual hours regularly exceed contracted hours
    • Activities that support an environment where staff are educated about, and feel empowered to, address their physical wellbeing
    • Activities that support an environment where staff are educated about and feel empowered to report and address bullying and harassment
    • Activities to cascade good practice on fair working conditions throughout the supply chain
    • Offer a pay and leave entitlement to all eligible staff who become kinship carers, ideally equivalent to statutory adoption pay and leave
    • Payment of more than the National Minimum Wage or National Living Wage (as appropriate) to the contract workforce
    • Monitoring and reporting of gender and ethnicity pay gaps and plans to address them where necessary
    • Entitlement to sick pay for the contract workforce, with provision in place for any staff who do not meet the earnings threshold for statutory sick pay, payment of sick pay from day one of absence and payment of staff on the contract workforce who are off sick a replacement income of 100% of their usual earnings for as long as possible
    • Plans for an appropriate income replacement policy for staff who are required to spend time away from work to care for a sick dependent or close relative

Service documents

• Pricing document

  PDF

• Service definition document

  PDF

• Terms and conditions

  PDF

Request an accessible format

If you use assistive technology (such as a screen reader) and need versions of these documents in a more accessible format, email the supplier at pstenderteam@insight.com. Tell them what format you need. It will help if you say what assistive technology you use.