AMBER LABS LIMITED

Databricks Data Lakehouse Service

The Amber Labs Data Lakehouse service will design and implement a Data Lakehouse solution based on the Databricks Data Lake and Spark platforms. A Data Lakehouse can deliver the economics of a data lake implementation with the performance and governance of a data warehouse solution across different workloads.

Features

• Unlimited storage scalability
• Support for structured, semi-structured and structured data
• Support for data science and business intelligence workloads
• Supports Python, R, Scala, Java and SQL languages
• Multi-cloud deployment options for AWS, Azure and Google Cloud
• ACID transaction and schema enforcement governance
• Library for third party and custom code extensibility
• Support for batch, micro-batch and streaming data ingestion
• Governance and meta-data handling with Databricks Unity Catalogue
• Secure real-time data sharing cross organisation with Delta Share

Benefits

• Delta compression optimisation reduces storage costs.
• Delta compression optimisation for compute costs
• Familiar notebook interface for Data Scientists, Engineers and Analysts
• Governed Lakehouse data platform avoiding risk of swamp-like platforms
• Open-standards technology platform
• Multi-cloud support
• Third-party integrations with data integration and data visualisation vendors
• Wide and varied use-case support
• Reduce time spent on users finding data
• Reduce time spent on users processing data.

£376 to £1,696 a unit a day

• Education pricing available

Service documents

• Pricing document

  PDF

• Skills Framework for the Information Age rate card

  PDF

• Service definition document

  PDF

• Terms and conditions

  PDF

Request an accessible format

If you use assistive technology (such as a screen reader) and need versions of these documents in a more accessible format, email the supplier at sales@amberlabs.io. Tell them what format you need. It will help if you say what assistive technology you use.

Framework

G-Cloud 14

Service ID

178831537303339

Contact

James Bennett
07852109808
sales@amberlabs.io

Planning

• Planning service: Yes
• How the planning service works: Planning will start establishing use-cases to be incorporated into a Lakehouse platform. These may be specific data science, machine learning, data engineering, data analysis, visualisation/reporting or integration into upstream or downstream components.; Understanding and assessing the use-cases will validate that a data lakehouse is the correct solution and will establish the benefits of deployment.; Cloud infrastructure design will also be a key planning component, ensuring all of the pre-requisites for a Databricks Lakehouse platform will be in place and that the architecture is secure, cost optimised, reliable, performant, operationally effective and sustainable.; Ensuring the platform has the correct level of environments, deployable via infrastructure as code to enable consistent and efficient Continuous Integration and Continuous Delivery.; The structure of the Lakehouse will be planned and designed. This will be informed by use-cases and requirements, but will follow leading practices such as the Databricks' medallion approach (bronze silver and gold zones based on data curation).; Data integration will require planning to ensure connectivity and any pre-requisites planned for (e.g. firewall configurations).; Finally all tools and services that will securely access the Lakehouse will be planned in such as Databricks cluster and workspace configuration, access via other third party tools.
• Planning service works with specific services: Yes
• Hosting or software services the planning service works with:
  • Databricks
  • Azure Web Services
  • Microsoft Azure Cloud
  • Google Cloud

Training

• Training service provided: No

Setup and migration

• Setup or migration service available: Yes
• How the setup or migration service works: Use-cases for the Data Lakehouse can consist of decommissioning older legacy systems and migrating data and process to or between cloud services.; An assessment of the end-to-end process to understand the data and the processing involved will be carried out. This will define how the data will be stored as it is ingested, integrated and curated to identify the most appropriate and efficient compute option. Ingestion approaches (batch, micro-batch, streaming) will also be evaluated along with the most suitable pattern to ingest (ETL, ELT).; Proof of concepts can be set up to verify and demonstrate value if required.; Storage will be optimised based on workload in terms of how often the data is accessed and any regulatory or retention requirements.; Data volumetrics will define the most suitable data migration approach whether that migration is on-premise to cloud or cloud-to-cloud.; All migration activity will be planned including cutover and where appropriate decommission of legacy systems.; As cloud services may be new to the buyer then Amber Labs will ensure that knowledge is transferred from both its cloud platform and data engineering teams to the buyer organisation, so colleagues comfortable with new terminology, technologies or vocabulary.
• Setup or migration service is for specific cloud services: Yes
• List of supported services:
  • Amazone Web Services
  • Microsoft Azure
  • Google Cloud

Quality assurance and performance testing

• Quality assurance and performance testing service: Yes
• How the quality assurance and performance testing works: A Quality Assurance Strategy will be delivered and will ensure:; ; Quality assurance will consistently applied through delivery - from validation of requirements to design governance and review.; Quality assurance testing will be carried out on cloud infrastructure. This will ensure that the data lakehouse solution has been implemented as per design, is secure ensuring principles of least access, with data encryption both at rest and in transit and will meet all non-functional requirements such as Recovery Point Objectives (RPO) and Recovery Time Objectives (RTO).; ; Migration will consist of firstly ensuring that the correct data is migrated across to the new data lakehouse platform. Testing will ensure that historic data is migrated, processed and stored in the correct Lakehouse container as a one-off data historical data load.; ; Testing will then focus on processing incremental data that is ingested into the data lakehouse, whether that is via batch, micro-batch or streamed ingestion. Data validity checks will be made at all storage points whether persistent or temporary.; ; Integration testing will ensure that connectivity to all upstream and downstream systems work as planned.; ; Performance testing will be executed to ensure that compute performance meets expectations.; ; Finally the project will support User Acceptance testing.

Security testing

• Security services: Yes
• Security services type:
  • Security risk management
  • Security design
  • Security testing
  • Security incident management
  • Security audit services
• Certified security testers: Yes
• Security testing certifications: Other
• Other security testing certifications:
  • Secure SDLC Training
  • OWASP

Ongoing support

• Ongoing support service: Yes
• Types of service supported:
  • Buyer hosting or software
  • Hosting or software provided by your organisation
• How the support service works: Our Data Bricks Solution can be deployed into Cloud Services that are owned and managed by Amber Labs, or Deployed into your Own Cloud Platforms. If deployed into an Amber Labs Cloud Platform the Solution will operate as Software As a Service and will be fully managed and maintained by Amber Labs. ; ; We can also provide support services for Solutions that are deployed on your own Cloud Platforms. Terms and conditions of Amber Labs Managed Solutions can be provided on request.

Service scope

• Service constraints: There are no constraints that to the Data Lakehouse services that buyers should know about.

User support

• Email or online ticketing support: Email or online ticketing
• Support response times: Depending on the level of service required, we can provide varying response times up to 24*7 365 Days per year support with 30 minute response times. It is recommended that the Service Level Agreement appropriate for your needs be assessed and agreed during the Project Implementation phase
• User can manage status and priority of support tickets: Yes
• Online ticketing support accessibility: WCAG 2.1 AA or EN 301 549
• Phone support: Yes
• Phone support availability: 24 hours, 7 days a week
• Web chat support: Yes, at an extra cost
• Web chat support availability: 24 hours, 7 days a week
• Web chat support accessibility standard: WCAG 2.1 AA or EN 301 549
• Web chat accessibility testing: Our Web Chat Tool has been thoroughly tested with a range of Assistive Technology users.
• Support levels: We can provide a range of custom support levels ranging from short periods of dedicated support time per day up to 24*7 365 Days per year. The level of support required will depend on the Databricks Solution being implemented. The precise level of support required will be defined during the project costing phase. Support Costs will be based on the Service Management Rates detailed in our rate card.

Resellers

• Supplier type: Not a reseller

Staff security

• Staff security clearance: Conforms to BS7858:2019
• Government security clearance: Up to Developed Vetting (DV)

Standards and certifications

• ISO/IEC 27001 certification: Yes
• Who accredited the ISO/IEC 27001: Schellman & Company LLC
• ISO/IEC 27001 accreditation date: 31/01/2006
• What the ISO/IEC 27001 doesn’t cover: Office locations not listed in our ISO 27001 certificate as well as security controls covered by our cloud service providers (e.g. AWS)
• ISO 28000:2007 certification: No
• CSA STAR certification: No
• PCI certification: Yes
• Who accredited the PCI DSS certification: A-Lign Assurance
• PCI DSS accreditation date: 31/01/2020
• What the PCI DSS doesn’t cover: N/a
• Cyber essentials: Yes
• Cyber essentials plus: Yes
• Other security certifications: Yes
• Any other security certifications:
  • SOC 2 Type II
  • HIPAA

Social Value

• Social Value:

  Social Value

  • Fighting climate change
  • Covid-19 recovery
  • Tackling economic inequality
  • Equal opportunity
  • Wellbeing

  Fighting climate change

  At Amber Labs, we are deeply committed to effective stewardship of the environment, aligning with our mission to fight climate change. Our predominantly remote and paperless way of working not only enhances efficiency but also significantly reduces our carbon footprint. By minimising the need for commuting and embracing digital solutions, we actively contribute to lowering greenhouse gas emissions, working towards our goal of achieving net zero emissions. Additionally, our company employees benefit from an electric vehicle scheme, further promoting sustainable transportation practices. Through our contracts, we harness our influence to instil environmental consciousness among staff, suppliers, customers, and communities, fostering a culture of protection and improvement to address the urgent challenges posed by climate change.

  Covid-19 recovery

  At Amber Labs, we prioritise a predominantly remote work setup, unless specifically requested by our clients. This approach not only grants our team greater flexibility but also serves as a proactive measure to mitigate health risks, including those associated with Covid-19. This adaptability not only benefits our valued staff but also aligns with the evolving needs of our clients, many of whom have yet to fully transition back to pre-pandemic office setups.; ; We create employment through our apprenticeship program. This scheme empowers young people from all backgrounds across the country to build meaningful careers in technology, by providing skill-building and employment pathways. Through our program, we not only bridge the digital and geographic divide but also cultivate a diverse and skilled workforce that drives innovation and social progress. ; ; In addition to our apprenticeship scheme, we're deeply committed to fostering employment opportunities through our graduate program. Geared towards technology graduates, this program is designed to pave the way for fulfilling careers in consulting, with a specialised focus on bolstering AI skills. We firmly believe that investing in such high-growth sectors equips individuals with the tools needed for remarkable success.; ; Furthermore, in recognition of the ongoing challenges posed by Covid-19 and other long-term health conditions, Amber Labs is dedicated to supporting affected employees through tailored accommodations. From flexible work hours to remote work options, and even adjustments in job responsibilities, we strive to create an inclusive and supportive environment where every team member can thrive.

  Tackling economic inequality

  At Amber Labs, we're committed to fostering economic inclusivity through our apprenticeship and graduate programs. Our apprenticeship scheme is designed to empower individuals from diverse backgrounds, providing skill-building opportunities and employment pathways in the technology sector. On the other hand, our graduate program specifically targets graduates in technology disciplines, equipping them with the expertise needed to thrive in high-growth industries like AI. In addition to these programs, Amber Labs initiates partnerships with inner-city schools to introduce students to technology careers, providing insights and connections with industry professionals and enhancing awareness of emerging technologies like AI from a young age.; ; Furthermore, Amber Labs proudly boasts a geographically diverse workforce drawn from all regions across the UK. By offering market-leading salaries, hybrid and flexible working arrangements, we demonstrate our commitment to creating an inclusive environment where everyone has the opportunity to succeed, regardless of their location or background.; ; In recognition of the economic challenges faced by many, such as the ongoing repercussions of Covid-19, Amber Labs is dedicated to providing support and accommodations. Whether through flexible work arrangements, remote work options, or tailored leave policies, we aim to ensure that individuals facing economic adversity have the opportunity to thrive in the workplace.; ; As an SME, we take pride in our continuous commitment to enhancing supply chain resilience and capacity.; ; Embracing innovation, including disruptive technologies like AI, we drive efficiencies and deliver higher quality goods and services, while also supporting the development of scalable and future-proofed methods within the supply chain. Cybersecurity is paramount, and we take proactive measures to identify and manage risks throughout the delivery process, including training for all our new consultants.

  Equal opportunity

  At Amber Labs, we are dedicated to reducing the disability employment gap and fostering equal opportunities within our workforce. Through our commitment to diversity and inclusion, we take proactive measures to increase the representation of disabled individuals in our contract workforce. Our interview processes are predominantly conducted remotely, ensuring accessibility and inclusivity from the outset. Additionally, we provide comprehensive support for disabled employees, including adaptations for remote working and accessible facilities, ensuring that they have the tools and resources needed to thrive in their roles.; ; Furthermore, we prioritise tackling workforce inequality through our performance management framework, which identifies areas for training and development for all employees. This framework ensures that individuals, including those from disadvantaged or minority groups, have access to opportunities for in-work progression and skills development relevant to our contracts. We use the information from this framework, and our knowledge on industry trends and client needs, to invest in continuous training for our consultants to ensure they remain up-to-date; this is funded internally to guarantee that our employees receive the necessary support to excel in their careers. Through these initiatives, we are committed to fostering an inclusive and equitable work environment where everyone has the opportunity to succeed.

  Wellbeing

  At Amber Labs, we prioritise the health and wellbeing of our workforce by taking proactive measures and fostering a supportive environment. We offer private medical insurance to all our employees once they have passed probation. Through initiatives like Perkbox, consultants have access to free mental health and physical health resources, along with discounts for gym memberships. Additionally, we advertise an HR inbox and provide a designated point of contact for those who wish to discuss mental health concerns, supplementing the line management chain for additional support and accessibility.

Pricing

• Price: £376 to £1,696 a unit a day
• Discount for educational organisations: Yes

Service documents

• Pricing document

  PDF

• Skills Framework for the Information Age rate card

  PDF

• Service definition document

  PDF

• Terms and conditions

  PDF

Request an accessible format

If you use assistive technology (such as a screen reader) and need versions of these documents in a more accessible format, email the supplier at sales@amberlabs.io. Tell them what format you need. It will help if you say what assistive technology you use.