Azure Databricks Architect
<b>Requirements:</b>
<ul><li>Strong track record designing Azure Databricks-based architectures in enterprise environments</li><li>Deep understanding of Lakehouse principles, Delta Lake, and governance capabilities</li><li>Architectural expertise with Spark-based platforms</li><li>Experience designing secure, governed platforms within regulated or public sector contexts</li><li>Proven ability to produce high-quality High-Level Designs (HLDs), Low-Level Designs (LLDs), and architectural decision artifacts</li><li>Excellent knowledge of Azure data services and integration technologies</li><li>Relevant Azure or Databricks certifications (desirable)</li><li>Background in architectural assurance or design review bodies (desirable)</li><li>Experience delivering data platforms within UK government or public sector organisations (desirable)</li><li>Familiarity with UK government cloud and security frameworks (desirable)</li></ul>
<b>Responsibilities:</b>
<ul><li>Define and oversee the end-to-end architecture of Azure Databricks-driven data platforms</li><li>Create Lakehouse designs incorporating Azure Databricks, ADLS Gen2, and associated Azure services</li><li>Produce and maintain High-Level Designs (HLDs) and Low-Level Designs (LLDs)</li><li>Develop and enforce best-practice patterns for data ingestion, transformation, and consumption</li><li>Shape data security models, including RBAC and data separation strategies</li><li>Ensure platforms adhere to public sector governance, compliance, and security expectations</li><li>Address performance, resilience, scalability, and cost-efficiency within architectural decisions</li><li>Participate in architectural assurance processes and structured design reviews</li><li>Define integration approaches with Azure Data Factory, event-driven and batch ingestion services, and downstream analytics/reporting platforms</li><li>Provide architectural guidance for CI/CD pipelines and Infrastructure-as-Code</li><li>Lead optimisation efforts to support sustainable platform operations</li><li>Act as a design authority for Databricks decisions across multiple delivery teams</li><li>Support discovery and early-stage design for emerging data and analytics initiatives</li><li>Identify technical risks, dependencies, and constraints, contributing to mitigation plans</li></ul>
<b>Technologies:</b>
<ul><li>Architect</li><li>Azure</li><li>CI/CD</li><li>Cloud</li><li>Databricks</li><li>Support</li><li>RBAC</li><li>Security</li><li>Spark</li></ul>
<p><b>More:</b></p>
<p>We are seeking an experienced Azure Databricks Architect for a 6-month contract role that is primarily remote, with 2 days required on-site in London each month. Our organisation is focused on leading the design and development of a cloud-based data and analytics platform within a public sector setting. You will have the opportunity to collaborate with delivery teams and stakeholders, ensuring our platform meets the necessary security, scalability, and compliance standards. This role is primarily advisory and architectural, allowing you to work across multiple teams and support both delivery and assurance activities throughout the lifecycle of the data platform.</p>
<p>last updated 8 week of 2026</p>