Lead Data Engineer
<p><b>Salary: £70,000 - 85,000 per year</b></p>
<b>Requirements:</b>
<ul><li>Proven experience building and owning data platforms on Azure</li><li>Deep, hands-on knowledge of Databricks (lakehouse architecture, cluster management, performance and cost optimisation)</li><li>Strong opinions on data modelling, schema design, and standardisation</li><li>Treat data pipelines as software: version control, CI/CD, automated testing</li><li>Comfortable challenging architectural decisions and explaining their impact</li><li>Able to translate technical trade-offs into business impact for non-technical stakeholders</li><li>A mentor by nature, raising the team through pairing, guidance, and example</li><li>Experience with industrial, sensor-driven, or time-series data highly desirable</li><li>Background in high-volume or highly variable data environments is a plus</li></ul>
<b>Responsibilities:</b>
<ul><li>Own the data platform and shape the future architecture</li><li>Lead the design and building of a modern, highly scalable data platform</li><li>Architect and rebuild the data transformation layer in Databricks</li><li>Design robust data flows that support both real-time operational views and deep historical analysis</li><li>Move pipelines from ad-hoc scripts to software-engineering standards (CI/CD, testing, modular design)</li><li>Define clear data models, schemas, and standards across a complex data estate</li><li>Establish a stable, high-performance serving layer for analytics, visualisation, and data science workloads</li><li>Work closely with data scientists to remove bottlenecks and enable better modelling and experimentation</li><li>Engage in pair-programming, mentoring, and raising the engineering bar for a small, capable team</li></ul>
<b>Technologies:</b>
<ul><li>Architect</li><li>Azure</li><li>CI/CD</li><li>Databricks</li><li>Support</li><li>Cloud</li><li>Grafana</li><li>Machine Learning</li><li>MQTT</li><li>Python</li><li>SQL</li><li>dbt</li></ul>
<p><b>More:</b></p>
<p>We are a dynamic company located in Sheffield, looking for a Lead Data Engineer specializing in Azure and Databricks to join our hybrid working model, where youll work in person two days a week. We offer a competitive salary of up to £85k depending on experience, alongside great benefits such as 5 weeks paid holiday plus bank holidays, tax-efficient stock options, a company pension scheme, and professional development support. Our team values transparency, mentoring, and innovation, allowing you to make meaningful architectural decisions while working on advanced data patterns and architectures.</p>
<p>last updated 8 week of 2026</p>
<b>Requirements:</b>
<ul><li>Proven experience building and owning data platforms on Azure</li><li>Deep, hands-on knowledge of Databricks (lakehouse architecture, cluster management, performance and cost optimisation)</li><li>Strong opinions on data modelling, schema design, and standardisation</li><li>Treat data pipelines as software: version control, CI/CD, automated testing</li><li>Comfortable challenging architectural decisions and explaining their impact</li><li>Able to translate technical trade-offs into business impact for non-technical stakeholders</li><li>A mentor by nature, raising the team through pairing, guidance, and example</li><li>Experience with industrial, sensor-driven, or time-series data highly desirable</li><li>Background in high-volume or highly variable data environments is a plus</li></ul>
<b>Responsibilities:</b>
<ul><li>Own the data platform and shape the future architecture</li><li>Lead the design and building of a modern, highly scalable data platform</li><li>Architect and rebuild the data transformation layer in Databricks</li><li>Design robust data flows that support both real-time operational views and deep historical analysis</li><li>Move pipelines from ad-hoc scripts to software-engineering standards (CI/CD, testing, modular design)</li><li>Define clear data models, schemas, and standards across a complex data estate</li><li>Establish a stable, high-performance serving layer for analytics, visualisation, and data science workloads</li><li>Work closely with data scientists to remove bottlenecks and enable better modelling and experimentation</li><li>Engage in pair-programming, mentoring, and raising the engineering bar for a small, capable team</li></ul>
<b>Technologies:</b>
<ul><li>Architect</li><li>Azure</li><li>CI/CD</li><li>Databricks</li><li>Support</li><li>Cloud</li><li>Grafana</li><li>Machine Learning</li><li>MQTT</li><li>Python</li><li>SQL</li><li>dbt</li></ul>
<p><b>More:</b></p>
<p>We are a dynamic company located in Sheffield, looking for a Lead Data Engineer specializing in Azure and Databricks to join our hybrid working model, where youll work in person two days a week. We offer a competitive salary of up to £85k depending on experience, alongside great benefits such as 5 weeks paid holiday plus bank holidays, tax-efficient stock options, a company pension scheme, and professional development support. Our team values transparency, mentoring, and innovation, allowing you to make meaningful architectural decisions while working on advanced data patterns and architectures.</p>
<p>last updated 8 week of 2026</p>