Lead Data Engineer - Hadoop - Spark - Python

Job Title: Lead Data Engineer - Hadoop, Spark, Pytthon
Location: Sheffield - 3 days per week in the office
Salary/Rate: Up to £617 per day inside IR35
Start Date: 02/03/2026
Job Type: Contract until November

We are seeking a Lead Data Engineering Consultant with proven experience in leading and developing data engineering platforms.

The ideal candidate will possess hands-on expertise in the following areas:

Extensive enterprise experience with Hadoop, Spark, and Splunk.
Proficiency in object-oriented and functional scripting, particularly in Python.
Skilled in handling raw, structured, semi-structured, and unstructured data (SQL and NoSQL).
Experience integrating large, disparate datasets using modern tools and frameworks.
Strong background in building and optimizing ETL/ELT data pipelines.
Familiarity with source control and implementing Continuous Integration, Delivery, and Deployment via CI/CD pipelines.
Experience supporting an...