Senior Data Engineer

X4 Contract Senior Data Engineers
3 Month Duration
Location: London, Manchester, Midlands
Inside IR35 - £475 - £525 per day
January start

Our client is seeking multiple Senior Data Engineers to join their client for 3 months starting in January.

You'll need strong experience in Databricks, Python, Pyspark, Deltalake, SQL and ADF skills and familiar with working within a Data Engineering framework and have been involved in the creation, configuration of the framework, metadata configuration and use of Unity Catalogue within Databricks including CI/CD.

Ideally as a Senior Data Engineer you'll have delivered the following:
-Data pipelines following Data Engineering best practice and standards. This includes meta driven parameterised and automated Azure Data Factory and Databricks as appropriate.
- Data pipelines deployment was undertaken through ADO (Repos, GIT, Pull Requests, Pipeline Running), Python, Pyspark, SQL and Databricks Medallion and Deltalake.
- Outputs of data pipelines were assured and evaluation of comparison between as-is and to-be was presented to users for acceptance.
- Data pipelines were built with appropriate quality checks and reporting in place as agreed with primary users and Data Operations data leads.
- Operational handover documents such as runbooks were created and revised through engagement with end users.
- All artefacts were created, and documents saved on SharePoint.
- The data asset was successfully deployed after testing and signed off by the Service Owner and Engineering leads.

Key skills:
- 5+ years of data engineering experience
- Built data products in Microsoft Azure using Azure Data Factory and Databricks
- Sound experience of data management & data quality management
- Azure SQL

This role requires you to be security cleared. You will need to be in the UK, able to work at one of the above listed locations and not require any sponsorship.

Please apply to be considered for the opportunity.