Data Engineer Centurion

Job Description

Profile Outline
A technology focused individual, data engineers will need to design, configure, develop, and deploy data transformations.

Key Responsibilities

1. Develop ETL pipelines. The data transformations will be developed in Azure Databricks using Python and on Azure SQL using T-SQL and deployed using ARM templates.
2. Combine and curate data in a central data lake.
3. Serve data for application and analytics through a variety of technologies such as SQL, Server Synapse, CosmosDB, and TSI.
4. Build transformation pipelines into dimensions and facts; therefore, a strong knowledge of standard BI concepts is mandatory.
5. Build stream pipelines leveraging IoT Hub, Event Hub, Databricks streaming, and other Azure stream technologies.
6. Work in a fluid environment with changing requirements whilst maintaining absolute attention to detail.

Knowledge <...