About the Role
As a Data Engineer, you will be responsible for:
Data Engineering & Development
* Design, build, and maintain high-quality, scalable, and tested data pipelines.
* Develop and manage Databricks structured streaming pipelines.
* Build and optimize event-driven and real-time data processing solutions.
* Implement and maintain Unity Catalog-based Lakehouse architecture.
* Develop analytics-ready datasets to support business insights and reporting.
Platform & Automation
* Build and manage CI/CD pipelines using Azure DevOps.
* Identify and implement automation opportunities across workflows.
* Ensure reliable and stable data platform operations.
* Apply governance, security, and documentation standards.
Data Quality & Reliability
* Establish the Data Lakehouse as a trusted and reliable source of truth.
* Monitor, troubleshoot, and resolve data incidents.
...
Data Engineering & Development
* Design, build, and maintain high-quality, scalable, and tested data pipelines.
* Develop and manage Databricks structured streaming pipelines.
* Build and optimize event-driven and real-time data processing solutions.
* Implement and maintain Unity Catalog-based Lakehouse architecture.
* Develop analytics-ready datasets to support business insights and reporting.
Platform & Automation
* Build and manage CI/CD pipelines using Azure DevOps.
* Identify and implement automation opportunities across workflows.
* Ensure reliable and stable data platform operations.
* Apply governance, security, and documentation standards.
Data Quality & Reliability
* Establish the Data Lakehouse as a trusted and reliable source of truth.
* Monitor, troubleshoot, and resolve data incidents.
...
Ready to Apply?
Submit your application today and take the next step in your career journey with BGTS LTD.
Apply Now