Data Engineer (Azure Databricks)

<p><b><u>Job Description </u></b></p> <p> Proficiency in Python PySpark SQL and Databricks Experience with building and managing data pipelines using Azure Data Factory ADF and Apache Airflow Understanding of Continuous Integration and Continuous Deployment CICD tools such as Git Azure DevOps GitHub and Bitbucket</p> <p><b><u>Roles and Responsibilities </u></b></p> <p>Develop maintain and optimize scalable data pipelines and workflows Collaborate with data scientists' analysts and other stakeholders to understand data requirements Implement best practices for version control and CICD to ensure reliable and efficient deployment Monitor and troubleshoot data pipeline performance and resolve issues promptly Document data engineering processes and maintain clear communication across teams</p>