Data Engineer – Azure Databricks/Microsoft Purview

Data Engineer with strong expertise in Azure Databricks and Microsoft Purview

Experience Level: Mid–Senior (5+ Years)

Location: Taguig - Onsite

Employment Type: (Full‑time/Direct Hire)

Key Responsibilities

• Design, build, and maintain scalable data processing pipelines using Azure Databricks and Spark.
• Develop high‑quality Python (PySpark) and SQL code for large‑scale data processing.
• Implement data governance, classification, lineage tracking, and cataloging using Microsoft Purview.
• Develop and optimize ETL/ELT workflows for ingestion, transformation, and integration across Azure services.
• Ensure data quality, security, and compliance across all datasets and pipelines.
• Collaborate with data architects, analysts, and business stakeholders to deliver reliable data solutions.
• Maintain proper version control in Git and follow CI/CD best practices.
• Produce clear and comprehensive techni...