Azure Data Engineer

Overview

We are looking for a highly skilled Azure Data Engineer for an engagement to build scalable, production-ready data solutions.

Responsibilities

• Build and optimize data pipelines using Python, PySpark, Spark SQL, and Azure Databricks
• Develop clean, modular code for data ingestion, transformation, validation, and quality checks
• Work with Azure Data Lake Storage Gen2 and Azure SQL to deliver reliable solutions
• Implement best practices for data quality, integrity, and security
• Troubleshoot issues independently and collaborate with cross-functional teams
• Maintain clear technical documentation and support production environments

Required Skills

• Strong expertise in PySpark, Spark SQL, and Spark optimization/performance tuning
• Hands-on experience with Azure Databricks (notebooks, workflows, job clusters)
• Solid understanding of Delta Lake (schema...