Cloud Data Engineer with Python Expertise

Join a dynamic team as a Cloud Data Engineer specializing in Python and Pyspark for enterprise-scale systems. This role demands collaboration with business analysts and a keen understanding of data warehousing concepts.
In this role, you’ll leverage your expertise to build and optimize data pipelines, ensuring high data quality while working within the Databricks environment. With a focus on performance, you will design and develop Spark programs and integrate various data sources effectively, all while adhering to data governance best practices.
Key Responsibilities:
• Build and optimize efficient data pipelines
• Design and develop Spark programs in Databricks
• Monitor and troubleshoot Databricks job performance
• Implement data management and governance practices
• Perform code reviews for compliance to standards
Requirements:
• 5+ years Python coding experience
• 5+ years SQL Server development
• ETL pipeline experience using Databricks Pyspark
...