Data Engineer

Job Description
One of our clients within the Financial Services space is looking for a full-time Data Engineer to support their organization. This position is part of the Enterprise Data & Analytics Capability team under Global Technology Organization. In this role, you will lead the design, development, and optimization of large-scale data solutions on the Databricks platform. Day to day responsibilities include the following:

• Design, build, and maintain scalable data pipelines on Databricks (using Spark, Delta Lake, etc.)
• Write clean, efficient and maintainable PySpark or SQL code for data transformation
• Design robust data models for analytics and reporting
• Ensure data quality, consistency, and governance
• Handle batch and streaming data workflows
• Provide architectural guidance and support in platform usage
• Drive best practices in data engineering across the team
• Monitor and optimize performance of Spark jobs and cluster usage
• E...