Lead Python Data Engineer

We are seeking a highly skilled
Lead Python Data Engineer
to join our team and lead the design and execution of scalable data solutions. This role involves overseeing innovative initiatives, leveraging advanced tools, and collaborating across teams to build robust data architectures and pipelines that meet shifting business demands.

Responsibilities

• Oversee, improve, and manage backend services and background jobs in Python, particularly with frameworks like FastAPI
• Architect and refine data processing workflows leveraging Pandas, Polars, openpyxl, and DuckDB
• Spearhead the design and maintenance of complex data architectures, including data lakes, medallion layers, and star schemas
• Develop and enhance CI/CD processes with tools like GitHub Actions
• Oversee the deployment and management of scalable solutions on Azure, using Container Apps, Azure Storage, Service Bus, and SignalR
• Define infrastructure configurations ...