We are looking for an experienced Senior Data Engineer to join one of our client’s team.
Role and Responsibilities:
Design, develop, and maintain scalable data pipelines using Python, PySpark and Databricks.Implement data orchestration workflows using Airflow or similar tools.Manage and optimize data storage solutions on Azure Cloud.Develop and maintain containerized microservices using Docker.Collaborate with cross-functional teams to ensure data quality and integrity.Support the setup of blockchains.Build tools to acquire data from blockchains and perform analysis on the data using Databricks.Support production infrastructure, including monitoring and automation using tools like Datadog.Participate in agile development practices, contributing to planning exercises and working in cross-functional groups. Skills and Qualifications:
Bachelor’s o...