Data Engineer – Data Platform

Key Responsibilities:

• Develop and maintain robust data pipelines for batch and real-time data processing.
• Design, configure, and manage workflows using Apache NiFi and Kafka.
• Work collaboratively with data scientists and analysts to support data exploration and modeling in Jupyter Lab and Data Lab environments.
• Deploy, monitor, and manage data science models using Domino Lab.
• Ensure data quality, integrity, and availability across data platforms.
• Troubleshoot and optimize data workflows and system performance.

Required Skills & Qualifications:

• Minimum of 2 years of experience as a Data Engineer or Data Pipeline Engineer.
• Proficient in Python for building ETL/ELT pipelines.
• Hands-on experience with Domino Lab for model lifecycle management.
• Strong knowledge of Apache NiFi and Kafka for data ingestion and streaming.
• Experience working with Jupyter Lab or Data Lab for ...