Senior Data Engineer

Job Summary
We are seeking an experienced Senior Data Engineer with strong expertise in big data technologies and modern data engineering practices. The ideal candidate will have extensive hands-on experience in Scala, PySpark, and Apache Spark, along with strong problem-solving capabilities and exposure to cloud and DevOps environments. This role involves designing, developing, and optimizing scalable data pipelines while supporting data migration and AI-driven initiatives.
Key Responsibilities
Design, develop, and maintain scalable data pipelines using Spark, Scala, and PySpark.
Perform large-scale data migration and modernization initiatives across platforms.
Develop and optimize batch and real-time data processing solutions.
Work with distributed data frameworks such as Apache Spark and Hadoop.
Implement automation using Shell Scripting and DevOps best practices.
Collaborate with cross-functional teams including Data Scientists, Analysts, and DevOps engineer...