Full-time
Senior Pyspark Developer
Posted by Kavi Software Technologies Private Limited • Chennai, Tamil Nadu, India
About the Role
Senior PySpark Developer
Job Summary
We are looking for a Senior PySpark Developer with strong hands-on experience working on the Cloudera stack. The role involves building and maintaining large-scale data processing and ETL pipelines using PySpark. Experience in finance or banking environments is a plus.
Experience: 5+ years
Key Responsibilities
• Develop and maintain PySpark-based ETL pipelines on the Cloudera platform
• Write efficient PySpark and Spark SQL transformations
• Process large volumes of structured and semi-structured data
• Optimize Spark jobs for performance and scalability
• Create and manage Hive tables and partitions
• Handle data validation, reconciliation, and error handling
• Support...
Ready to Apply?
Submit your application today and take the next step in your career journey with Kavi Software Technologies Private Limited.
Apply Now