Full-time
Data Engineer with Python and Spark Expertise
Posted by Confidential • mississauga, peel region, Canada
About the Role
We are looking for a Data Engineer with significant experience (9+ years) in Python and Spark for a full-time onsite position, five days a week. This role is crucial for developing effective software solutions.
As a Data Engineer, you will utilize your Python and Pyspark skills to design software solutions and conduct data analysis. Your tasks will also include gathering data from HBase, performing transformations with Apache Spark, and creating back-end services and APIs for seamless data integration.
Key Responsibilities:
• Develop and maintain software solutions in Python
• Implement Pyspark programs for data analysis
• Gather data from HBase for business transformations
• Create back-end services and integrate databases
• Enhance application performance and security
Requirements:
• Minimum of 9 years in data engineering/development
• Expertise in Python, Spark, and Pyspark
• Experience with Apache Spark DataFrames and RDDs
• Knowledge of database...
As a Data Engineer, you will utilize your Python and Pyspark skills to design software solutions and conduct data analysis. Your tasks will also include gathering data from HBase, performing transformations with Apache Spark, and creating back-end services and APIs for seamless data integration.
Key Responsibilities:
• Develop and maintain software solutions in Python
• Implement Pyspark programs for data analysis
• Gather data from HBase for business transformations
• Create back-end services and integrate databases
• Enhance application performance and security
Requirements:
• Minimum of 9 years in data engineering/development
• Expertise in Python, Spark, and Pyspark
• Experience with Apache Spark DataFrames and RDDs
• Knowledge of database...
Ready to Apply?
Submit your application today and take the next step in your career journey with Confidential.
Apply Now