About the Role
Pyspark , AWS Developer
Location: Plano, TX / Jersey City, NJ - hybrid onsite
Core responsibilities
- Data pipeline development Design, develop, and maintain high-performance data pipelines using PySpark.
- Performance optimization Optimize and tune existing data processing workflows for better performance and efficiency.
- Data transformation Implement complex data transformations and integrations, such as reading from external sources, merging data, and loading into target destinations.
- Troubleshooting Monitor and troubleshoot performance issues, errors, and other problems in data processing systems.
- Collaboration Work with cross-functional teams like data scientists, data engineers, and business analysts to understand requirements and deliver solutions.
Required skills and qualifications
- Technical skills Strong proficiency in Python and Apache Spark is essential, along with exp...
Location: Plano, TX / Jersey City, NJ - hybrid onsite
Core responsibilities
- Data pipeline development Design, develop, and maintain high-performance data pipelines using PySpark.
- Performance optimization Optimize and tune existing data processing workflows for better performance and efficiency.
- Data transformation Implement complex data transformations and integrations, such as reading from external sources, merging data, and loading into target destinations.
- Troubleshooting Monitor and troubleshoot performance issues, errors, and other problems in data processing systems.
- Collaboration Work with cross-functional teams like data scientists, data engineers, and business analysts to understand requirements and deliver solutions.
Required skills and qualifications
- Technical skills Strong proficiency in Python and Apache Spark is essential, along with exp...
Ready to Apply?
Submit your application today and take the next step in your career journey with Q1 Technologies, Inc.
Apply Now