Full time
Automate data workflows using Apache Airflow or Cloud Composer
Posted by Orison Solutions • Kochi, Kerala, India
About the Role
Job Description<br />
<br />
Key Responsibilities<br />
<br />
<br />
<br />
Design, develop, and optimize ETL pipelines using PySpark on Google Cloud Platform (GCP).<br />
<br />
<br />
Work with BigQuery, Cloud Dataflow, Cloud Composer (Apache Airflow), and Cloud Storage for data transformation and orchestration.<br />
<br />
<br />
Develop and optimize Spark-based ETL processes for large-scale data processing.<br />
<br />
<br />
Implement best practices for data governance, security, and monitoring in a cloud environment.<br />
<br />
<br />
Collaborate with data engineers, analysts, and business stakeholders to understand data requirements.<br />
<br />
<br />
Troubleshoot performance bottlenecks and&n...
<br />
Key Responsibilities<br />
<br />
<br />
<br />
Design, develop, and optimize ETL pipelines using PySpark on Google Cloud Platform (GCP).<br />
<br />
<br />
Work with BigQuery, Cloud Dataflow, Cloud Composer (Apache Airflow), and Cloud Storage for data transformation and orchestration.<br />
<br />
<br />
Develop and optimize Spark-based ETL processes for large-scale data processing.<br />
<br />
<br />
Implement best practices for data governance, security, and monitoring in a cloud environment.<br />
<br />
<br />
Collaborate with data engineers, analysts, and business stakeholders to understand data requirements.<br />
<br />
<br />
Troubleshoot performance bottlenecks and&n...
Ready to Apply?
Submit your application today and take the next step in your career journey with Orison Solutions.
Apply Now