Cloud Data Engineer

Join to apply for the Cloud Data Engineer role at Epergne Solutions .

Job Location: Singapore

Experience: 6-8 Years

Responsibilities

• Design and architect data storage solutions such as databases, data lakes, and data warehouses using AWS (S3, RDS, Redshift, DynamoDB) and Databricks Delta Lake.
• Build, manage, and optimize data pipelines for ingestion, processing, and transformation using AWS Glue, AWS Lambda, Databricks, and Informatica IDMC.
• Integrate data from various internal and external sources into AWS and Databricks environments while ensuring data quality and consistency.
• Develop ETL processes using Databricks (Spark) and Informatica IDMC for cleansing, transforming, and enriching data.
• Monitor and optimize data processing performance and queries to meet scalability and efficiency requirements.
• Implement security b...