AWS Data Engineer

Data Architecture & Engineering

• Architect, develop, and optimize complex ETL pipelines using AWS Glue, PySpark, and EMR.
• Automate metadata management and schema discovery using AWS Glue Crawlers.
• Manage large-scale data processing using AWS EMR (Spark, Hadoop, etc.).
• Implement and govern enterprise data lakes using AWS Lake Formation.
• Design and maintain scalable, secure Amazon S3 buckets and S3 Tables for structured and unstructured data.

Orchestration & Automation

• Orchestrate and monitor data workflows using AWS Step Functions, MWAA (Apache Airflow), or AWS Glue Workflows.
• Establish and manage CI/CD pipelines leveraging AWS CodePipeline, CodeBuild, CodeDeploy, and CodeCommit.
• Provision, automate, and maintain compute resources on Amazon EC2.

Application & Integration

• Integrate and manage APIs for seamless data ingestion and transformation.
• Develop serverle...