About this role
Technical Requirements : 1. AWS: S3, Glue, Lambda, Step Function, Eventbridge, Cloudwatch, EMR, Secrets Manager, IAM 2. Infrastructure as Code (IaC): Terraform 3. Continuous Integration / Continuous Deployment (CI/CD): Jenkins, Gitlab 4. Coding: Python, SQL, Spark/PySpark 5. Data Engineering: Data pipeline development, DevOps, ETL / ELT design patterns, Batch vs real-time processing, Schema evolution and data partitioning, Problem-solving and debugging 6. Good to have: Starburst, Teradata, Iceberg