About this role
Data Engineer – Data and AI Tribe Responsibilities
• Design, architect and maintain secure data platform with focus on optimal data warehousing and modelling, data processing and storage • Assess and work with the right infrastructure and data technologies based on stakeholder requirements, ensuring highly available and scalable data capabilities • Implement and maintain optimized workflows, ETL / ELT processes, and pipelines • Produce visualization and insights on ingested data and be able to communicate results with non-technical stakeholders • Work with colleagues such as Product Owner, Data Analysts, Software Engineers, and tech leads on implementing solutions involving end to end data ingestion, storage, and consumption
Qualifications
• Proficiency and experience in programming languages such as Python • Expertise in SQL / RDBMS and NoSQL databases • Extensive experience in design and implementation of data warehousing and data handling processes (ingestion, transformation, modelling, and storage). Experience with MS SQL / SQL Server , Oracle Databases • Expertise in cloud platforms and technologies. Experience with Azure and its products such is a plus. • Expertise in cloud platforms and technologies (Azure, AWS, GCP) is a plus but not required • Experience with streaming platform setup and consumption such as Kafka, Flink • Experience with consumption from other storages for streaming such as S3, Spark • Experience in containers and container orchestration platforms such as Docker and Kubernetes • Experience in CI / CD and Devops, scripting languages such as shell and automation • Experience with software quality and data pipeline testing • ETL concepts and tools. • Preferably a degree in the related fields of Computer Science • Strong problem solving and solutions engineering mindset • Experience in working and coordinating remotely