About this role
Key Accountabilities
- Develop and maintain complex data pipelines and ETL processes in Snowflake.
- Write efficient and optimized SQL queries for data extraction, transformation, and loading.
- Utilize Python for advanced data processing, automation tasks, and integration with other systems.
- Implement and oversee data modelling techniques, including OLTP, OLAP, and Data Vault 2.0 methodologies.
- Collaborate with data architects, analysts, and stakeholders to design optimal and scalable data solutions.
- Manage and optimize CI/CD pipelines using Azure DevOps for seamless deployment of data solutions.
- Ensure data quality, integrity, and compliance throughout the data lifecycle.
- Troubleshoot, optimize, and enhance existing data processes and queries for performance improvements.
- Document data models, processes, and workflows clearly for future reference and knowledge sharing.
- Performance Tuning: Implement advanced techniques for performance tuning methodologies in Snowflake to optimize query performance and reduce data processing time.
- DBT Development: Develop and maintain DBT models, macros, and tests for managing data transformations in Snowflake.
- Version Control Management: Manage version control using Git repositories, enabling seamless code management and collaboration.
- CI/CD Pipeline Development & Automation: Design, implement, and maintain automated CI/CD pipelines using Azure DevOps for Snowflake and DBT deployment processes.
- Impacts the effectiveness of own work team through the quality and timeliness of the work produced.
- Largely works within standardized procedures and practices to achieve objectives and meet deadlines and gains some discretion in problem solving.
Qualifications
- Bachelor's/master's degree in computer science, Information Technology, or a related field.
Experience
- Minimum of 5 years of proven experience as a Snowflake Developer or in a similar data engineering role.
- Extensive hands-on experience with SQL and Python, demonstrating proficiency in data manipulation and analysis.
- Significant industry experience working with DBT (Data Build Tool) for data transformation.
- Strong familiarity with CI/CD pipelines, preferably in Azure DevOps.
- Deep understanding of data modelling techniques ( OLTP, OLAP ) and best practices.
CANDIDATE'S PROFILE
Work Experience
- Minimum of 5 years of proven experience as a Snowflake Developer or in a similar data engineering role.
- Extensive hands-on experience with SQL and Python, demonstrating proficiency in data manipulation and analysis.
- Significant industry experience working with DBT ( Data Build Tool ) for data transformation.
- Strong familiarity with CI/CD pipelines, preferably in Azure DevOps.
- Deep understanding of data modelling techniques (OLTP, OLAP, DBT) and best practices.
Preferred Qualifications
- Experience in working with large datasets and performance tuning in Snowflake.
- Familiarity with data governance, data security best practices, and compliance standards.
- Knowledge of additional data technologies ( e.g., AWS, Azure ) is a plus.
- Experience in leading projects or mentoring junior developers is advantageous.