About this role
Data Quality Engineer – Azure Data Platform Testing
Overview
Seeking a seasoned Azure Data Engineer Tester to drive test strategy and ensure data quality across a large-scale Azure data platform modernization initiative. Data is a critical enterprise asset, and this role ensures accurate ingestion, transformation, storage, and reporting across cloud-based data solutions. The ideal candidate has test lead experience, strong automation skills, Agile exposure, and familiarity with P&C insurance domains.
Key Responsibilities
Test Strategy & Leadership
• Drive overall test strategy and create effective test cases and scenarios based on business and user requirements • Define and implement test automation strategy, ensuring the right balance of manual and automated testing • Participate in architecture, design, requirements, and code reviews; provide feedback to stakeholders
Azure Data Pipeline Testing
• Test Azure data pipelines built using services such as Microsoft Azure, Azure Data Factory, and Azure Synapse Analytics • Validate end-to-end data movement from source to destination across batch and streaming workflows
Ensure Data Quality & Accuracy
• Validate ETL/ELT transformations across Medallion architecture layers • Identify missing, duplicate, or incorrect data and ensure business rules are applied accurately • Validate analytical outputs such as dashboards, reports, and data visualizations
Database & Storage Validation
• Test data stored in Azure SQL Database and Azure Data Lake Storage for integrity, reliability, and performance • Validate schema, source-to-target mappings, and data models
Automation & Performance Testing
• Develop automated test scripts using SQL, Python, and PySpark • Perform performance, scalability, and load testing of pipelines and data platforms • Track defects and test cycles using Jira
Desired Skills & Competencies
Data & Technical Acumen
• Strong understanding of data warehousing concepts, star schemas, data marts, and Medallion architecture • Ability to read data models and update source-to-target mapping documents • Hands-on experience with Snowflake, Azure, DBT, Python, and PySpark
Industry & Methodology
• Experience working in Agile environments • Knowledge of Property & Casualty (P&C) and Specialty Insurance is preferred
Key Responsibilities
Test Strategy & Leadership
• Drive overall test strategy and create effective test cases and scenarios based on business and user requirements • Define and implement test automation strategy, ensuring the right balance of manual and automated testing • Participate in architecture, design, requirements, and code reviews; provide feedback to stakeholders
Azure Data Pipeline Testing
• Test Azure data pipelines built using services such as Microsoft Azure, Azure Data Factory, and Azure Synapse Analytics • Validate end-to-end data movement from source to destination across batch and streaming workflows
Ensure Data Quality & Accuracy
• Validate ETL/ELT transformations across Medallion architecture layers • Identify missing, duplicate, or incorrect data and ensure business rules are applied accurately • Validate analytical outputs such as dashboards, reports, and data visualizations
Database & Storage Validation
• Test data stored in Azure SQL Database and Azure Data Lake Storage for integrity, reliability, and performance • Validate schema, source-to-target mappings, and data models
Automation & Performance Testing
• Develop automated test scripts using SQL, Python, and PySpark • Perform performance, scalability, and load testing of pipelines and data platforms • Track defects and test cycles using Jira
Bachelors Degree