About this role
Salary: £55,000 - 95,000 per year
Requirements: We require experience in data engineering testing.We require BPSS minimum; SC is not mandated, but there is a strong likelihood it may be required.We require a deep understanding of AWS data pipelines, data warehouse and data lakehouse environments, ETL/ELT processes, data quality concepts, data infrastructure, and related testing methodologies.We require experience building advanced, feature-rich test automation frameworks from scratch using object-oriented and scripted languages.We require breadth of experience across at least two of the following technologies: JavaScript/TypeScript, Java, C#, or Python.We require deep practical knowledge of the object-oriented programming paradigm.We require experience with AWS cloud services, including AWS Glue.We require experience with Python/PySpark.We require experience writing and running SQL queries.We require experience with YAML configuration.We require experience with CI/CD tools such as GitHub Actions or similar.We require knowledge of AI-driven testing solutions and automation accelerators.We require a strong understanding of data feeds architectures and best practices.We require strong problem-solving skills and critical thinking.We require experience with test coverage, defect management, and reporting tools such as JIRA, XRAY, or ADO.We would also value experience with interface/API testing.We would also value experience with non-functional testing.We would also value AWS fundamentals, such as AWS Certified Data Engineer.We would also value experience with HDFS. Responsibilities: We design, develop, and execute automated data tests in line with functional requirements, non-functional requirements, and acceptance criteria.We ensure test data governance and quality control measures are implemented.We validate data quality dimensions.We implement source-to-target reconciliation, schema validation, and transformation testing in ETL/ELT environments.We collaborate with cross-functional teams in a multi-vendor environment to understand business requirements and translate them into technical testing solutions.We translate data mappings, business rules, and transformation logic into automated test scenarios.We develop reusable and maintainable test scripts using approved automation frameworks.We test data feed pipeline migrations repointing from an existing Data Warehouse to a new AWS Data Lakehouse architecture, underpinned with AI ETL accelerators, Python/PySpark, SQL, and YAML configs.We test initial bulk loads and subsequent deltas from legacy to new platforms.We execute automated test suites as part of sprint-based delivery and regression cycles.We identify, document, and track data-related defects with clear evidence and analysis.We work closely with data engineers and analysts to diagnose issues and verify fixes.We support root-cause analysis of data quality failures and pipeline issues.We execute automated tests within CI/CD pipelines and scheduled testing runs.We ensure test assets are version controlled and aligned with delivery processes.We support release activities by validating data readiness and quality gates.We maintain documentation for test cases, test results, and quality metrics.We provide clear status updates and reporting on testing progress and outcomes.We support audit, governance, and compliance requirements related to data quality.We work closely with the wider scrum team, including Data Engineers, Platform Engineers, Product Owners, Business SMEs, and third-party partners, to ensure connected technical testing solutions.We understand and review the implemented unit tests for data processing applications. Technologies: AIAPIAWSAWS GlueC#CI/CDCloudData WarehouseETLGitHubSupportJIRAJavaJavaScriptPythonPySparkSQLTypeScriptNetworkOOP More:
We are NTT DATA, a $30+ billion business and technology services, AI, and digital infrastructure leader that co-innovates solutions with clients and partners globally for business and societal impact. We serve 75% of the Fortune Global 100, operate in over 70 countries, and encourage experimentation while recognizing great work. As a Global Top Employer and part of NTT Group, we invest over $3 billion annually in R&D. We offer tailored benefits that support physical, emotional, and financial wellbeing, continuous learning and development opportunities, and flexible work options. We are committed to equal opportunities, equity, diversity, and inclusion, and we collaborate with individuals with disabilities and long-term health conditions to remove barriers to employment. We are building a truly diverse and empowered team.
last updated 36 week of 2026