About this role
The Data Engineer will be responsible for designing, developing, and maintaining scalable and reliable data pipelines on Databricks and cloud platforms. The role requires integrating diverse data sources, ensuring high-quality data processing, and supporting analytics, reporting, and machine learning workloads. The role involves collaborating closely with analytics, product, and infrastructure teams to enhance the company’s data platform while adhering to best practices for governance, monitoring, and reliability.
What will you do?
Develop and maintain ETL pipelines for centralized data storage systems (e.g. Delta Lake).Integrate data from databases, APIs, log files, streaming platforms, and external providersDevelop data transformation routines to clean, normalize, and aggregate dataApply data processing techniques to handle complex or inconsistent datasetsContribute to frameworks and best practices for code development and deploymentImplement data governance in alignment with company standardsPartner with analytics and product leaders to design and operationalize pipelinesCollaborate with infrastructure leaders to advance cloud-based data platformsExplore new tools and techniques leveraging Azure, Databricks, or related platformsMonitor data pipelines to detect and resolve issues promptlyDevelop monitoring tools, alerts, and automated error-handling mechanismsAnalyse business requirements and identify data extraction requirementsAttend requirement grooming and refinement sessions with usersDevelop and maintain ETL pipelines for ingestion, transformation, validation, and loadingOptimise performance and batch schedulingDevelop dashboards, reports, scorecards, and data visualizationsPerform SIT, data validation, data profiling and confirm data accuracyValidate completeness and consistency of ETL LoadsSupport UAT and production implementation
The ideal candidate should possess:
3 or more years of experience in data engineering with scalable pipelinesStrong experience designing data solutions including data modelling and distributed computing architecturesHands-on experience with data processing jobs using PySpark, Spark SQL, and Databricks notebooks/jobsExperience orchestrating data pipelines with ADF, Airflow, or similar toolsExperience with both real-time and batch data processingExperience building pipelines on Azure, with AWS experience beneficialProficiency in SQL including window functions and performance optimizationUnderstanding of DevOps tools, Git workflows, and CI/CD pipelinesFamiliarity with Scrum methodology and experience working in Scrum teamsAbility to apply Scrum practices in a practical project contextStrong problem-solving and collaborative mindsetExperience with streaming technologies such as Apache Kafka, Apache Flink, or AWS KinesisAbility to design and implement real-time data processing pipelinesDatabricks Certified Data Engineer Associate and Databricks Certified Data Engineer Professional are preferred
Why Join NCS
Lead high-impact Data & AI advisory programs for major enterprises and public sector clients.
Shape enterprise strategies and governance frameworks that drive real transformation.
Work with a talented, multidisciplinary team in a collaborative environment.
Competitive compensation and strong professional development support.
We are driven by our AEIOU beliefs—Adventure, Excellence, Integrity, Ownership, and Unity—and we seek individuals who embody these values in both their professional and personal lives. We are committed to our Impact: Valuing our clients, Growing our people, and Creating our future.
Together, we make the extraordinary happen.
Learn more about us at ncs.co and visit our LinkedIn career site.
Scam Alert
We are aware of fraudulent job offers and impersonations of NCS recruiters. Phishing emails using convincing-looking but fake addresses are also commonly used to trick you into thinking that they come from official NCS sources.
Please note that all official communications from NCS Group will only be sent from verified corporate email addresses. Always check that the sender’s email address ends with the genuine NCS domain, @ncs.com.sg and beware of extra letters, symbols or misspellings. When in doubt, verify the sender’s identity by contacting us at [email protected].