About this role
Surgo Health is building the Behavioral Intelligence layer for healthcare — revealing why people behave as they do, predicting what they will do next, and helping organizations make the decisions that change outcomes. A Public Benefit Corporation grounded in two decades of global health experience, Surgo generates foundational behavioral data that reveals the unseen why and builds the AI products that power decision-grade insights at population scale — equipping healthcare organizations, funders, and public agencies to act on what actually shapes health outcomes: people's beliefs, motivations, and barriers. Backed by 40+ peer-reviewed publications and trusted by partners including the Gates Foundation, J&J, Takeda, Pivotal Ventures, and the Clinton Health Access Initiative, Surgo is building a future where healthcare organizations don't just understand human behavior, but anticipate it.
- Role Summary: We are looking for a Data Engineer to join the R&D Engineering team building Derin, our AI-powered interview platform.
- Derin runs conversational, LLM-led interviews over WhatsApp/SMS, web and voice, and turns thousands of conversations into structured data that our scientists and clients use to ultimately improve patients’ outcomes.
- You will own the data layer behind all of this: the pipelines that move interview data from our application into our Databricks lakehouse, the models that make it analysis-ready, and the serving layer (Postgres/Lakebase) that our product reads from in real time.
- You will work side by side with backend engineers, data scientists and product managers, in a small team where your work reaches clients quickly.
- Work AI-first: use AI agents (Claude Code, Cursor and others) throughout your day to design, build, debug and optimize, and help the team keep raising the bar on AI-assisted engineering Own the Databricks data platform behind Derin, from ingestion of interview and survey data to the analytics-ready tables our product, scientists and clients rely on Design and build reliable batch and incremental pipelines on Databricks (Lakeflow Spark Declarative Pipelines, formerly Delta Live Tables; Jobs; Delta Lake) and govern them in Unity Catalog Help move our production data layer to Databricks Lakebase (managed Postgres), including synced tables, migration and cutover, and keep the serving layer fast for our APIs Model survey and conversation data in Delta Lake so it is easy to access for downstream analytics products Make pipelines observable and trustworthy: data-quality checks (such as Lakeflow expectations), tests, Unity Catalog lineage, monitoring and alerting Turn scientists' Databricks notebooks and analyses into production-grade, reusable pipelines Build privacy and security into how we handle sensitive participant data, using Unity Catalog access controls, row filters and column masks, in a SOC2 and HIPAA-compliant environment Use infrastructure as code (Terraform, Databricks Asset Bundles) and CI/CD to deploy data workloads across environments Contribute to shaping our engineering culture and data platform as we grow