About this role
Lead QA Engineer (AI & Agentic Systems) at Solstice. Location: New York City, New York, United States. Role: building evals, testing agents, writing tests Requirements: Senior, hands-on QA engineer with strong Python, Playwright, CI/CD and test-infrastructure experience; experience testing ML/LLM/agentic systems, building evaluation systems, manual exploratory testing, and clear communication. Category: Engineering Seniority: Senior Level Tools: Python, Playwright, CI/CD, TypeScript, React, LangChain, LangGraph, LangSmith, Langfuse, Arize Phoenix, Braintrust, RAGAS, Promptfoo, OpenAI Evals, LLM Commitment: Full Time Workplace: Onsite Languages: English