About this role
Senior AI Agent & Evaluations Engineer at Vacatia. Location: Portland, Oregon, United States. Role: designing prompts, building evaluations, monitoring performance Requirements: Proven experience shipping production AI agents; deep prompt engineering; building evaluation frameworks and golden datasets; familiarity with Claude Code, Codex, LangSmith, Langfuse, Arize, Galileo; strong communication and ownership. Category: Software Development Seniority: Senior Level Tools: Claude Code, Codex, LangSmith, Langfuse, Arize, Galileo, Salesforce, AWS Connect Commitment: Full Time Workplace: Hybrid Languages: English