About this role
AI Engineer at Overtone. Location: New York City, New York, United States. Role: Design prompts, Build evaluation pipelines, Experiment with models Requirements: 5+ years of engineering experience; production experience with LLM-powered products; strong prompt engineering and evaluation instincts; experience building evaluation pipelines; familiarity with vector databases and retrieval-augmented architectures; experience with fine-tuning (SFT, DPO, RLHF); Python, SQLAlchemy, FastAPI, PostgreSQL. Category: Engineering Seniority: Senior Level Tools: Python, SQLAlchemy, FastAPI, PostgreSQL, Langfuse, TensorZero, Promptfoo Commitment: Full Time Workplace: Onsite Languages: English