About this role
Join us to shape the future of enterprise AI, where your expertise will help create impactful solutions using cutting-edge technologies. You'll have the opportunity to work hands-on with LLMs, agentic workflows, and advanced AI controls, collaborating with talented teams across the organization. We value your creativity, technical skills, and passion for building secure, production-ready systems. At JPMorganChase, you'll find a supportive environment that encourages growth, learning, and meaningful contributions. Discover how you can make a difference and advance your career with us.
As an AI/ML Engineer - Associate Engineer in our AI Workflow Engineering team, you will design, build, and integrate modern AI solutions that power enterprise innovation. You will work across AI workflows, backend services, and production controls, helping us deliver secure, governed, and reliable AI systems. You'll collaborate with product managers, engineers, and business stakeholders to create impactful solutions. Your role will focus on transforming prototypes into scalable, production-ready applications while fostering a culture of excellence and inclusivity.
Job Responsibilities:
Design, develop, test, and maintain production-quality AI/ML and GenAI solutionsBuild and integrate LLM-powered workflows, including RAG pipelines, agentic workflows, and workflow orchestrationDevelop backend services, APIs, and integrations to automate AI workflowsImplement RAG solutions using embeddings, vector stores, hybrid search, and grounded response generationBuild agentic AI workflows with planning, tool usage, state management, and human-in-the-loop controlsImplement prompt management, versioning, evaluation harnesses, and quality measurement for LLM-based systemsApply AI safety controls such as guardrails, hallucination mitigation, input/output validation, and access controlSupport MLOps / LLMOps practices including CI/CD, automated testing, deployment, monitoring, and lifecycle managementInstrument AI systems for quality, latency, cost, hallucination risk, tool-call failures, and user feedbackCollaborate with product managers, engineers, platform teams, and business stakeholders to deliver secure AI workflow solutions Required Qualifications, Capabilities, and Skills:
Bachelor's or Master's degree in Computer Science, Engineering, Data Science, or equivalent practical experienceHands-on programming experience in Python, Java, C#, or TypeScriptStrong software engineering fundamentals: data structures, APIs, design patterns, testing, version control, CI/CD, and production supportExperience building or integrating GenAI / LLM-based applicationsPractical understanding of RAG architecture, including embeddings, chunking, vector search, retrieval evaluation, and grounded response generationExposure to agentic AI patterns, including tool calling, function calling, workflow orchestration, multi-step reasoning, human approval flows, and state managementExperience building APIs and backend services using REST/gRPC or similar patternsExperience with containerization and deployment practices such as Docker and KubernetesUnderstanding of MLOps / LLMOps, including model/prompt versioning, evaluation, monitoring, release management, and rollbackAbility to write unit tests, integration tests, and automated validation for AI-enabled systemsUnderstanding of AI safety and control patterns, including guardrails, hallucination mitigation, prompt injection risks, and access controls Preferred Qualifications, Capabilities, and Skills:
Experience building production-grade agentic AI workflows or AI automation platformsExperience with MCP, tool registries, function schemas, or enterprise tool integration patternsExperience with vector databases, hybrid search, reranking, knowledge retrieval, or document intelligence systemsExperience building evaluation frameworks for LLM/RAG systems, including golden datasets, LLM-as-judge, retrieval metrics, and regression testingExperience with cloud platforms such as Azure, AWS, or GCPExperience with observability tools for tracing, logging, cost tracking, latency monitoring, and quality dashboardsExperience with MLflow, Kubeflow, LangChain, LlamaIndex, Semantic Kernel, or similar AI orchestration frameworksExperience integrating enterprise productivity platforms such as Microsoft 365 Copilot, Copilot Agents, Microsoft Graph, Teams, Outlook, or Power PlatformExperience working in regulated enterprise environments with security, privacy, audit, and governance requirements
ABOUT US
J.P. Morgan is a global leader in financial services, providing strategic advice and products to the world's most prominent corporations, governments, wealthy individuals and institutional investors. Our first-class business in a first-class way approach to serving clients drives everything we do. We strive to build trusted, long-term partnerships to help our clients achieve their business objectives.
We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants' and employees' religious practices and beliefs, as well as mental health or physical disability needs. Visit our FAQs for more information about requesting an accommodation.
ABOUT THE TEAM
Our professionals in our Corporate Functions cover a diverse range of areas from finance and risk to human resources and marketing. Our corporate teams are an essential part of our company, ensuring that we're setting our businesses, clients, customers and employees up for success.