About this role
Salary: £100,000 - 100,000 per year
Requirements: Hands-on experience with system design, application development, testing, and operational stability in production environmentsAdvanced proficiency in Python for building production-grade services and toolingProficiency with automation and continuous delivery methodsHands-on experience with cloud infrastructure platforms and infrastructure-as-code tooling for delivery and lifecycle managementStrong understanding of site reliability engineering practices, including incident management, root-cause analysis, runbooks, and reliability patternsPractical knowledge of observability and instrumentation across metrics, logs, and tracesHands-on experience with Kubernetes and container-based orchestration platforms, including managed cloud variantsExperience hosting and serving large language models on cloud-based infrastructure and local GPU environmentsKnowledge of large language model reliability and risk considerations, including latency and throughput trade-offs, model versioning, prompt and response logging, and safe rollout patternsHands-on experience using enterprise-authorized AI-assisted software development tools within the work environment, with demonstrated ability to critically evaluate, validate, and refine AI-generated outputs for correctness, performance, and securityUnderstanding of responsible AI use in engineering workflows, including data sensitivity considerations, secure handling of inputs/outputs, and adherence to resiliency and security expectations; ability to guide peers on safe and effective usage within team practices Responsibilities: Design, develop, troubleshoot, and deliver secure, high-quality production software and services for AI infrastructureBuild backend services and APIs that enable reliable operation of AI infrastructure in production environmentsOperate and scale large language model serving infrastructure, including model hosting, request routing, continuous batching, and cache optimizationDeploy, host, and lifecycle-manage open-source and proprietary large language models on cloud-based container orchestration platforms and on-premises GPU clusters using reproducible infrastructure as code and continuous delivery pipelinesImplement observability across logs, metrics, and traces with dashboards and actionable alerting for large language model and GPU workloadsTune GPU and accelerator capacity, autoscaling, and cost efficiency for large language model inference workloads using performance optimization techniques such as quantization, parallelism, and speculative decodingLead reliability engineering for large language model endpoints through capacity planning, load and soak testing, safe rollouts, failover, and incident response for outages and model-quality regressionsParticipate in on-call rotations, lead incident triage and mitigation, and produce clear post-incident root-cause analyses and follow-up actionsIdentify recurring operational issues and automate remediation to improve platform stability and developer experienceBuild and maintain multi-agent systems with strong orchestration, including planning, coordination, tool-calling, state and memory management, and workflow control where appropriateDrive team adoption of enterprise-authorized AI-assisted engineering practices to improve code quality, delivery speed, and operational outcomes, while establishing consistent validation standards and promoting reuse of effective patterns across the team Technologies: AIBackendCloudIncident ManagementKubernetesMachine LearningMarketingModel ServingPythonSecurityAI AgentsSupportLLMvLLM More:
hackajob is partnering directly with JPMorganChase to hire for this role. As a Senior Lead Software Engineer on the AI and Machine Learning Platform team, we build and scale AI infrastructure that modernizes traditional infrastructure management and site reliability engineering through applied AI. This role focuses on reliability, performance, and cost-efficiency for large language model inference platforms, with hands-on work in cloud and Kubernetes-based deployments, observability, and production operations. We are a global leader in financial services with a first-class business in a first-class way approach, and we value diversity, inclusion, and reasonable accommodations. Our Corporate Functions team supports the business across finance, risk, human resources, and marketing, helping set our businesses, clients, customers, and employees up for success.
last updated 35 week of 2026