About this role
We are looking for a passionate and experienced Sr, Software Development Engineer to help us build and scale the next generation of AI runtime infrastructure for Alexa+. You will design and implement model evaluation frameworks and contribute to Tier-1 distributed systems that orchestrate expert agent executions, manage LLM inference pipelines, and ensure reliable, low-latency delivery across Alexa-enabled devices globally. This is a high-impact role where your work directly shapes how millions of customers experience Alexa+ every day.
Key job responsibilities
Design, build, and operate services that power Alexa+ Model evaluations — including test case storage and execution, build processes and model evaluation systems. Contribute to multi-agent coordination systems that route requests to the right expert agents with minimal latency Own the operational excellence of core services, ensuring 99.99%+ availability at scale Collaborate with applied scientists and ML engineers to integrate new AI capabilities into production Drive architectural decisions that balance performance, reliability, and cost efficiency Mentor teammates and raise the engineering bar through code reviews, design reviews, and technical leadership
About the team
The AI Runtime team is the backbone of Alexa+. We own the infrastructure that powers Expert executions — the multi-agent systems that bring Alexa+'s intelligent capabilities to life for hundreds of millions of customers worldwide. Our services orchestrate LLM inference, coordinate expert agents, and deliver responses at massive scale with low latency. When a customer interacts with Alexa+ and it feels magical, our platform made it happen.
Key job responsibilities
Design, build, and operate large-scale services that drive Alexa+ quality flywheel Build multi-tier frameworks that handle millions of requests to measure model accuracy Own the operational excellence of core services, ensuring 99.99%+ availability at scale Collaborate with applied scientists and ML engineers to integrate new AI capabilities into production Drive architectural decisions that balance performance, reliability, and cost efficiency Mentor teammates and raise the engineering bar through code reviews, design reviews, and technical leadership