About this role
Software Engineer, ML Serving at Rime. Location: San Francisco, California, United States. Role: building infrastructure, optimizing models, ensuring reliability Requirements: Hands-on experience with real-time multinode ML serving, distributed model serving, Linux internals, networking, containerization (Docker, Kubernetes), IaC (Terraform, Packer), and on-call/production reliability responsibilities. Category: Software Development Seniority: Mid Level Tools: NVIDIA Dynamo, Triton, vLLM, SGLang, DDP, FSDP, Linux, Docker, Kubernetes, Terraform, Packer, gRPC, WebRTC, WebSockets, Ansible, Chef, Puppet, AWS, GCP, OCI, Hopper, Blackwell Commitment: Full Time Workplace: Hybrid Languages: English