Senior Software Development Engineer
We're looking for an experienced Senior Software Development Engineer to help build and scale the distributed inference engine that powers Amazon Bedrock. As part of the AWS Mantle team, you will design and deliver critical systems that enable millions of customers to access the world's leading foundation models securely, reliably, and at global scale. This is an opportunity to work on one of the most impactful AI infrastructure platforms at AWS, where your code and design decisions will directly shape how generative AI is served to enterprises worldwide.

Key Responsibilities:
Design, build, and operate high-performance distributed systems that serve ML inference at massive scale across all AWS regions. Own the end-to-end delivery of complex features from requirements through design, implementation, testing, deployment, and production operations. Collaborate with cross-functional teams to solve challenging problems in capacity management, model serving, and API compatibility. Contribute to a culture of engineering excellence by writing clean, maintainable code and driving continuous improvement in system reliability. Influence technical direction within your team while contributing to broader architectural discussions across Mantle and Amazon Bedrock.

Key job responsibilities include designing and implementing core components of Mantle's distributed inference engine, including request routing, load balancing, model lifecycle management, and quality-of-service enforcement. Build and operate services that onboard new foundation models rapidly while maintaining strict performance SLAs and Zero Operator Access (ZOA) security guarantees. Drive operational excellence by owning your team's services in production - monitoring, alarming, incident response, and continuous reliability improvement. Partner with applied scientists, ML engineers, and partner teams to integrate new model architectures and optimize inference performance across GPU/accelerator fleet. Mentor junior and mid-level engineers through code reviews, design reviews, and hands-on guidance that elevates the team's technical capabilities.

The AWS Mantle team is building the next-generation inference engine that powers Amazon Bedrock - providing secure, enterprise-grade access to high-performing foundation models from the world's leading AI companies. Our mission is to simplify and accelerate how models are served at global scale, with an unwavering commitment to customer trust through innovations like our Zero Operator Access architecture, designed so that no person - whether from AWS, a customer, or a model provider - can ever access customer inference data. We operate at massive scale, serving inference requests across all major AWS regions with sophisticated automated capacity management and unified resource pools. Our team values builders who thrive in ambiguity, think long-term, and are excited to define the future of AI infrastructure from the ground up. We foster a collaborative, inclusive environment where diverse perspectives drive better solutions - and where the best ideas win regardless of where they originate. We ship fast and iterate with purpose, having rapidly expanded from launch to supporting models from OpenAI, DeepSeek, Google, Mistral, NVIDIA, and more. We believe work should be meaningful and fun - you'll join a team that takes pride in making history at the forefront of generative AI.