Job Description

Salary: $193,300 - 261,500 per year Requirements:

• 5+ years of professional software development experience (excluding internships)
• 5+ years of expertise in at least one software programming language, specifically including C/C++
• 5+ years of experience leading system architecture and design, focusing on reliability, scaling, and design patterns
• 5+ years of experience across the full software development life cycle, including coding standards, code reviews, and build processes
• Proven background as a tech lead, mentor, or engineering team leader
• Strong understanding of Linux, kernels, and low-level performance optimization
• Familiarity with ML Communications frameworks such as NCCL, NIXL, or NVSHMEM is preferred
• A Bachelors degree in Computer Science or a related technical field is preferred
• Experience with embedded systems, high-speed networking, or HPC interconnects is highly valued

• Develop and optimize distributed AI/ML systems and collective operations to scale AI across multiple servers and accelerators
• Write performant, low-level code primarily in C and C++ for EC2 infrastructure
• Collaborate with a multi-disciplinary team of hardware engineers, RTL engineers, scientists, and architects
• Mentor junior and new engineers to foster technical growth within the team
• Design and implement networking solutions specifically for Machine Learning and High-Performance Computing workloads
• Iterate quickly to deliver scalable features for large-scale clusters and cutting-edge AI models

• AI
• AWS
• EC2
• Embedded
• Hardware
• Linux
• Machine Learning
• Cloud
• Support
• Network

More:

Join Annapurna Labs, a specialized division of AWS, where we design the fundamental hardware and software building blocks for the global EC2 infrastructure. Based in Cupertino, CA, our team is at the forefront of the AI/ML revolution, building the systems that power the worlds largest models for premier customers. We offer a fast-paced, international environment that values mentorship, continuous learning, and a healthy work-life balance. Our compensation packages include a competitive base salary ranging from $193,300 to $261,500, sign-on bonuses, and restricted stock units. Additionally, we provide comprehensive benefits such as medical, dental, and vision insurance, 401(k) matching, paid parental leave, and adoption assistance. We are an inclusive, equal opportunity employer committed to providing a supportive workplace for all employees.

last updated 35 week of 2026

Job Tags

Similar Jobs