Machine Learning Compiler Engineer

Job Description

Job Title: Sr. Machine Learning Compiler Engineer – AWS Neuron, Annapurna Labs

As a Senior Machine Learning Compiler Engineer, you will lead the design, development, and scaling of compiler systems for AWS's custom ML chips, collaborate with hardware teams, and contribute to pre-silicon design, product launches, and advanced optimization projects.

Responsibilities:

• Lead architecture and implementation of critical compiler features for AWS Neuron SDK.
• Optimize ML models from frameworks such as PyTorch, TensorFlow, and MXNet for execution on custom AWS hardware.
• Collaborate with AWS ML services teams to integrate compiler improvements into production systems.
• Participate in pre-silicon design activities for future ML hardware;
• Mentor engineers and contribute to team-wide technical growth.
• Publish research and technical innovations in compiler design and ML acceleration.

Qualifications:

• 5+ years of professional software development experience (non-internship).
• 5+ years programming in at least one language;
• 5+ years leading system design or architecture (scaling, reliability, design patterns).
• 5+ years in full software development lifecycle, including code reviews, testing, and operations.
• Proven leadership as mentor, tech lead, or team lead.

Preferred

• Bachelor’s degree in Computer Science or related field.
• Background in Machine Learning or AI accelerators.

Benefits & Work Culture:

• Inclusive team culture with global employee affinity groups.
• Flexible work-life balance and working hours.
• Strong mentorship and career development support;
• Competitive compensation ranging from $151,300 to $261,500/year based on location and experience.
• Equity, sign-on bonuses, and full range of medical, financial, and other benefits.