AI Engineer 5

AI Engineer 5

What You’ll Do

• Design, develop, test, deploy, and support AI software components including foundation model training, large language model inference, agents and multi-agent workflows, similarity search, guardrails, model evaluation, experimentation, governance, and observability, etc.
• Leverage a broad stack of Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, PyTorch, and more.
• Invent and introduce state-of-the-art foundation model optimization techniques to improve the performance — scalability, cost, latency, throughput — of large scale production AI systems.
• Design, implement and optimize multi-model orchestration pipelines - integrating LLMs, vector search, and domain-specific models into unified systems
• Establish and lead cost-performance governance reviews across AI systems, tracking GPU utilization, model throughput, and inference cost efficiency
• Lead team design councils or design review boards to ensure technical consistency and compliance with AI engineering standards
• Mentor Principal and Manager-level AI engineers, fostering cross-domain learning and elevating organizational technical maturity

The Ideal Candidate

• Passion for staying abreast of the latest research, and an ability to intuitively understand scientific publications and judiciously apply novel techniques in production
• You are deeply Technical. You possess a strong foundation in engineering and mathematics, and your expertise in hardware, software, and AI enables you to see and exploit optimization opportunities that others miss
• You are a resilient trailblazer who can forge new paths to achieve business goals when the route is unknown

Basic

Qualifications

• Bachelor's Degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 6 years of experience developing AI and ML algorithms or technologies, or a Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 4 years of experience developing AI and ML algorithms or technologies
• At least 6 years of experience programming with Python, Go, Scala, CUDA, or Java

Preferred

Qualifications

• Experience leading development AI systems with tradeoff decisions around cost, latency, throughput and accuracy
• 7+ years of experience deploying scalable and responsible AI solutions on cloud platforms (e.g. AWS, Google Cloud, Azure, or equivalent private cloud)
• Experience designing, developing, delivering, and supporting complex AI systems
• Experience developing AI and ML algorithms or technologies (e.g. LLM Inference, Similarity Search and VectorDBs, Guardrails, Memory) using Python, C++, C#, Java, CUDA, or Golang
• Experience developing and applying state-of-the-art techniques for optimizing training and inference software to improve hardware utilization, latency, throughput, and cost
• Experience in building agentic AI systems and agentic workflows
• Excellent communication and presentation skills, with the ability to articulate complex AI concepts to peers
• Experience architecting and integrating heterogeneous AI systems - including rule-based, retrieval-augmented, and generative components - into unified production pipelines
• Experience defining and enforcing standards for ethical AI deployment, including explainability, fairness, and human-in-the-loop review processes
• Demonstrated ability to balance model performance and operational cost through dynamic inference strategies and model compression
• Experience right-sizing models, instance counts, and hardware types given requirements (e.g., context length, token inputs, token outputs)

Cambridge, MA: $229,900 - $262,400 for AI Engineer 5

New York, NY: $250,800 - $286,200 for AI Engineer 5

San Jose, CA: $250,800 - $286,200 for AI Engineer 5