AI Engineer 4 (Gen AI Platform Services: Agentic AI, Guardrails, Evaluation)
- Location
- New York, NY
- Track
- AI Platform / SRE
- Level
- Senior
- Salary
- $230K–$262K / yr
- Posted
- October 6, 2026
- Source
- Workday
Job description
AI Engineer 4 (Gen AI Platform Services: Agentic AI, Guardrails, Evaluation)
What You’ll Do
- Own the end-to-end architecture for complex AI systems - ensuring maintainability, observability, and ethical alignment
- Define and maintain service-level objectives (SLOs) for AI reliability, including latency, uptime, and model performance drift
- Collaborate with infrastructure engineering to optimize GPU/TPU utilization and accelerate model inference pipelines
- Lead cross-functional technical reviews for new AI system deployments, ensuring security, data governance, and compliance standards are met
- Mentor Principal and Senior Associates on scalable design, performance tuning and research-to-production translation
The Ideal Candidate
- You are deeply Technical. You possess a strong foundation in engineering and mathematics, and your expertise in hardware, software, and AI enables you to see and exploit optimization opportunities that others miss
- You are a resilient trailblazer who can forge new paths to achieve business goals when the route is unknown
Basic
Qualifications
- Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 4 years of experience developing AI and ML algorithms or technologies, or a Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 2 years of experience developing AI and ML algorithms or technologies
- At least 4 years of experience programming with Python, Go, Scala, CUDA, or Java
Preferred
Qualifications
- Experience leading development AI systems with tradeoff decisions around cost, latency, throughput and accuracy
- 6+ years of experience deploying scalable and responsible AI solutions on cloud platforms (e.g. AWS, Google Cloud, Azure, or equivalent private cloud)
- Experience designing, developing, delivering, and supporting AI services
- Proficiency in designing distributed systems for model training, evaluation, and online inference at petabyte scale
- Experience defining AI model governance processes, including producibility, lineage tracking, and automated retaining schedules
- Demonstrated ability to influence architectural decisions across multiple AI product lines or platforms
Cambridge, MA: $197,300 - $225,100 for AI Engineer 4
McLean, VA: $197,300 - $225,100 for AI Engineer 4
New York, NY: $215,200 - $245,600 for AI Engineer 4
San Francisco, CA: $215,200 - $245,600 for AI Engineer 4
San Jose, CA: $215,200 - $245,600 for AI Engineer 4
Skills
- AI Agent
- RAG
- Machine Learning