AI Ops / DevOps Jobs

AI Ops or AIOps engineers run the production lifecycle for ML and LLM systems: CI/CD for models, GPU scheduling, observability, cost monitoring, and on-call response when an inference endpoint starts hallucinating or running 10× over budget. The role overlaps traditional DevOps but adds ML-specific concerns: model versioning, canary deploys for stochastic systems, eval-driven rollbacks, and capacity planning for spiky GPU demand. Hiring is concentrated at AI-first companies and at platform teams inside larger orgs that have hit the operational limits of running models like normal microservices.

As of October 2026, AgenticCareers tracks 63 open AI Ops / DevOps positions across 44 companies. The median advertised salary is $159K–$265K per year (based on 25 listings with disclosed pay). 44% of roles are remote. The most active employers are OpenAI, Arize AI, LangChain.

Full AI Ops / DevOps salary data