T
AI Architect
TtecAI InfrastructureMid
AI Governance · AI Services · API Integration
CareersUpdated August 25, 2026
AI Infrastructure Jobs
195 open positions across the agentic economy.
01Overview
What is an AI Infrastructure engineer?
AI Infrastructure engineers build and operate the platform layer that ML and LLM teams stand on: GPU clusters, training schedulers, distributed file systems, inference gateways, and the cost-attribution systems that let finance trace a $2M monthly bill. The role overlaps SRE and platform engineering but with deep CUDA, NCCL, and PyTorch-distributed knowledge. Hiring concentrates at frontier labs, hyperscalers, and infra startups (Modal, Together, Anyscale, RunPod). Strong candidates have run multi-node training jobs and debugged interconnect bottlenecks in production.
As of August 2026, AgenticCareers tracks 195 open AI Infrastructure positions across 35 companies. The median advertised salary is $200K–$273K per year (based on 27 listings with disclosed pay). 7% of roles are remote. The most active employers are Databricks, Drata, Scale AI.
Full AI Infrastructure salary data02At a glance
Role overview
- Top companies hiring
- Common skills
- AI InfrastructuregreenhouseStaffSeniorMidashbyLeadindeed
- Remote availability
- 7% remote
- Salary range
- $102K – $340K
03Open roles
All AI Infrastructure positions
T
AI Infrastructure Engineer - Recommendation & LLM
TiktokAI InfrastructureMid
Algorithms · C++ · CUDA
CO
Senior Lead AI Engineer (GenAI Platform, Agentic Infrastructure)
Capital OneAI InfrastructureLead
AI Infrastructure
$230K–$262K / yr
E
Principal AI Ecosystem Architect - OpenAI/Anthropic
ElasticAI InfrastructureStaff
AI Infrastructure
E
Principal AI Ecosystem Architect - OpenAI/Anthropic
ElasticAI InfrastructureStaff
AI Infrastructure
SA
AI Infrastructure Engineer, Sandbox Platform
Scale AIAI InfrastructureMid
AI Infrastructure
SI
AI Platform Operations Manager
STACK Infrastructure USAI InfrastructureLead
THE COMPANY: STACK INFRASTRUCTURE (STACK) provides digital infrastructure to scale the world’s most innovative companies. We are an award-winning industry leader in building, owning, and operating highly efficient, cost-effective wholesale, colocation, and cloud data centers. Each of our national facilities meets or exceeds the highest industry standards in all operational categories of availability, security, connectivity, and physical resilience. STACK offers the scale and geographic rea
$128K–$146K / yr
J
Lead Software Engineer - AI Application
JPMorganChaseAI InfrastructureLead
AI Infrastructure
$157K–$215K / yr
N
Senior Software Engineer, Fleet Intelligence Backend
NVIDIAAI InfrastructureSenior
AI Infrastructure
$152K–$288K / yr
N
Senior Software Engineer, Fleet Intelligence Agent Systems
NVIDIAAI InfrastructureSenior
AI Infrastructure
$152K–$288K / yr
N
Senior Deep Learning Software Engineer, DLSim
NVIDIAAI InfrastructureSenior
AI Infrastructure
$152K–$288K / yr
D
Senior Software Engineer- Singapore
DatabricksAI InfrastructureSenior
AI Infrastructure
D
Sr Director, Enterprise Data and AI Platform
DayforceAI InfrastructureExecutive
AI Infrastructure · Executive
$175K–$273K / yr
CO
Senior Manager, AI Engineering (People Leader) (Gen AI Platform Services)
Capital OneAI InfrastructureLead
RAG · Machine Learning
$251K–$286K / yr
C
Staff Applied AI Inference Engineer
CRUSOEAI InfrastructureStaff
AI Infrastructure
$185K–$225K / yr
VI
AI Platform Lead
Visionist, INCAI InfrastructureLead
AI Infrastructure
$170K–$240K / yr
Q
Principal Product Manager, Core AI Platform
QualtricsAI InfrastructureLead
AI Infrastructure
$200K–$262K / yr
D
Manager I, Engineering - AI Platform - Evaluation & Annotation
DatadogAI InfrastructureLead
AI Infrastructure
D
Manager I, Engineering - AI Platform - Training & Serving
DatadogAI InfrastructureLead
AI Infrastructure
D
Manager, Strategic Sourcing, AI Infrastructure & Services
DatadogAI InfrastructureLead
AI Infrastructure
CA
Sr Software Engineer
Cox AutomotiveAI InfrastructureSenior
AI Infrastructure
$102K–$169K / yr
TL
AI Engineer
Tessera LabsAI InfrastructureMid
About Tessera Labs Tessera Labs is a new category of enterprise software: an AI platform that changes how the world's largest companies run. Every large enterprise carries the same weight — decades of accumulated process, data, and code that no longer match the business it has become. Changing any of it is a program measured in years and hundreds of millions of dollars, staffed by armies of consultants, and it fails more often than anyone admits. Most companies have quietly accepted this as
$200K–$250K / yr
TL
AI Engineer
Tessera LabsAI InfrastructureMid
About Tessera Labs Tessera Labs is a new category of enterprise software: an AI platform that changes how the world's largest companies run. Every large enterprise carries the same weight — decades of accumulated process, data, and code that no longer match the business it has become. Changing any of it is a program measured in years and hundreds of millions of dollars, staffed by armies of consultants, and it fails more often than anyone admits. Most companies have quietly accepted this as
$200K–$250K / yr
D
Senior Software Engineer (App-Framework)
DatabricksAI InfrastructureSenior
AI Infrastructure
D
Senior Software Engineer - Data + AI Observability
DatabricksAI InfrastructureSenior
AI Infrastructure
D
Senior Software Engineer (Data Platform)
DatabricksAI InfrastructureSenior
AI Infrastructure
D
Senior Software Engineer (Money)
DatabricksAI InfrastructureSenior
AI Infrastructure
D
Senior Software Engineer - Multi Cloud Efficiency
DatabricksAI InfrastructureSenior
AI Infrastructure
D
Senior Software Engineer - Observability
DatabricksAI InfrastructureSenior
AI Infrastructure
A
AI Infrastructure Operations, Demand Planning
AnthropicAI InfrastructureMid
AI Infrastructure
04Common questions
Frequently asked
What is an AI Infrastructure engineer?
AI Infrastructure engineers build and operate the platform layer that ML and LLM teams stand on: GPU clusters, training schedulers, distributed file systems, inference gateways, and the cost-attribution systems that let finance trace a $2M monthly bill. The role overlaps SRE and platform engineering but with deep CUDA, NCCL, and PyTorch-distributed knowledge. Hiring concentrates at frontier labs, hyperscalers, and infra startups (Modal, Together, Anyscale, RunPod). Strong candidates have run multi-node training jobs and debugged interconnect bottlenecks in production.
How many AI Infrastructure jobs are available?
As of August 2026, AgenticCareers tracks 195 open AI Infrastructure positions across 35 companies, updated daily.
What is the average AI Infrastructure salary?
The median advertised AI Infrastructure salary is $200K–$273K per year, based on 27 listings with disclosed pay.
Are AI Infrastructure jobs remote?
7% of the AI Infrastructure roles currently tracked on AgenticCareers are remote.
Which companies are hiring AI Infrastructure engineers?
The most active employers hiring AI Infrastructure engineers right now are Databricks, Drata, Scale AI.
05Related reading
All articles Related articles
- Careers
AI Infrastructure Engineer: The Agentic Economy Backbone
AI infrastructure engineers build the GPU clusters, optimize inference pipelines, and keep model serving running at scale. Here is what the role looks like, what it pays, and how to get hired.
- Guides
The AI Agent Observability Stack: 5 Platforms Compared
You cannot improve what you cannot measure. This guide compares the five leading AI agent observability platforms across tracing, evaluation, cost tracking, and production monitoring for 2026.
- Industry
The Real Cost of Running AI Agents in Production
A single production AI agent costs $3,200-$18,000 per month to operate depending on complexity and volume. Here is where every dollar goes: LLM APIs, infrastructure, monitoring, and the hidden costs no one talks about.
Find your next role in the agentic economy
1,700+ curated AI and agentic jobs from top companies
Get the weekly agentic jobs digest
Curated every Thursday. No spam.
06Keep exploring