All roles

AI Infrastructure Jobs

63 open positions across the agentic economy

Updated July 12, 2026

Get new AI Infrastructure roles weekly

We track 63 AI Infrastructure positions and send the freshest every Thursday. No spam.

What is an AI Infrastructure?

AI Infrastructure engineers build and operate the platform layer that ML and LLM teams stand on — GPU clusters, training schedulers, distributed file systems, inference gateways, and the cost-attribution systems that let finance trace a $2M monthly bill. The role overlaps SRE and platform engineering but with deep CUDA, NCCL, and PyTorch-distributed knowledge. Hiring concentrates at frontier labs, hyperscalers, and infra startups (Modal, Together, Anyscale, RunPod). Strong candidates have run multi-node training jobs and debugged interconnect bottlenecks in production.

As of July 2026, AgenticCareers tracks 63 open AI Infrastructure positions across 29 companies. The median advertised salary is $200K–$276K per year (based on 17 listings with disclosed pay). 30% of roles are remote. The most active employers are Scale AI, Fireworks AI, Capital One.

Full AI Infrastructure salary data

Role Overview

Top Companies Hiring
Common Skills
AI InfrastructuregreenhousebuiltinMidStaffAI AgentLeadSenior
Remote Availability

30% of positions are remote

Salary Range

$140K – $432K

All AI Infrastructure positions

Lead AI Engineer (Gen AI Platform, Agentic AI & LLM Infrastructure & Orchestration)

Capital OneAI InfrastructureLead

AI Infrastructure

RemoteTodayBuilt In

Principal Product Manager, Agentic AI Infrastructure

DigitalOceanAI InfrastructureStaff

AI Infrastructure

RemoteTodayBuilt In

Senior Director, Agentic AI Infrastructure Engineering

DigitalOceanAI InfrastructureSenior

AI Infrastructure

RemoteTodayBuilt In

Lead AI Engineer (MLX, Agentic AI, Gen AI platform Services)

Capital OneAI InfrastructureLead

AI Infrastructure

RemoteTodayBuilt In

Staff Software Engineer, Conversational and Agentic AI Platform Services

ServiceNowAI InfrastructureStaff

AI Infrastructure

RemoteTodayBuilt In

Senior Lead AI Engineer (GenAI Platform, Agentic Infrastructure)

Capital OneAI InfrastructureSenior

AI Infrastructure

RemoteTodayBuilt In

Senior AI Infrastructure Engineer, LLM/AI Platforms

CrowdStrikeAI InfrastructureSenior

AI Infrastructure

RemoteTodayBuilt In

Principal Data Engineer, LLM/AI Platforms (Remote)

CrowdStrikeAI InfrastructureStaff

AI Infrastructure

RemoteTodayBuilt In

Manager, Strategic Sourcing, AI Infrastructure & Services

DatadogAI InfrastructureLead

AI Infrastructure

RemoteTodayBuilt In

Senior Paid Acquisition Manager - AI Infrastructure & Growth

HiBobAI InfrastructureSenior

AI Infrastructure

RemoteTodayBuilt In

Staff Site Reliability Engineer, Core AI Infrastructure

CoinbaseAI InfrastructureStaff

AI Infrastructure

RemoteTodayBuilt In

Principal Engineer, AI Infrastructure (R4941)

Shield AIAI InfrastructureStaff

AI Infrastructure

RemoteTodayBuilt In

Research Associate, Semiconductors & AI Infrastructure - 26229

EnverusAI InfrastructureJunior

AI Infrastructure

RemoteTodayBuilt In

Product Marketing Manager, AI Infrastructure/Compute

CoreWeaveAI InfrastructureLead

AI Infrastructure

RemoteTodayBuilt In

AI Platform Specialist

Version 1AI InfrastructureMid

AI Infrastructure

Bengaluru, IndiaTodayTop GenAI Jobs

Senior Customer Engineer, Edge LATAM

ArmadaAI InfrastructureSenior

S&M---Pre-Sale · Pre-Sales-Engineering · Customer-Engineering

RemoteTodayHimalayas

AI Engineering Architect

Infosys LimitedAI InfrastructureMid

LLM

BangaloreTodayTop GenAI Jobs

Lead Architect - AI/ML

BirlasoftAI InfrastructureLead

AI Agent · Generative AI

INDIA - PUNE - BIRLASOFT OFFICE - HINJAWADI1d agoTop GenAI Jobs

Lead AI Engineer (MLX, Agentic AI, Gen AI platform Services)

Capital OneAI InfrastructureLead

AI Agent · RAG · Machine Learning

San Jose, CA2d agoWorkday

Software Development Engineer 4

AdobeAI InfrastructureMid

LLM

Bangalore2d agoWorkday

Staff+ Software Engineer, Safeguards ML Infrastructure

AnthropicAI InfrastructureStaff

AI Infrastructure

San Francisco, CA2d agoGreenhouse

Software Engineer | AI Platforms

SingleStoreAI InfrastructureMid

AI Agent

India3d agoTop GenAI Jobs

Software Engineer, Frontier AI Infrastructure

Scale AIAI InfrastructureMid

AI Infrastructure

San Francisco, CA; St. Louis, MO; New York, NY; Washington, DC3d agoGreenhouse

AI Infrastructure Engineer, Model Serving Platform

Scale AIAI InfrastructureMid

AI Infrastructure

San Francisco, CA; New York, NY3d agoGreenhouse

Senior Software Engineer, Full-Stack – Scale GP

Scale AIAI InfrastructureSenior

AI Infrastructure

San Francisco, CA; New York, NY3d agoGreenhouse

Software Engineer (Backend), Enterprise

Scale AIAI InfrastructureMid

AI Infrastructure

Budapest, Hungary3d agoGreenhouse

Software Engineer, Enterprise

Scale AIAI InfrastructureMid

AI Infrastructure

London, UK3d agoGreenhouse

Software Engineer, Enterprise AI

Scale AIAI InfrastructureMid

AI Infrastructure

New York, NY; San Francisco, CA3d agoGreenhouse

Software Engineer, Platform

Scale AIAI InfrastructureMid

AI Infrastructure

London, UK3d agoGreenhouse

Manager I, Engineering - AI Platform - Evaluation & Annotation

DatadogAI InfrastructureLead

AI Infrastructure

Paris, France4d agoGreenhouse

Frequently asked questions

What is an AI Infrastructure?

AI Infrastructure engineers build and operate the platform layer that ML and LLM teams stand on — GPU clusters, training schedulers, distributed file systems, inference gateways, and the cost-attribution systems that let finance trace a $2M monthly bill. The role overlaps SRE and platform engineering but with deep CUDA, NCCL, and PyTorch-distributed knowledge. Hiring concentrates at frontier labs, hyperscalers, and infra startups (Modal, Together, Anyscale, RunPod). Strong candidates have run multi-node training jobs and debugged interconnect bottlenecks in production.

How many AI Infrastructure jobs are available?

As of July 2026, AgenticCareers tracks 63 open AI Infrastructure positions across 29 companies, updated daily.

What is the average AI Infrastructure salary?

The median advertised AI Infrastructure salary is $200K–$276K per year, based on 17 listings with disclosed pay.

Are AI Infrastructure jobs remote?

30% of the AI Infrastructure roles currently tracked on AgenticCareers are remote.

Which companies are hiring AI Infrastructures?

The most active employers hiring AI Infrastructures right now are Scale AI, Fireworks AI, Capital One.

Related articles

All articles

Find your next role in the agentic economy

1,700+ curated AI and agentic jobs from top companies

Get the weekly agentic jobs digest

Curated every Thursday. No spam.

Explore other roles