AI Infrastructure Jobs
344 open positions across the agentic economy. Updated October 10, 2026.
All AI Infrastructure positions
Senior Engineer, Data Infrastructure
FlagshippioneeringincCambridgeAI Infrastructure, SeniorPay not listedTodayApplied AIML Lead-Python & Agentic AI
JPMorganChaseRemoteAI Infrastructure, LeadPay not listed1d agoSenior Lead Software Engineer - AI/ML Developer
JPMorganChaseJersey City, New Jersey, USAAI Infrastructure, LeadPay not listed1d agoAI Engineer 5 (FM Hosting, LLM Inference)
Capital OneNew York, NYAI Infrastructure, Senior$230K–$262K1d agoAI Infrastructure Architect
AccentureHyderabad, Telangana, INDAI Infrastructure, StaffPay not listed1d agoAI ML Engineer
HERE TechnologiesMumbai, Maharashtra, INDAI InfrastructurePay not listed1d agoSenior Deep Learning Software Engineer, Inference and Model Optimization
NVIDIAUS, CA, Santa ClaraAI Infrastructure, SeniorPay not listed1d agoProduct Engineer, Developer Platform
NVIDIASanta Clara, CA 95051AI Infrastructure$168K–$270K1d agoSoftware Engineer, Clinical AI Devices
DeepHealthRemote jobAI InfrastructurePay not listed1d agoJunior ML Engineer (LLM Ops & Serving) in AI Foundations
SchibstedOslo, NORAI Infrastructure, JuniorPay not listed2d agoML Data Engineer-5
RealignIrving, TXAI Infrastructure, SeniorPay not listed2d agoML Platform Engineer
BV TeckIselin, NJ, USAI Infrastructure$100K–$160K2d agoSoftware Engineer, Machine Learning Platform - Gen AI
DoorDashSan Francisco, CA, USAI Infrastructure$131K–$192K2d agoAI ML Engineer
HERE TechnologiesMumbai, Maharashtra, INDAI InfrastructurePay not listed2d agoSenior Software Engineer, GenAI Platform
DeliverooLondonAI Infrastructure, SeniorPay not listed2d agoLLM Inference Systems Engineer
Hippocratic AIMenlo Park, California, USAAI InfrastructurePay not listed3d agoEngineering Manager - Inference Performance
BasetenSan FranciscoAI Infrastructure, Lead$240K–$270K3d agoSoftware Engineer III, Generative AI, Core
GoogleSan Jose, CA, USAAI InfrastructurePay not listed3d agoAI Infrastructure Architect
AccentureBengaluru, Karnataka, INDAI InfrastructurePay not listed3d agoSystems Software Engineer, AI and Cloud - New College Grad 2026
NVIDIASanta Clara, CA 95051AI Infrastructure, Junior$108K–$196K3d agoPrincipal Product Applications Engineer
Astera LabsSan Jose, California, USAAI Infrastructure, Staff$207K–$230K3d agoAI Infrastructure Architect
AccentureKolkata, West Bengal, INDAI Infrastructure, StaffPay not listed3d agoSenior Network Engineer
MirantisCampbell, California, USAAI Infrastructure, SeniorPay not listed3d agoAI Infrastructure Architect
AccentureBengaluru, Karnataka, INDAI InfrastructurePay not listed3d agoSenior DL Compiler Engineer - CUDA Tile LPU
NVIDIAAustin, TX, USAI Infrastructure, Senior$152K–$242K3d agoSenior Platform Engineer, Enterprise Products
NVIDIASanta Clara, CA, USAI Infrastructure, Senior$200K–$322K3d agoSenior Java Software Engineer - Search Inference - Platform
ElasticUnited KingdomAI Infrastructure, SeniorPay not listed4d agoSenior Java Software Engineer - Search Inference - Platform
ElasticIrelandAI Infrastructure, SeniorPay not listed4d agoSenior Java Software Engineer - Search Inference - Platform
ElasticSpainAI Infrastructure, SeniorPay not listed4d agoSenior Java Software Engineer - Search Inference - Platform
ElasticGreeceAI Infrastructure, SeniorPay not listed4d agoWhat is an AI Infrastructure engineer?
AI Infrastructure engineers build and operate the platform layer that ML and LLM teams stand on: GPU clusters, training schedulers, distributed file systems, inference gateways, and the cost-attribution systems that let finance trace a $2M monthly bill. The role overlaps SRE and platform engineering but with deep CUDA, NCCL, and PyTorch-distributed knowledge. Hiring concentrates at frontier labs, hyperscalers, and infra startups (Modal, Together, Anyscale, RunPod). Strong candidates have run multi-node training jobs and debugged interconnect bottlenecks in production.
As of October 2026, AgenticCareers tracks 344 open AI Infrastructure positions across 76 companies. The median advertised salary is $220K–$330K per year (based on 167 listings with disclosed pay). 11% of roles are remote. The most active employers are OpenAI, NVIDIA, Databricks.
Role overview
- Top companies hiring
- OpenAI59NVIDIA55Databricks28Anthropic27Together AI19Baseten13
- Common skills
- LLM, Machine Learning, Senior Deep Learning Engineer, AI Agent, RAG, AI, Deep Learning Software Engineer, machine learning
- Remote availability
- 11% remote
- Salary range
- $58K – $555K
Frequently asked
What is an AI Infrastructure engineer?
AI Infrastructure engineers build and operate the platform layer that ML and LLM teams stand on: GPU clusters, training schedulers, distributed file systems, inference gateways, and the cost-attribution systems that let finance trace a $2M monthly bill. The role overlaps SRE and platform engineering but with deep CUDA, NCCL, and PyTorch-distributed knowledge. Hiring concentrates at frontier labs, hyperscalers, and infra startups (Modal, Together, Anyscale, RunPod). Strong candidates have run multi-node training jobs and debugged interconnect bottlenecks in production.
How many AI Infrastructure jobs are available?
As of October 2026, AgenticCareers tracks 344 open AI Infrastructure positions across 76 companies, updated daily.
What is the average AI Infrastructure salary?
The median advertised AI Infrastructure salary is $220K–$330K per year, based on 167 listings with disclosed pay.
Are AI Infrastructure jobs remote?
11% of the AI Infrastructure roles currently tracked on AgenticCareers are remote.
Which companies are hiring AI Infrastructure engineers?
The most active employers hiring AI Infrastructure engineers right now are OpenAI, NVIDIA, Databricks.
Related articlesAll articles
Find your next role in the agentic economy
Curated AI and agentic jobs from top companies, updated daily
Curated every Thursday. No spam.