All roles

AI Infrastructure Jobs

43 open positions across the agentic economy

What is an AI Infrastructure?

AI Infrastructure engineers build and operate the platform layer that ML and LLM teams stand on — GPU clusters, training schedulers, distributed file systems, inference gateways, and the cost-attribution systems that let finance trace a $2M monthly bill. The role overlaps SRE and platform engineering but with deep CUDA, NCCL, and PyTorch-distributed knowledge. Hiring concentrates at frontier labs, hyperscalers, and infra startups (Modal, Together, Anyscale, RunPod). Strong candidates have run multi-node training jobs and debugged interconnect bottlenecks in production.

Role Overview

Top Companies Hiring
Common Skills
AI InfrastructuregreenhouseMidLLMbuiltinStaffSeniorRAG
Remote Availability

26% of positions are remote

All AI Infrastructure positions

AI Engineer (MTS)

Micro1AI InfrastructureMid

API Development · AWS · Amazon Web Services

RemoteTodayAI Jobs

Software & AI Platform Engineer

SandiskAI InfrastructureMid

API · Anomaly Detection · C#

Batu Kawan, Penang, MalaysiaTodayAI Jobs

Senior Product Marketing Manager, AI Infrastructure

CoreWeaveAI InfrastructureSenior

AI Infrastructure

RemoteTodayBuilt In

Staff Software Engineer (AI Infrastructure/Python)

NBCUniversalAI InfrastructureStaff

AI Infrastructure

RemoteTodayBuilt In

Director, Cloud Marketplace and AI Infrastructure Partnerships

RunpodAI InfrastructureLead

AI Infrastructure

RemoteTodayBuilt In

Developer Relations Lead, AI Infrastructure and Community

RunpodAI InfrastructureLead

AI Infrastructure

RemoteTodayBuilt In

Staff / Senior Devops Engineer, Data&AI Infrastructure

AirwallexAI InfrastructureSenior

AI Infrastructure

RemoteTodayBuilt In

Staff / Engineering Lead, Data&AI Infrastructure

AirwallexAI InfrastructureStaff

AI Infrastructure

RemoteTodayBuilt In

AI Infrastructure & Reliability Engineer

HiBobAI InfrastructureMid

AI Infrastructure

RemoteTodayBuilt In

Vice President, AI Infrastructure Engineer

BlackRockAI InfrastructureExecutive

AI Infrastructure · Executive

RemoteTodayBuilt In

Member of Technical Staff, Software Engineer

Fireworks AIAI InfrastructureStaff

AI Infrastructure

San Mateo, CA2d agoGreenhouse

Senior AI Infrastructure Engineer - Training Platform

Scale AIAI InfrastructureSenior

AI Infrastructure

San Francisco, CA; Seattle, WA; New York, NY2d agoGreenhouse

Software Engineer, Frontier AI Infrastructure

Scale AIAI InfrastructureMid

AI Infrastructure

San Francisco, CA; St. Louis, MO; New York, NY; Washington, DC2d agoGreenhouse

Senior AI Infrastructure Engineer, Model Serving Platform

Scale AIAI InfrastructureSenior

AI Infrastructure

San Francisco, CA; New York, NY2d agoGreenhouse

Infrastructure Software Engineer, Enterprise GenAI

Scale AIAI InfrastructureMid

AI Infrastructure

San Francisco, CA; New York, NY2d agoGreenhouse

Senior Software Engineer, Full-Stack – Scale GP

Scale AIAI InfrastructureSenior

AI Infrastructure

San Francisco, CA; New York, NY2d agoGreenhouse

Software Engineer, Enterprise AI

Scale AIAI InfrastructureMid

AI Infrastructure

New York, NY; San Francisco, CA2d agoGreenhouse

Staff Software Engineer, Full-Stack - Enterprise Gen AI

Scale AIAI InfrastructureStaff

AI Infrastructure

New York, NY; San Francisco, CA2d agoGreenhouse

Senior LLM Agents Architect

NVIDIAAI InfrastructureSenior

LLM

Israel, Yokneam1w agoWorkday

Senior Lead AI Engineer (Gen AI Platform Services)

Capital OneAI InfrastructureSenior

LLM · RAG · Machine Learning

San Jose, CA1w agoWorkday

AI Infrastructure Specialist - Fully Remote | Upto $130/hr

MercorAI InfrastructureMid
New York, NY1w agoJobSpy

Solutions Architect

Fireworks AIAI InfrastructureMid

AI Infrastructure

New York, NY; San Mateo, CA1w agoGreenhouse

Software Engineer, AI Infrastructure

Fireworks AIAI InfrastructureMid

AI Infrastructure

New York, NY; San Mateo, CA2w agoGreenhouse

Member of Technical Staff, Data Platform Engineer

Fireworks AIAI InfrastructureStaff

AI Infrastructure

San Mateo, CA2w agoGreenhouse

Security Engineer

Fireworks AIAI InfrastructureMid

AI Infrastructure

San Mateo, CA2w agoGreenhouse

Support Engineer

Fireworks AIAI InfrastructureMid

AI Infrastructure

San Mateo, CA2w agoGreenhouse

Technical Developer Advocate

Fireworks AIAI InfrastructureMid

AI Infrastructure

New York, NY; San Mateo, CA2w agoGreenhouse

Staff Software Engineer, Enterprise GenAI

Scale AIAI InfrastructureStaff

AI Infrastructure

San Francisco, CA; New York, NY2w agoGreenhouse

Staff + Sr. Software Engineer, Inference Deployment

AnthropicAI InfrastructureSenior

AI Infrastructure

San Francisco, CA | New York City, NY | Seattle, WA3w agoGreenhouse

LLM Reinforcement Learning Framework Engineer

NVIDIAAI InfrastructureMid

LLM

China, Shanghai1mo agoWorkday

Compiler Engineer - AI Inference

NVIDIAAI InfrastructureMid

AI Infrastructure

US, CA, Santa Clara1mo agoWorkday

Principal Architect, AI Networking

NVIDIAAI InfrastructureStaff

RAG

US, CA, Santa Clara1mo agoWorkday

AI Computing Development Engineer, TensorRT-LLM

NVIDIAAI InfrastructureMid

LLM

China, Shanghai1mo agoWorkday

Senior High-Performance LLM Training Engineer

NVIDIAAI InfrastructureSenior

LLM

US, CA, Santa Clara1mo agoWorkday

ML Infrastructure Engineer, Safeguards

AnthropicAI InfrastructureMid

AI Infrastructure

San Francisco, CA1mo agoGreenhouse

Data Center Engineer, Resource Efficiency – Compute Supply

AnthropicAI InfrastructureMid

AI Infrastructure

Remote-Friendly, United States1mo agoGreenhouse

Software Engineer, Compute Efficiency

AnthropicAI InfrastructureMid

AI Infrastructure

San Francisco, CA | New York City, NY1mo agoGreenhouse

AI Hardware Architect

NVIDIAAI InfrastructureMid

AI Infrastructure

US, CA, Santa Clara2mo agoWorkday

Machine Learning Ops Engineer, Brand Concierge

AdobeAI InfrastructureMid

RAG · Machine Learning

San Jose2mo agoWorkday

AI Inference Performance Engineer

NVIDIAAI InfrastructureMid

LLM · Generative AI

US, CA, Santa Clara2mo agoWorkday

Senior Capability Development Engineer

NVIDIAAI InfrastructureSenior

RAG

China, Shenzhen3mo agoWorkday

Staff Product Designer, AI Platform

VantaAI InfrastructureStaff

AI Infrastructure

Remote U.S.3mo agoAshby

AI Computing Software Development Engineer, TensorRT-LLM

NVIDIAAI InfrastructureMid

LLM

Taiwan, Taipei8mo agoWorkday

Related articles

All articles

Find your next role in the agentic economy

1,700+ curated AI and agentic jobs from top companies

Get the weekly agentic jobs digest

Curated every Thursday. No spam.

Explore other roles