O
Senior LLM Engineer (RAG & AWS Bedrock)
OowlishLLM EngineerSenior
LLM Engineer
LLM Engineer Jobs
46 open positions across the agentic economy
Updated July 12, 2026
Get new LLM Engineer roles weekly
We track 46 LLM Engineer positions and send the freshest every Thursday. No spam.
What is an LLM Engineer?
An LLM Engineer builds production systems on top of large language models — fine-tuning, inference optimization, evaluation harnesses, and serving infrastructure that meets latency and cost SLAs. Unlike Prompt Engineers, LLM Engineers own the runtime stack: tokenizer choices, KV-cache strategies, batched inference on GPU clusters, and the eval pipelines that catch regressions before they ship. The role is most common at AI-native companies (Anthropic, OpenAI, Cohere) and at infrastructure providers (Together, Fireworks, Modal). Strong candidates have a mix of distributed-systems and ML-research experience.
As of July 2026, AgenticCareers tracks 46 open LLM Engineer positions across 16 companies. The median advertised salary is $197K–$239K per year (based on 11 listings with disclosed pay). 22% of roles are remote. The most active employers are NVIDIA, Langfuse, Capital One.
Full LLM Engineer salary dataRole Overview
Top Companies Hiring
Common Skills
LLMLLM EngineerSeniorbuiltinRAGGenerative AIashbyMachine Learning
Remote Availability
22% of positions are remote
Salary Range
$75K – $314K
All LLM Engineer positions
Z
Associate LLM Engineer
ZSLLM EngineerJunior
LLM Engineer
A
Prompt/LLM Engineer
AvontixLLM EngineerMid
LLM Engineer
A
AI Systems Engineer (LLM & RAG Optimization)
AirbusLLM EngineerMid
LLM Engineer
CO
Senior Lead AI Engineer (LLM Customization and Finetuning)
Capital OneLLM EngineerSenior
LLM Engineer
CO
Lead AI Engineer (FM Hosting, LLM Inference)
Capital OneLLM EngineerLead
LLM Engineer
CO
Senior Lead AI Engineer (LLM Gateway, FM Hosting)
Capital OneLLM EngineerSenior
LLM Engineer
CO
Lead AI Engineer (AI Foundations, LLM Customization and Finetuning)
Capital OneLLM EngineerLead
LLM Engineer
W
LLM Platform Engineer
WhatnotLLM EngineerMid
LLM Engineer
Z
Senior Software Development Engineer-Network, Security, LLM (AI Security)
ZscalerLLM EngineerSenior
LLM Engineer
N
Speech LLM Engineer, Voice-First Agentic AI
NVIDIALLM EngineerMid
AI Agent · LLM
N
AI Engineer
NomiaLLM EngineerMid
LLM · Machine Learning
GH
AI Engineer
Greenway HealthLLM EngineerMid
LLM
VA
Lead AI Engineer
Verisk AnalyticsLLM EngineerLead
LLM
A
GEO Domain Expert
AdobeLLM EngineerMid
LLM
N
Senior Software Engineer – TensorRT Edge-LLM
NVIDIALLM EngineerSenior
LLM · Generative AI
BP
AI Solutions Developer for Cybersecurity
BNP Paribas India SolutionsLLM EngineerMid
LLM · Machine Learning
S
Software Engineering LMTS- AI/LLM
SalesforceLLM EngineerMid
LLM · RAG
D
Staff Software Engineer - ML Observability
DatadogLLM EngineerStaff
LLM Engineer
N
AI Software Engineer
NVIDIALLM EngineerMid
LLM · RAG · Generative AI
S
Staff ML Engineer, Fine Tuning - Slack
SalesforceLLM EngineerStaff
RAG
CO
Senior Lead AI Engineer (FM Hosting, LLM Inference)
Capital OneLLM EngineerSenior
LLM · RAG · Machine Learning
CO
Senior Lead Software Engineer, Full Stack (Go/Java, Angular, AWS)
Capital OneLLM EngineerSenior
LLM · RAG
N
Engineering Manager, LLM Performance
NVIDIALLM EngineerLead
LLM
N
AI Computing Software Development Engineer, LLM Inference
NVIDIALLM EngineerMid
LLM
A
Computer Scientist ( Python )
AdobeLLM EngineerMid
AI Agent · LLM · RAG
N
AI Computing Development Engineer, TensorRT and TensorRT-LLM AIGV
NVIDIALLM EngineerMid
LLM · Generative AI
L
Senior Cloud Infrastructure Engineer
LangfuseLLM EngineerSenior
LLM Engineer
N
Senior LLM Agents Architect
NVIDIALLM EngineerSenior
LLM
N
Applied Deep Learning PhD Research Intern, Reinforcement Learning for LLMs - Fall 2026
NVIDIALLM EngineerIntern
LLM
Frequently asked questions
What is an LLM Engineer?
An LLM Engineer builds production systems on top of large language models — fine-tuning, inference optimization, evaluation harnesses, and serving infrastructure that meets latency and cost SLAs. Unlike Prompt Engineers, LLM Engineers own the runtime stack: tokenizer choices, KV-cache strategies, batched inference on GPU clusters, and the eval pipelines that catch regressions before they ship. The role is most common at AI-native companies (Anthropic, OpenAI, Cohere) and at infrastructure providers (Together, Fireworks, Modal). Strong candidates have a mix of distributed-systems and ML-research experience.
How many LLM Engineer jobs are available?
As of July 2026, AgenticCareers tracks 46 open LLM Engineer positions across 16 companies, updated daily.
What is the average LLM Engineer salary?
The median advertised LLM Engineer salary is $197K–$239K per year, based on 11 listings with disclosed pay.
Are LLM Engineer jobs remote?
22% of the LLM Engineer roles currently tracked on AgenticCareers are remote.
Which companies are hiring LLM Engineers?
The most active employers hiring LLM Engineers right now are NVIDIA, Langfuse, Capital One.
Related articles
All articlesIndustry
What Is an LLM Engineer? (vs ML Engineer vs AI Engineer) — 2026 Guide
LLM Engineer, ML Engineer, and AI Engineer get used interchangeably — but they are different jobs with different pay. Here's a clear 2026 breakdown with responsibilities, skills, and salary ranges ($170K-$420K).
CareersThe Top 10 Interview Questions for LLM Engineer Jobs (And How to Answer Them)
After sitting on both sides of the table for hundreds of LLM engineer interviews, I've seen the same questions come up again and again — and most candidates answer them wrong.
IndustryWhat Is a RAG Engineer? Role, Skills, Salary & How to Become One (2026)
A RAG Engineer builds retrieval pipelines that ground LLMs in source documents. Here's what they do day-to-day, typical salary ($160K-$340K), the skills you need, and how to transition from SWE or ML engineer roles.
Find your next role in the agentic economy
1,700+ curated AI and agentic jobs from top companies
Get the weekly agentic jobs digest
Curated every Thursday. No spam.