J
SR Principal Software Engineer - LLM Engineering
JPMorganChaseLLM EngineerStaff
LLM Engineer
CareersUpdated August 25, 2026
LLM Engineer Jobs
59 open positions across the agentic economy.
01Overview
What is an LLM Engineer?
An LLM Engineer builds production systems on top of large language models: fine-tuning, inference optimization, evaluation harnesses, and serving infrastructure that meets latency and cost SLAs. Unlike Prompt Engineers, LLM Engineers own the runtime stack: tokenizer choices, KV-cache strategies, batched inference on GPU clusters, and the eval pipelines that catch regressions before they ship. The role is most common at AI-native companies (Anthropic, OpenAI, Cohere) and at infrastructure providers (Together, Fireworks, Modal). Strong candidates have a mix of distributed-systems and ML-research experience.
As of August 2026, AgenticCareers tracks 59 open LLM Engineer positions across 22 companies. The median advertised salary is $197K–$225K per year (based on 10 listings with disclosed pay). 14% of roles are remote. The most active employers are NVIDIA, JPMorganChase, Capital One.
Full LLM Engineer salary data02At a glance
Role overview
- Top companies hiring
- Common skills
- LLM EngineerLLMbuiltinlinkedinLeadGenerative AISeniorMid
- Remote availability
- 14% remote
- Salary range
- $75K – $314K
03Open roles
All LLM Engineer positions
A
LLM Model Developer
AccentureLLM EngineerMid
LLM
G
Lead AI Engineer
GenpactLLM EngineerLead
LLM · Generative AI · Machine Learning
J
Principal Software Engineer - LLM Optimization
JPMorganChaseLLM EngineerStaff
LLM Engineer
CO
Senior Lead AI Engineer (FM Hosting, LLM Inference)
Capital OneLLM EngineerLead
LLM Engineer
$230K–$262K / yr
D
Staff Software Engineer - ML Observability
DatadogLLM EngineerStaff
LLM Engineer
SD
Senior NLP/LLM Engineer
Social Discovery GroupLLM EngineerSenior
LLM Engineer
RP
NLP / LLM Engineer
Rubiscape Private LimitedLLM EngineerMid
LLM Engineer
CO
Lead Software Engineer, Full Stack (Python/GO/Java, Typescript, AI/LLM)
Capital OneLLM EngineerLead
LLM Engineer
$179K–$205K / yr
TT
Senior GenAI / LLM Engineer (RAG, MLOps)
Test TriangleLLM EngineerSenior
LLM Engineer
J
Senior Lead Software Engineer - LLM Ops Platform Reliability
JPMorganChaseLLM EngineerLead
LLM Engineer
Z
Associate LLM Engineer
ZSLLM EngineerJunior
LLM Engineer
$75K–$90K / yr
Z
Associate LLM Engineer (Forward Deployment)
ZSLLM EngineerJunior
LLM Engineer
$75K–$90K / yr
O
Senior LLM Engineer (RAG & AWS Bedrock)
OowlishLLM EngineerSenior
LLM Engineer
PS
Generative AI/LLM Engineer
Public StorageLLM EngineerMid
J
AI Engineer - Software Engineer III
JPMorganChaseLLM EngineerMid
LLM Engineer
PR
Sr. Artificial Intelligence Engineer
Plymouth Rock AssuranceLLM EngineerSenior
LLM Engineer
PR
Artificial Intelligence Engineer
Plymouth Rock AssuranceLLM EngineerMid
We are seeking a highly skilled AI Engineer to design and build Generative and Agentic AI systems that transform how our company operates and serves customers. This role focuses on developing AI applications powered by large language models (LLMs), retrieval-augmented generation (RAG), Model Context Protocol (MCP) servers, and Agentic AI across the enterprise for internal and customer facing use cases. The ideal candidate has strong experience with a modern AI/ML stack, including a profound Pyth
GI
AI/LLM Engineer
Gap InternationalLLM EngineerMid
LLM Engineer
CO
Lead AI Engineer (AI Foundations, LLM Customization and Finetuning)
Capital OneLLM EngineerLead
LLM Engineer
$197K–$225K / yr
CO
Lead AI Engineer (FM Hosting, LLM Inference)
Capital OneLLM EngineerLead
LLM Engineer
$197K–$225K / yr
J
Software Engineer III - Java / Transformative AI/LLM
JPMorganChaseLLM EngineerMid
LLM Engineer
J
Senior Lead Software Engineer - Python/AWS/AI/LLM
JPMorganChaseLLM EngineerLead
LLM Engineer
J
Applied AI ML Lead Software Engineer - LLM Suite Engineering
JPMorganChaseLLM EngineerLead
LLM Engineer
J
Applied AI ML Lead Engineer- (NLP/LLM/Graph)
JPMorganChaseLLM EngineerLead
LLM Engineer
C
LLM Engineer (Remote)
CognizantLLM EngineerMid
L
Product Marketing Engineer
LangfuseLLM EngineerMid
LLM Engineer
N
Senior Deep Learning Architect, LLM Inference
NVIDIALLM EngineerSenior
LLM · Generative AI
CO
Lead AI Engineer (AI Foundations, LLM Customization and Finetuning)
Capital OneLLM EngineerLead
LLM Engineer
$197K–$225K / yr
N
AI Computing Software Development Engineer, TensorRT-LLM
NVIDIALLM EngineerMid
AI Agent · LLM · Generative AI
04Common questions
Frequently asked
What is an LLM Engineer?
An LLM Engineer builds production systems on top of large language models: fine-tuning, inference optimization, evaluation harnesses, and serving infrastructure that meets latency and cost SLAs. Unlike Prompt Engineers, LLM Engineers own the runtime stack: tokenizer choices, KV-cache strategies, batched inference on GPU clusters, and the eval pipelines that catch regressions before they ship. The role is most common at AI-native companies (Anthropic, OpenAI, Cohere) and at infrastructure providers (Together, Fireworks, Modal). Strong candidates have a mix of distributed-systems and ML-research experience.
How many LLM Engineer jobs are available?
As of August 2026, AgenticCareers tracks 59 open LLM Engineer positions across 22 companies, updated daily.
What is the average LLM Engineer salary?
The median advertised LLM Engineer salary is $197K–$225K per year, based on 10 listings with disclosed pay.
Are LLM Engineer jobs remote?
14% of the LLM Engineer roles currently tracked on AgenticCareers are remote.
Which companies are hiring LLM Engineers?
The most active employers hiring LLM Engineers right now are NVIDIA, JPMorganChase, Capital One.
05Related reading
All articles Related articles
- Guides
RAG vs. Fine-Tuning: A Decision Framework for 2026
Should you retrieve context at inference time or bake knowledge into the model? This guide provides a concrete decision framework with cost, accuracy, and maintenance trade-offs for each approach.
- Industry
What Is an AI Evaluation Engineer? The 2026 Career Guide
AI Evaluation Engineer went from niche to one of the fastest-growing 2026 specializations because agents in production cannot ship what they cannot measure. Here is the role, the skill stack, and the $180K-$700K compensation range.
- Industry
What Is an LLM Engineer? A 2026 Guide
LLM Engineer, ML Engineer, and AI Engineer get used interchangeably, but they are different jobs with different pay. Here's a clear 2026 breakdown with responsibilities, skills, and salary ranges ($170K-$420K).
Find your next role in the agentic economy
1,700+ curated AI and agentic jobs from top companies
Get the weekly agentic jobs digest
Curated every Thursday. No spam.
06Keep exploring