All roles
CareersUpdated September 5, 2026

LLM Engineer Jobs

57 open positions across the agentic economy.

Get new LLM Engineer roles weekly

We track 57 LLM Engineer positions and send the freshest every Thursday. No spam.

01Overview

What is an LLM Engineer?

An LLM Engineer builds production systems on top of large language models: fine-tuning, inference optimization, evaluation harnesses, and serving infrastructure that meets latency and cost SLAs. Unlike Prompt Engineers, LLM Engineers own the runtime stack: tokenizer choices, KV-cache strategies, batched inference on GPU clusters, and the eval pipelines that catch regressions before they ship. The role is most common at AI-native companies (Anthropic, OpenAI, Cohere) and at infrastructure providers (Together, Fireworks, Modal). Strong candidates have a mix of distributed-systems and ML-research experience.

As of September 2026, AgenticCareers tracks 57 open LLM Engineer positions across 19 companies. The median advertised salary is $197K–$225K per year (based on 15 listings with disclosed pay). 14% of roles are remote. The most active employers are NVIDIA, Capital One, JPMorganChase.

Full LLM Engineer salary data
02At a glance

Role overview

Top companies hiring
NVIDIA18
Capital One10
JPMorganChase6
Langfuse5
Gap International2
Plymouth Rock Assurance2
Common skills
LLM EngineerLLMbuiltinlinkedinLeadSeniorGenerative AIRAG
Remote availability
14% remote
Salary range
$75K – $307K
03Open roles

All LLM Engineer positions

Senior LLM Engineer (3+ years)

Featured
Infocusp InnovationsLLM EngineerSenior

AI Agent · LLM

Ahmedabad/Pune2d agoTop GenAI Jobs

AI Engineer

USTLLM EngineerMid

LLM

BangaloreTodayTop GenAI Jobs

AI Engineer - Software Engineer III

JPMorganChaseLLM EngineerMid

Job Description We have an exciting and rewarding opportunity for you to take your software engineering career to the next level. As an Software Engineer III at JPMorganChase within Enterprise Technology, you will help design and deliver agentic AI platforms and large language model-enabled services for enterprise use cases. You will contribute to architecture decisions, build cloud-native services on AWS, and improve system quality through evaluation and observability. You will help raise e

Jersey City, NJ1d agolinkedin

LLM Specialist

EsimplicityLLM EngineerMid

Description: About Us: eSimplicity is a modern digital services company that partners with government agencies to improve the lives and protect the well-being of all Americans, from veterans and service members to children, families, and seniors. Our engineers, designers, and strategists cut through complexity to create intuitive products and services that equip federal agencies with solutions to courageously transform today for a better tomorrow. Responsibilities: The LLM Specialist

Columbia, MD, US1d agoJobSpy
$105K–$145K / yr

Lead AI Engineer (AI Foundations: LLM Customization, Finetuning, Reinforcement Learning)

Capital OneLLM EngineerLead

LLM Engineer

Remote2d agoBuilt In
$197K–$225K / yr

Senior Lead AI Engineer (LLM Gateway, FM Hosting)

Capital OneLLM EngineerLead

LLM · RAG · Machine Learning

San Jose, CA2d agoWorkday
$230K–$262K / yr

Staff Engineer, AI/LLM Platform

Immunetrics, Inc.LLM EngineerStaff

LLM Engineer

United States2d agoindeed

Lead AI Engineer (AI Foundations: LLM Customization, Finetuning, Reinforcement Learning)

Capital OneLLM EngineerLead

LLM · Machine Learning

New York, NY3d agoWorkday
$197K–$225K / yr

Software Engineer III - LLM Suite Engineering - Senior Associate

JPMorganChaseLLM EngineerSenior

LLM Engineer

London, England, GBR3d agoBuilt In

Staff Software Engineer - ML Observability

DatadogLLM EngineerStaff

LLM Engineer

Boston, Massachusetts, USA; New York, New York, USA3d agoGreenhouse

Senior Technical Program Manager - LLM Safety

NVIDIALLM EngineerLead

LLM · RAG

US, CA, Santa Clara4d agoWorkday

AI/LLM Engineer

Gap InternationalLLM EngineerMid

LLM Engineer

Greater Philadelphia4d agolinkedin

AI/LLM Engineer

Gap InternationalLLM EngineerMid
Remote5d agoJobSpy

Lead AI Engineer (AI Foundations, LLM Customization and Finetuning)

Capital OneLLM EngineerLead

LLM Engineer

New York, NY6d agolinkedin
$197K–$225K / yr

Engineering Manager, LLM Inference & Deployment at Scale

NVIDIALLM EngineerLead

LLM · Generative AI

US, CA, Santa Clara1w agoWorkday

Senior Lead AI Engineer (AI Foundations: LLM Customization, Finetuning, Reinforcement Learning)

Capital OneLLM EngineerLead

LLM Engineer

Remote1w agoBuilt In
$230K–$262K / yr

Senior Software Engineer (SDK)

LangfuseLLM EngineerSenior

LLM Engineer

Europe1w agoAshby
€90K–€160K / yr

SR Principal Software Engineer - LLM Engineering

JPMorganChaseLLM EngineerStaff

LLM Engineer

Remote1w agoBuilt In

Senior AI Engineer – LLM, RAG

BrightAILLM EngineerSenior
Palo Alto, CA1w agoJobSpy

Senior Lead AI Engineer (FM Hosting, LLM Inference)

Capital OneLLM EngineerLead

LLM Engineer

Remote1w agoBuilt In
$230K–$262K / yr

NLP / LLM Engineer

Rubiscape Private LimitedLLM EngineerMid

LLM Engineer

Pune, Maharashtra, IND1w agoBuilt In

Lead Software Engineer, Full Stack (Python/GO/Java, Typescript, AI/LLM)

Capital OneLLM EngineerLead

LLM Engineer

Richmond, Virginia, USA1w agoBuilt In
$179K–$205K / yr

Senior GenAI / LLM Engineer (RAG, MLOps)

Test TriangleLLM EngineerSenior

LLM Engineer

Dublin, Dublin, IRL1w agoBuilt In

Senior Lead Software Engineer - LLM Ops Platform Reliability

JPMorganChaseLLM EngineerLead

LLM Engineer

Remote2w agoBuilt In

Sr. Artificial Intelligence Engineer

Plymouth Rock AssuranceLLM EngineerSenior

LLM Engineer

Greater Boston2w agolinkedin

Artificial Intelligence Engineer

Plymouth Rock AssuranceLLM EngineerMid

We are seeking a highly skilled AI Engineer to design and build Generative and Agentic AI systems that transform how our company operates and serves customers. This role focuses on developing AI applications powered by large language models (LLMs), retrieval-augmented generation (RAG), Model Context Protocol (MCP) servers, and Agentic AI across the enterprise for internal and customer facing use cases. The ideal candidate has strong experience with a modern AI/ML stack, including a profound Pyth

Greater Boston2w agolinkedin

Generative AI/LLM Engineer

Public StorageLLM EngineerMid

Since opening our first self-storage facility in 1972, Public Storage has grown to become the largest owner and operator of self-storage facilities in the world. With thousands of locations across the U.S. and Europe, and more than 170 million net rentable square feet of real estate, we're also one of the largest landlords. We've been recognized as A Great Place to Work by the Great Place to Work Institute. And, our employees have also voted us as having Best Career Growth, r

Frisco, TX2w agolinkedin

Associate LLM Engineer

ZSLLM EngineerJunior

LLM Engineer

Toronto, Ontario, CAN2w agoBuilt In
$75K–$90K / yr

Associate LLM Engineer (Forward Deployment)

ZSLLM EngineerJunior

LLM Engineer

Toronto, Ontario, CAN2w agoBuilt In
$75K–$90K / yr

Lead AI Engineer (AI Foundations, LLM Customization and Finetuning)

Capital OneLLM EngineerLead

LLM Engineer

Remote2w agoBuilt In
$197K–$225K / yr
04Common questions

Frequently asked

What is an LLM Engineer?

An LLM Engineer builds production systems on top of large language models: fine-tuning, inference optimization, evaluation harnesses, and serving infrastructure that meets latency and cost SLAs. Unlike Prompt Engineers, LLM Engineers own the runtime stack: tokenizer choices, KV-cache strategies, batched inference on GPU clusters, and the eval pipelines that catch regressions before they ship. The role is most common at AI-native companies (Anthropic, OpenAI, Cohere) and at infrastructure providers (Together, Fireworks, Modal). Strong candidates have a mix of distributed-systems and ML-research experience.

How many LLM Engineer jobs are available?

As of September 2026, AgenticCareers tracks 57 open LLM Engineer positions across 19 companies, updated daily.

What is the average LLM Engineer salary?

The median advertised LLM Engineer salary is $197K–$225K per year, based on 15 listings with disclosed pay.

Are LLM Engineer jobs remote?

14% of the LLM Engineer roles currently tracked on AgenticCareers are remote.

Which companies are hiring LLM Engineers?

The most active employers hiring LLM Engineers right now are NVIDIA, Capital One, JPMorganChase.

05Related reading
All articles

Related articles

Find your next role in the agentic economy

1,700+ curated AI and agentic jobs from top companies

Get the weekly agentic jobs digest

Curated every Thursday. No spam.

06Keep exploring

Explore other roles

  1. General AI595 positions
  2. AI Infrastructure176 positions
  3. AI Agent Engineer136 positions
  4. ML Engineer134 positions