LLM Engineer Jobs

An LLM Engineer builds production systems on top of large language models: fine-tuning, inference optimization, evaluation harnesses, and serving infrastructure that meets latency and cost SLAs. Unlike Prompt Engineers, LLM Engineers own the runtime stack: tokenizer choices, KV-cache strategies, batched inference on GPU clusters, and the eval pipelines that catch regressions before they ship. The role is most common at AI-native companies (Anthropic, OpenAI, Cohere) and at infrastructure providers (Together, Fireworks, Modal). Strong candidates have a mix of distributed-systems and ML-research experience.

As of October 2026, AgenticCareers tracks 160 open LLM Engineer positions across 113 companies. The median advertised salary is $150K–$213K per year (based on 52 listings with disclosed pay). 24% of roles are remote. The most active employers are Capital One, Accenture, Bright Vision Technologies.

Full LLM Engineer salary data