Jobs

AI Engineer 5 (AI Foundations, LLM Core and Agentic AI)

Capital One

Apply on Workday
Location
San Jose, CA
Track
AI Agent Engineer
Level
Staff
Salary
$230K–$262K / yr
Posted
September 18, 2026
Source
Workday

Job description

AI Engineer 5 (AI Foundations, LLM Core and Agentic AI)

What You’ll Do

  • Design, implement and optimize multi-model orchestration pipelines - integrating LLMs, vector search, and domain-specific models into unified systems
  • Establish and lead cost-performance governance reviews across AI systems, tracking GPU utilization, model throughput, and inference cost efficiency
  • Lead team design councils or design review boards to ensure technical consistency and compliance with AI engineering standards
  • Mentor Principal and Manager-level AI engineers, fostering cross-domain learning and elevating organizational technical maturity

The Ideal Candidate

  • You are deeply Technical. You possess a strong foundation in engineering and mathematics, and your expertise in hardware, software, and AI enables you to see and exploit optimization opportunities that others miss
  • You are a resilient trailblazer who can forge new paths to achieve business goals when the route is unknown

Basic

Qualifications

  • Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 6 years of experience developing AI and ML algorithms or technologies, or a Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 4 years of experience developing AI and ML algorithms or technologies
  • At least 6 years of experience programming with Python, Go, Scala, CUDA, or Java

Preferred

Qualifications

  • Experience leading development AI systems with tradeoff decisions around cost, latency, throughput and accuracy
  • 7 years of experience deploying scalable and responsible AI solutions on cloud platforms (e.g. AWS, Google Cloud, Azure, or equivalent private cloud)
  • Experience designing, developing, delivering, and supporting complex AI systems
  • Excellent communication and presentation skills, with the ability to articulate complex AI concepts to peers
  • Experience architecting and integrating heterogeneous AI systems - including rule-based, retrieval-augmented, and generative components - into unified production pipelines
  • Experience defining and enforcing standards for ethical AI deployment, including explainability, fairness, and human-in-the-loop review processes
  • Demonstrated ability to balance model performance and operational cost through dynamic inference strategies and model compression
  • Experience right-sizing models, instance counts, and hardware types given requirements (e.g., context length, token inputs, token outputs)

Cambridge, MA: $229,900 - $262,400 for AI Engineer 5

McLean, VA: $229,900 - $262,400 for AI Engineer 5

New York, NY: $250,800 - $286,200 for AI Engineer 5

San Jose, CA: $250,800 - $286,200 for AI Engineer 5

Skills

  • AI Agent
  • LLM
  • RAG
  • Machine Learning

Similar roles

Get roles like this in your inbox

New agentic AI jobs, curated every Thursday. No spam.

Apply on Workday