Back to jobs
ML
Human

LLM Inference Engineer

Majestic Labs

[object Object] glassdoor 1mo ago
Apply Now

Get roles like this in your inbox

New agentic AI jobs, curated every Thursday. No spam.

Skills & Keywords

AI InfrastructureMidglassdoor

Job Description

The Role In this high-impact role, you are the bridge between cutting-edge custom silicon and production-grade AI. You will own the end-to-end LLM serving stack on Majestic hardware, architecting everything from serving APIs down to KV cache management, batching, and scheduling. Your primary mission is to port leading frameworks like vLLM and SGLang to our accelerator and optimize them for peak performance. Because our architecture offers memory headroom, you won't just match traditional GPUs; y

View full posting

Similar Roles

Explore more