ML Inference Engineer â Terminal-Bench Task Designer (vLLM / SGLang / TensorRT-LLM)
Toptal
- Location
- Anywhere in the World
- Track
- AI Infrastructure
- Posted
- November 5, 2026
- Source
- Remote OK
Job description
Overview We are building a benchmark that tests how well AI agents handle real expert work in a terminal. We are hiring ML inference and serving experts to turn real, paid tasks from their jobs into expert-level Terminal-Bench challenges. Each task includes the environment, a working solution, and an automated check that proves the result is correct. THIS IS A TASK BASED COMPENSATION MODEL. PLEASE CHECK THE APPLICATION QUESTIONS FOR MORE DETAILS. Responsibilities ⢠Design expert-level Te
Skills
- Artificial Intelligence
- Docker
- Git
- Graphics Processing Unit
- LLM