Human role

Staff + Senior Software Engineer, Inference

Anthropic

Ontario, CAN greenhouse 1d ago
Apply now

The role

Job description

Analyze observability data to tune performance; Build deployment pipelines for model releases; Build real time resilient flexible systems; Design distributed systems for inference; Develop request routing and load balancing; Implement traffic management systems; Integrate new AI accelerator platforms; Manage multi-region deployments and geographic routing; Maximize compute efficiency with autoscaling; Operate production inference infrastructure; Orchestrate production and research workloads; Sup

View full posting

Index terms

Skills & keywords

AWSAutoscalingAzureBatchingCachingCloud infrastructureDeployment PipelinesDistributed SystemsGCPInference OptimizationKubernetesLLM Inference

Get roles like this in your inbox

New agentic AI jobs, curated every Thursday. No spam.

Explore more

All General AI jobs All jobs at Anthropic
AnthropicStaff + Senior Software Engineer, Inference
Apply