Software Engineer, Trust & Safety
- Location
- San Francisco, New York City, United States
- Track
- AI Safety
- Salary
- $208K–$312K / yr
- Posted
- September 12, 2025
- Source
- Greenhouse
Job description
About the role
We are looking for a Software Engineer, Trust & Safety, to design, build, and operate the large-scale, real-time distributed systems that stop abuse and fraud on the platform, including fraud committed through AI agents, fraud that abuses deployments and compute resources, and payment fraud on token-based usage. You will write the services, detection systems, and large language model (LLM) tooling that disrupt abuse at internet scale. This is a hybrid role based in San Francisco or New York City, with three days a week in the office.
What you’ll do
- Design and build production services that detect and disrupt fraud committed through AI agents, fraud that abuses deployments and compute resources, and payment fraud on token-based usage
- Build detection systems that find abuse patterns across large datasets
- Ship LLM-driven systems for abuse detection, classification, and prevention, and build the datasets and evaluation pipelines that measure them
- Build and maintain internal tools for trust and safety workflows
- Analyze threat actor behavior to inform detection logic, and work with security, product, and infrastructure teams to move prototypes into stable production
What you need
- 5+ years of software engineering experience building large-scale, real-time distributed systems
- Wrote and shipped production code in JavaScript/TypeScript and Python, owning systems end to end from prototype through deployment and iteration
- Hands-on LLM experience, including prompt engineering, evaluation, and fine-tuning
- Operated production services on AWS
Bonus if you
- Shipped an AI-based trust and safety system to production
- Worked in abuse prevention, trust and safety, or security engineering
- Built or hosted a project on Vercel
- Flexible Time Off.
The San Francisco, CA base pay range for this role is $208,000 - $312,000. Actual salary will be based on job-related skills, experience, and location. Compensation outside of San Francisco may be adjusted based on employee location. The total compensation package may include benefits, equity-based compensation, and eligibility for a company bonus or variable pay program depending on the role. Your recruiter can share more details during the hiring process.