Jobs

AI Implementation Engineer

AVISO

Apply on the company site
Location
Fremont, CA, United States
Track
AI Platform / SRE
Level
Staff
Salary
$150K–$170K / yr
Posted
October 21, 2026
Source
Indeed

Job description

Position Overview

We are seeking a Staff IT AI Implementation Engineer to lead the architecture, deployment, and operational oversight of our enterprise AI ecosystem. Sitting at the intersection of hands-on technical execution and strategic governance, this role is pivotal in building production-ready AI solutions, automating cross-functional workflows, and shaping responsible AI adoption standards across the organization.

The ideal candidate thrives on delivering scalable AI integrations while acting as a trusted advisor to help business units understand, deploy, and maximize the value of artificial intelligence securely.

Core Responsibilities

  • AI Platform Administration: Manage enterprise AI platforms (including frontier LLMs like Claude Enterprise and ChatGPT Enterprise), ensuring secure access controls and seamless coordination with IT infrastructure.
  • Workflow Automation & Agent Development: Design, build, deploy, and maintain custom AI agents and automated workflows to solve business challenges while adhering to IT security standards.
  • Cross-Functional Advisory: Serve as the primary point of contact for AI requests across all business units. Partner with stakeholders to assess feasibility, scope technical requirements, and deliver production-ready implementations.
  • Governance & Security Compliance: Collaborate with IT Security and leadership to establish, implement, and enforce AI governance frameworks and acceptable use policies.
  • Vendor & Tool Evaluation: Review and vet emerging AI tools, services, and platform releases alongside IT Security to provide recommendations for adoption or integration.
  • Enablement & Training: Develop cross-departmental guidance, best practices, and training programs to support safe, compliant, and effective AI usage.
  • Performance & Cost Optimization: Track platform usage metrics, monitor cost allocations, and present operational insights and optimization strategies to leadership.
  • Security Reviews: Ensure all agents, MCP servers, integrations, and data connections undergo rigorous IT Security review before deployment, upholding principles of least-privilege access.

Key Qualifications

Experience

3+ years of experience in software engineering, data science, ML engineering, or applied AI (or 2+ years specialized in building production LLM applications).

  • AI Model Integration: 1–3 years of hands-on experience working with frontier AI services, LLMs, or agent development.
  • Agent Architecture: Proven ability to build AI agents utilizing tool/function calling, API integrations, and Model Context Protocol (MCP) frameworks.
  • RAG Pipelines: Technical proficiency in Retrieval-Augmented Generation (RAG) architecture, including embeddings, vector databases, chunking strategies, and retrieval evaluation.
  • LLM Evaluation: Hands-on experience evaluating LLM performance using test sets, LLM-as-judge frameworks, and prompt regression testing.
  • Prompt & Context Engineering: Advanced expertise in production-grade prompt engineering and context optimization.
  • AI Security Standards: Strong knowledge of AI-specific security threats (e.g., prompt injection, data leakage, PII handling) and familiarity with the OWASP Top 10 for LLMs.
  • Deployment & Managed Services: Experience containerizing AI applications, managing self-hosted/served models, and utilizing cloud AI services (e.g., AWS Bedrock, Azure OpenAI/AI Foundry, Google Vertex AI).
  • Governance Frameworks: Familiarity with responsible-AI practices and governance models (such as NIST AI RMF or ISO/IEC 42001).
  • Communication & Collaboration: Demonstrated track record of collaborating across business units and translating complex technical concepts for non-technical stakeholders.

Preferred Qualifications

  • Certifications:

Anthropic Claude Certified Associate / Developer

AWS Certified AI Practitioner or AWS Certified Generative AI Developer

Microsoft Azure AI Fundamentals

CompTIA AI+ or equivalent vendor-neutral credential

  • Frameworks & Orchestration: Experience with agent orchestration tools (e.g., LangChain, LangGraph, AutoGen).
  • Observability: Experience using LLM observability and cost-tracking platforms (e.g., LangSmith).
  • Automation Platforms: Familiarity with workflow automation tools (e.g., Power Automate, n8n, Zapier).
  • Model Customization: Hands-on experience with fine-tuning or local deployment frameworks (e.g., Ollama, OpenWebUI).

Company Culture & Benefits

We foster a collaborative, innovative culture centered on continuous growth, cross-functional mentorship, and transformative technology.

We offer a comprehensive benefits package designed to support full employee well-being, including:

Competitive medical, dental, and vision health coverage

Retirement savings plans with employer matching

Short-term and long-term disability protection

Paid time off, holidays, and parental leave programs

  • Wellness programs and dedicated professional development initiatives

Similar roles

Get roles like this in your inbox

New agentic AI jobs, curated every Thursday. No spam.

Apply on the company site