Zscaler
Senior Staff AI Engineer
Share this job
Job Description
About the Role
A global lead company applies AI to its own operations first. You will set the technical direction for a model platform used across sales, support, finance and engineering, with direct, measurable cost and quality impact. is an equal opportunity employer. We welcome applicants of all backgrounds and provide reasonable accommodations throughout the hiring process.
IT AI/ML Engineering team is hiring a Senior Staff AI Engineer to serve as technical lead for two engineering groups: one that runs our shared AI platform, and one that delivers AI solutions and support to teams across the company. You will set technical direction, keep delivery on track, and work day to day with engineers and contractors in the US and India.
This is a hands-on leadership role. You will own the architecture and roadmap for platform services such as model gateways and cost controls, AI observability and evaluation, and shared memory and context, along with the AI-powered applications, enterprise AI tool administration and support processes built on top. Deep expertise in model inference or training is not required.
What You'll Do
- Lead the AI platform group. Own architecture, roadmap and delivery for shared services: LLM gateways and model routing, AI cost optimization, observability and evaluation, an internal catalog of agents and skills, and long-term memory and context for AI applications.
- Lead the AI solutions and support group. Own delivery and quality for AI-powered help and search experiences, the rollout and administration of enterprise AI platforms, and the L2 support model, including triage, escalation, runbooks and training workshops.
- Anchor a distributed team. Work with engineers and contractors across the US and India, bridge time zones, run planning and reviews, and make sure context and decisions flow in both directions.
- Plan and prioritize. Turn business requests into a clear priority order, balance capacity across the team, flag risks early, and report status to engineering leadership and stakeholders.
- Stay hands-on. Design and review APIs, services, front-end and back-end code, and CI/CD pipelines; unblock engineers; set standards for code quality, testing and documentation.
- Set the quality bar for AI solutions. Define release gates, regression checks and cost and latency targets using evaluation and observability tooling, and partner with the team that owns models and agents on model selection and tuning.
- Run operations well. Reduce repeat support tickets through automation and better documentation, lead incident response and postmortems, and track platform cost, usage and reliability.
- Partner across the company. Work with business owners in sales, support, finance andengineering, and with Security, Privacy and Legal on data handling, access controls and approvals.
- Grow the team. Mentor engineers, help hire, manage contractor performance, and share best practices through documentation and workshops.What You Bring
Minimum Qualifications
8+ years of software engineering experience, including 3+ years building production applications with LLMs or other ML services; Bachelor's or Master's degree in Computer Science, Engineering or a related field (or equivalent experience).
3+ years as a technical lead or equivalent, leading engineers on shared deliverables, ideally
across time zones and with contractors.
Strong full-stack skills: Python and TypeScript/Node.js (or Java/Go), a modern front-end
framework such as React, and solid API design.
Practical experience with LLM applications: prompt and tool design, retrieval-augmented
generation, agents and function calling or MCP , and gateways or routing layers.
Experience with evaluation and observability for AI systems: test sets, regression suites,
LLM-as-judge, tracing, and cost and latency tracking.
Cloud and DevOps skills: AWS (or GCP/Azure), Docker, Kubernetes and CI/CD, with monitoring, canary and rollback practice.
Experience running or supporting a production service, including on-call, incident response,
runbooks and L2 escalation.
Clear written and verbal communication, with a record of managing priorities and expectations with leaders and business partners.
Preferred Qualifications
Experience administering enterprise AI platforms and vendor accounts (such as Claude, OpenAI, Amazon Bedrock or Vertex), including usage controls and cost governance.
Experience with vector and graph databases, and with agent memory and context management.
Experience building search or help experiences, Slack bots and web widgets integrated with AI services.
Familiarity with model inference, fine-tuning and open-weight models; helpful but not required.
Experience running enablement: workshops, documentation and internal training for AI tools.
Experience in regulated environments such as FedRAMP.
Team, Location and Compensation
Team. You will join IT AI/ML Engineering team and lead two of its groups, working closely with the group that builds agents and models. Day to day you will use Python, TypeScript, AWS, Kubernetes, LLM gateways and evaluation tooling.
Location. Hybrid, three days per week in San Jose, CA or Bellevue, WA; remote within the US considered for exceptional candidates.
Pay: $107,000.00 - $130,000.00 per year
Benefits
- 401(k)
- Dental insurance
- Flexible schedule
- Retirement plan
Work Location: Hybrid remote in San Jose, CA 95139
Keep looking
Similar Remote Jobs That Pay Well
Premier Global Links
Staff Applied AI Engineer
DoubleVerify
Senior AI Engineer
Premera Blue Cross
AI Engineer IV
THIRD