
San Francisco, United States $163,800 – $306,000 per year about 3 years ago
AI overview
Software Engineer, Agent Platform at Retool in San Francisco, United States focuses on But most companies don't have the resources to properly invest in these tools, leading to a lot of. AI has changed who gets to build software.
As an AI Engineer, you’ll own model-driven behavior in production systems, working across product, infrastructure, and evaluation layers. Your work will directly shape what users experience—and how confidently the team can ship. You might:
- Own the behavior of AI-powered features across multiple product surfaces, including quality, safety, variance, and failure modes
- Design and evolve prompting, retrieval, routing, and tool-use strategies that embrace non-determinism while bounding its downside
- Build and maintain evaluation systems that measure model performance using statistical signals, distributions, and trends—not just pass/fail tests.
- Detect, diagnose, and resolve non-deterministic failures such as hallucinations, partial correctness, instruction drift, or sensitivity to context changes.
- Define and implement guardrails, fallbacks, and degradation paths that keep systems useful even when models behave unexpectedly.
- Partner with product and infra teams to decide when probabilistic behavior is “good enough” to ship—and when it isn’t.
- Influence model selection, model behavior, and tool design to balance quality, cost, latency, and robustness for real user workflows.
Experience6+ years
SectorTechnology
ContractFull-time
Work typeHybrid
Salary$163,800 – $306,000 per year
Applications0
Postedabout 3 years ago
Category Manager (Technology Sourcing)
Okta · San Francisco, California
Growth - Lifecycle Lead (B2B)
Openai · San Francisco
Head of FinOps & Cloud Billing
IREN · San Francisco, California, United States
Business Operations Manager, AI-Native
IREN · San Francisco, California, United States
Software Engineer, Consumer Health
Openai · San Francisco
People Business Partner, GTM (Post Sales & Sales Development)
Brex · San Francisco, California, United States
Software Engineer, Build Systems / CI
Openai · San Francisco
Protection Scientist Engineer, Integrity
Openai · San Francisco
Software Engineer
Retool · San Francisco, United States
Staff Copywriter
Retool · United States - Remote
Engineering Manager, Enterprise Platform
Retool · San Francisco, United States
Software Engineer, Cloud Platform
Retool · San Francisco, United States
Product Manager, Integration Platform & Partnerships
Retool · San Francisco, United States
Product Security Engineer
Retool · San Francisco, United States
IT Engineer
Retool · San Francisco, United States
Software Engineer, Sandbox & Agent Executor
Retool · San Francisco, United States
UX Research Manager
Retool · San Francisco, United States
Software Engineer, Resources
Retool · San Francisco, United States
Enterprise Account Executive, EMEA
Retool · London, United Kingdom

