Retool company logo
Full-time
Hybrid

Software Engineer, Agent Platform

Retool
San Francisco, United States $163,800 – $306,000 per year about 3 years ago
AI overview

Software Engineer, Agent Platform at Retool in San Francisco, United States focuses on But most companies don't have the resources to properly invest in these tools, leading to a lot of. AI has changed who gets to build software.

As an AI Engineer, you’ll own model-driven behavior in production systems, working across product, infrastructure, and evaluation layers. Your work will directly shape what users experience—and how confidently the team can ship. You might:

  • Own the behavior of AI-powered features across multiple product surfaces, including quality, safety, variance, and failure modes
  • Design and evolve prompting, retrieval, routing, and tool-use strategies that embrace non-determinism while bounding its downside
  • Build and maintain evaluation systems that measure model performance using statistical signals, distributions, and trends—not just pass/fail tests.
  • Detect, diagnose, and resolve non-deterministic failures such as hallucinations, partial correctness, instruction drift, or sensitivity to context changes.
  • Define and implement guardrails, fallbacks, and degradation paths that keep systems useful even when models behave unexpectedly.
  • Partner with product and infra teams to decide when probabilistic behavior is “good enough” to ship—and when it isn’t.
  • Influence model selection, model behavior, and tool design to balance quality, cost, latency, and robustness for real user workflows.
Experience6+ years
SectorTechnology
ContractFull-time
Work typeHybrid
Salary$163,800 – $306,000 per year
Applications0
Postedabout 3 years ago

Frequently asked questions