Agentic AI QA Engineer

Rootly is seeking an AI Quality Engineer to own the evaluation and optimization of our agentic AI features—designing test scenarios, running adversarial prompts, interpreting outputs, and working directly with engineering and product to close the loop on performance.

This role involves thinking like an attacker, a curious user, and a power user across complex incident workflows to probe how our AI agents reason, decide, and handle edge cases.