LLM Applications Engineer — Build & Evaluate AI Workflows

Xist4 IT Limited is seeking an LLM Application Engineer to own the behaviour, prompts, and evaluation between LLMs and users in a fully remote UK role. You’ll build and ship production-grade Python AI applications, integrating tools, APIs, databases and retrieval systems while managing multi-step workflows.

In this role you’ll own datasets and evaluation frameworks to measure quality, reliability and regressions, with a focus on latency, cost and observability.