ScultureAI is a B2B SaaS startup focused on developing innovative coaching solutions to enhance organizational culture using large-language models and advanced AI technologies.
The company aims to improve employee wellbeing and company success, and has been recognized as one of Europe’s hottest startups and a leading UK AI startup.
The Senior AI Engineer will design, build, and optimize complex multi-agent prompt pipelines that directly influence product and customer outcomes.
This role involves creating and scaling evaluation systems to assess and improve the quality, performance, reliability, and cost-efficiency of prompt architectures.
Responsibilities include architecting robust multi-agent pipelines, decomposing complex problems into scalable solutions, and using advanced prompt engineering techniques.
The engineer will maintain a library of evaluation prompts, develop automated evaluation systems, and analyze output quality using statistical techniques.
Collaboration with full-stack engineers and other technical colleagues is essential to design automated systems for evaluating output quality and consistency.
Requirements:
A minimum of 18 months of hands-on experience in LLM prompt engineering, preferably with multi-prompt or agentic architectures.
Proven experience in designing or contributing to LLM evaluation systems for QA, R&D, or production monitoring.
Strong understanding of LLM behavior, capabilities, and potential failure modes.
Proficiency with prompt evaluation tools or libraries such as OpenAI Evals, DeepEval, and LangChain eval.
Familiarity with advanced evaluation metrics and the ability to interpret results effectively.
A Master's degree with distinction in a relevant subject is required.
An appreciation for coaching, behavior change, and organizational culture principles is necessary.
Experience in designing few-shot evaluator prompts and LLM-as-a-judge pipelines is preferred.
Benefits:
The position offers a competitive salary and equity options.
Flexible working hours and a remote-first environment are provided.
Employees have the opportunity to work on groundbreaking AI technology.
A learning and development budget is available to support career growth.
The company fosters a supportive, inclusive team culture where individual contributions have a significant impact.
