Remote AI Engineer, Quality (Evals)

Posted 2 months ago

Description:

Fieldguide is a remote-first company focused on automating assurance and audit work in cybersecurity, privacy, and financial audit.
As an AI Engineer, Quality, you will develop evaluation infrastructure for AI agents, ensuring reliable performance at enterprise scale.

Requirements:

Multiple years of experience in production software for complex systems.
Proficiency in TypeScript, React, Python, and Postgres.
Experience with LLM-powered features, evaluation frameworks, and observability infrastructure.
Ability to operate in ambiguity and take responsibility for outcomes.

Experience level

Skills

Benefits