Description:

Blueprint is on a mission to empower therapists with world-class tools for exceptional mental health care.
The AI assistant automates administrative tasks for therapists, allowing them to focus on client interactions.
Over 50,000 therapists currently use Blueprint to enhance care for hundreds of thousands of clients.
The organization has a flat structure with a small, talent-dense team that values truth-seeking, creativity, and passion for improving mental health care.
The company operates remotely (US and Canada only) and holds in-person gatherings a few times a year.
The AI/ML Engineer will take ownership of evaluation and quality across AI systems, ensuring reliability and safety.
The role involves designing evaluation infrastructure, defining quality metrics, and collaborating with various teams to ensure consistent delivery of quality.

Requirements:

Candidates must be hands-on ML/AI practitioners with experience in building high-quality systems.
Experience with LLMs in production at scale is required, focusing on making outputs reliable and human-aligned.
Candidates should have built or owned evaluation infrastructure for LLMs or generative AI products.
Experience in designing QA workflows, human-in-the-loop systems, or LLM-as-a-judge pipelines is necessary.
Ability to think in terms of feedback loops and translate product goals into testable quality metrics is essential.
Proficiency in coding, shipping experiments, and working across the stack is required.
Candidates should be excited about collaborating with product, design, and domain experts to define quality in real-world AI applications.
Bonus qualifications include experience in healthcare or mental health, familiarity with labeling and data QA, and a strong perspective on evaluation tools and metrics.

The position offers a competitive salary and equity.
It is a 100% remote role, eliminating commuting.
Health, dental, and vision insurance is provided, with 75% of premiums covered by Blueprint.
Employees can participate in semi-annual team gatherings in Chicago.
The company offers unlimited PTO.
There are opportunities for personal and professional growth within the company and to shape the product.
Employees work with hardworking, mission-driven, and friendly coworkers.