Remote Senior Applied AI Engineer, Agent Quality & Evaluations

Posted 1 hour ago

Share:

Please let Flodesk know you found this job on RemoteYeah. This helps us get more companies to post jobs here for you.

Description:

  • Flodesk is a rapidly growing email marketing company focused on providing tools for small businesses to grow and monetize their email lists.
  • The Senior Applied AI Engineer will shape AI systems to enhance member experiences by managing AI behavior, creating evaluation criteria, and improving system performance.

Requirements:

  • Proven experience in building or improving production-level LLM or agentic products.
  • Strong software engineering skills in Python, TypeScript, or similar languages.
  • Familiarity with LLM evaluation, observability, and experimental design.
  • Ability to translate member feedback into actionable quality definitions and system changes.
  • Excellent communication skills across technical and non-technical disciplines.
  • Bonus: Experience with content-generation tools, multi-turn agents, and platforms like Langfuse or Braintrust.

Benefits:

  • Competitive salary range of $150,000 - $250,000 based on location and experience.
  • Fully paid health insurance for individual coverage.
  • Generous parental leave policies (16 weeks for non-birthing parents, 22 weeks for birthing parents).
  • Unlimited flexible time off and 401(k) match for US employees.
  • $1,000 annual stipend for learning and development.

Job type

Experience level

Required experience

-

Salary

$150,000—$250,000 / year

Degree requirement

No degree required

Report this job

Job expired or something else is wrong with this job?

Report job
SerpApi

SerpApi

Scrape Google and other search engines from our fast, easy, and complete API.

RemoteYeah Ads