Remote Lead Engineer, AI Quality

Posted 9 hours ago

Share:

Please let Circle know you found this job on RemoteYeah. This helps us get more companies to post jobs here for you.

Description:

  • Lead the AI Quality engineering team to build evaluation frameworks, observability tooling, and diagnostic infrastructure for AI-powered features.
  • Focus on improving the reliability, efficiency, and scalability of AI systems.

Requirements:

  • 7+ years of experience in production software, particularly with LLM-powered agents.
  • Proficiency in Ruby on Rails and Python, with experience in building evaluation or observability infrastructure for ML/AI systems.
  • Experience in designing datasets and annotation workflows for ML/AI evaluation.
  • Ability to thrive in a fast-paced, dynamic environment and strong alignment with company values.
  • Proficient in English at CEFR Level C2 / ILR Level 5.

Benefits:

  • U.S.-benchmarked compensation globally, equity in the company, and 35 days of paid time off annually.
  • Remote-only work with biannual company retreats and a benefits package supporting health, wellbeing, and professional growth.

Report this job

Job expired or something else is wrong with this job?

Report job
SerpApi

SerpApi

Scrape Google and other search engines from our fast, easy, and complete API.

RemoteYeah Ads