Remote Senior QA and AI Evals Engineer

Posted 1 hour ago

Share:

Please let Ruya AI know you found this job on RemoteYeah. This helps us get more companies to post jobs here for you.

Description:

  • Ruya AI is a defense-tech company developing AI-native software for mission-critical environments.
  • The Senior QA and AI Evals Engineer will ensure the quality of the platform, covering both software behavior and AI outcomes.

Requirements:

  • Strong experience with Playwright and API/integration testing.
  • Familiarity with pytest and TypeScript frameworks like Vitest.
  • Understanding of asynchronous and distributed-system failure modes.
  • Experience evaluating LLM or non-deterministic systems.
  • Ability to design effective test suites rather than maximizing test counts.

Benefits:

  • Competitive salary with potential equity through ESOP and sign-on bonuses.
  • Medical, dental, and vision insurance for employees and dependents.
  • Commuter benefits and relocation assistance.
  • Paid time off and supportive leave-of-absence programs.

Report this job

Job expired or something else is wrong with this job?

Report job
SerpApi

SerpApi

Scrape Google and other search engines from our fast, easy, and complete API.

RemoteYeah Ads