Remote QA Engineer (AI Voice)

Posted 2 hours ago

Share:

Please let Lingaro know you found this job on RemoteYeah. This helps us get more companies to post jobs here for you.

Description:

  • Run E2E, API, integration, regression, and release tests on voice journeys across markets and configurations.
  • Prepare test data and expected outcomes, and support business testers during UAT.
  • Run and extend automated suites and evaluation sets designed by the Senior.
  • Log defects with clear reproduction steps and transcripts, and follow them to closure.
  • Flag risks and blockers early.

Requirements:

  • At least 3 years of experience in software QA.
  • At least 1 year of experience in testing voice or conversational AI.
  • Hands-on voice agent testing: speech recognition and speech output basics, intents, latency, reading transcripts.
  • Understanding of varying AI outputs from the same input.
  • API testing and basic automation in Python or JavaScript/TypeScript.
  • Experience with Jira or Azure DevOps and a test management tool.
  • Clear written and verbal communication skills.
  • Familiarity with voice testing platforms (Hamming, Cekura, Coval, Botium) is a plus.
  • Experience with LLM evaluation tools (Promptfoo, DeepEval, LangSmith) is a plus.
  • Knowledge of Telephony basics (SIP, Twilio, Azure Communication Services) is a plus.
  • ISTQB certification is a plus.
  • Experience in Responsible-AI testing (PII, bias, safety) is a plus.
  • Experience validating customer journeys across multiple markets is a plus.
  • English proficiency at least B2.

Benefits:

  • Stable employment with over 1500 talents in 7 global sites since 2008.
  • “Office as an option” model for remote or in-office work.
  • Workation policy for working from inspiring locations.
  • Great Place to Work® certified employer.
  • Flexible working hours and contract options.
  • Comprehensive online onboarding program with a “Buddy” from day 1.
  • Cooperation with top-tier engineers and experts.
  • Unlimited access to the Udemy learning platform from day 1.
  • Certificate training programs with 500+ technology certificates yearly.
  • Upskilling support with 110+ training opportunities yearly.
  • Internal promotion opportunities with 76% of managers promoted from within.
  • A diverse, inclusive, and values-driven community.
  • Autonomy to choose the way you work.
  • Community-building activities with referral bonuses.
  • Well-being and health support activities.
  • Opportunities to donate to charities and support the environment.
  • Modern office equipment provided or available to borrow.

Report this job

Job expired or something else is wrong with this job?

Report job
SerpApi

SerpApi

Scrape Google and other search engines from our fast, easy, and complete API.

RemoteYeah Ads