Remote Senior Quality Engineer, AI

Description:

• Help shape the future of AI at Descript by ensuring the quality and reliability of AI-powered products.
• Build scalable processes for evaluating AI models both quantitatively and qualitatively.
• Collaborate with the AI Research team to create test plans, run experiments, and identify areas for improvement in model behavior.
• Set the gold standard for model quality by creating baselines, benchmarks, and rating systems.
• Organize clear test plans, documentation, and bug reports for team efficiency.
• Utilize internal and external resources to gather data for refining models.
• Serve as the expert for working with third-party service providers to meet quality standards.
• Continuously improve testing tools and methodologies.
• Mentor others and collaborate across teams to ensure seamless integration of components.

Requirements:

• A minimum of 2 years of experience leading the evaluation of AI models.
• At least 2 years of experience as a test lead on a team, product area, or feature.
• A total of 5+ years of QA experience.
• Experience working with AI Research teams is essential.
• Strong ability to collaborate effectively with cross-functional teams and stakeholders.
• A Bachelor’s degree in Computer Science, Engineering, or equivalent relevant experience is required.

Benefits:

• A generous healthcare package is provided to all employees.
• Employees enjoy catered lunches as part of the workplace culture.
• Flexible vacation time is offered to promote work-life balance.
• The company encourages a hybrid work model, allowing remote work while also valuing in-person collaboration when needed.