Please let Qualysoft know you found this job on RemoteYeah. This helps us get more companies to post jobs here for you.
Description:
Establish and maintain automated frontend testing.
Build API and integration test coverage for routers and database flows.
Design and implement E2E tests with Playwright for critical user flows.
Create stable mocking and fixture strategies (MSW, pytest fixtures, predefined test data).
Configure quality gates in CI for linting, unit/integration/E2E tests, code coverage, and reporting.
Extend coverage into non-test UI and workflow areas and prevent regressions.
Build an LLM evaluation discipline with golden datasets and measurable quality gates.
Track reliability of model outputs, detect drift, and condition releases on quality/stability thresholds.
Improve test maintainability, eliminate flakiness, and optimize runtimes.
Requirements:
3+ years in QA automation on production systems.
Strong Python testing skills with pytest.
Strong frontend testing skills.
Experience building and maintaining E2E suites with Playwright/Selenium.
Experience in API testing (REST, schema validation, authentication/error scenarios).
Experience with SQL/PostgreSQL testing and test data management.
Experience with CI/CD pipelines (GitHub Actions, Azure Pipelines or Jenkins).
Practical understanding of testing non-deterministic outputs of LLM models.
A plus: Experience in performance and benchmark testing, WebSocket testing, knowledge of security and dependency scanning, experience in legal-tech, fintech or other regulated domains, familiarity with LLM quality metrics.
Benefits:
Premium medical package.
Lunch Tickets & Pluxee Card.
Bookster subscription.
13th salary/yearly bonuses.
Enterprise job security with a startup mentality and international exposure.
Supportive culture valuing ownership, autonomy, and healthy work-life balance.
Flexible working program and openness to remote work.
Collaborative mindset allowing employees to shape their own benefits and practices.
Diverse opportunities in Software Development with international exposure.
Access to leading learning platforms, courses, and certifications.
Career growth & learning through mentorship programs and professional development opportunities.