Remote Remote Tech Lead Engineer (Web scraping & Anti-bot)

at Infatica.io

Posted 2 days ago 0 applied

Description:

  • Infatica.io is a global provider of proxy and DaaS solutions, building a high-load web scraping platform that allows users to submit any URL and receive clean HTML or structured JSON output.
  • The platform supports both cloud deployment and on-premises deployment in client infrastructure, including Kubernetes.
  • The company is seeking an experienced Tech Lead for their web scraping development team to lead the team, become the technical leader of the platform, drive architectural decisions, and shape the future of the scraping infrastructure.
  • Key responsibilities include architecture design, development leadership, anti-bot research and bypass, and DevOps/SRE tasks.
  • Architecture design involves creating a high-parallel crawler, session management, anti-bot bypass, CAPTCHA solver, API, authorization, billing, quotas, monitoring, and infrastructure using microservices, Docker/K8s, CI/CD, and observability.
  • Development leadership includes team building, establishing development and release processes, and overseeing code quality control and technical decisions.
  • Anti-bot research and bypass tasks involve analyzing browser and network-level fingerprinting and bypassing various protection systems.
  • DevOps/SRE responsibilities include setting up CI/CD, Helm charts, scaling configuration, and organizing monitoring and SLA processes.

Requirements:

  • Candidates must have 5+ years of engineering experience in high-load backend/data platforms.
  • An excellent understanding of HTTP, TLS, HTTP/2, proxies, and browser stack (CDP, WebRTC) is required.
  • Experience with async Python and Go (ideally both), Redis, queues, and message brokers is necessary.
  • Advanced level knowledge of DevOps tools such as Kubernetes, Helm, Prometheus, and CI/CD is essential.
  • Experience analyzing and bypassing bot protection systems is a strong plus.
  • Candidates must be fluent in English, as all documentation and part of the team are English-speaking.
  • Strong decision-making skills, mentoring abilities, and accountability for results are required.

Benefits:

  • The position offers the opportunity to participate in developing the company's key product from scratch.
  • Employees will have high autonomy and influence on architecture and team decisions.
  • A budget for conferences, courses, and work tools is provided.
  • A competitive compensation package is offered.
  • The role includes remote work flexibility.