Remote Remote Tech Lead Engineer (Web scraping & Anti-bot)

at Infatica.io

Posted 2 days ago 0 applied

Description:

  • Infatica.io is a global provider of proxy and DaaS solutions, building a high-load web scraping platform that allows users to submit any URL and receive clean HTML or structured JSON output.
  • The platform supports both cloud and on-premises deployment in client infrastructure, including Kubernetes.
  • The company is seeking an experienced Tech Lead for the web scraping development team to lead the team, drive architectural decisions, and shape the future of the scraping infrastructure.
  • Key responsibilities include architecture design, development leadership, anti-bot research and bypass, and DevOps/SRE tasks.
  • Architecture design involves creating a high-parallel crawler, session management, anti-bot bypass, CAPTCHA solver, API, authorization, billing, quotas, monitoring, and infrastructure using microservices, Docker/K8s, CI/CD, and observability.
  • Development leadership includes team building, establishing development and release processes, and overseeing code quality control and technical decisions.
  • Anti-bot research focuses on browser and network-level fingerprinting and protection bypass for various systems.
  • DevOps/SRE responsibilities include CI/CD setup, scaling configuration, and monitoring organization.

Requirements:

  • Candidates must have 5+ years of engineering experience in high-load backend/data platforms.
  • An excellent understanding of HTTP, TLS, HTTP/2, proxies, and browser stack (CDP, WebRTC) is required.
  • Experience with async Python and Go (ideally both), Redis, queues, and message brokers is necessary.
  • Advanced level knowledge of DevOps tools such as Kubernetes, Helm, Prometheus, and CI/CD is essential.
  • Experience analyzing and bypassing bot protection systems is a strong plus.
  • Candidates must be fluent in English, as all documentation and part of the team are English-speaking.
  • Strong decision-making skills, mentoring abilities, and accountability for results are required.

Benefits:

  • The position offers the opportunity to participate in developing the company's key product from scratch.
  • There is high autonomy and influence on architecture and team decisions.
  • A budget for conferences, courses, and work tools is provided.
  • The compensation package is competitive.
  • Remote work flexibility is available.