Remote Remote Tech Lead Engineer (Web scraping & Anti-bot)

at Infatica.io

Posted 20 hours ago 0 applied

Description:

  • Infatica.io is a global provider of proxy and DaaS solutions, building a high-load web scraping platform.
  • The platform will allow users to submit any URL and receive clean HTML or structured JSON output, without concerns about proxies, CAPTCHAs, or anti-bot systems.
  • The position is for an experienced Tech Lead for the web scraping development team, responsible for leading the team and driving architectural decisions.
  • Key responsibilities include architecture design for data-plane and control-plane components, development leadership, anti-bot research and bypass, and DevOps/SRE tasks.
  • The architecture design involves creating a high-parallel crawler, session management, anti-bot bypass, API, authorization, billing, quotas, and monitoring.
  • Development leadership includes team building, establishing development and release processes, and overseeing code quality and technical decisions.
  • Anti-bot research focuses on browser and network-level fingerprinting and protection bypass techniques.
  • DevOps/SRE responsibilities include CI/CD setup, scaling configuration, and monitoring organization.

Requirements:

  • Candidates must have 5+ years of engineering experience in high-load backend/data platforms.
  • Extensive scraping experience is mandatory.
  • An excellent understanding of HTTP, TLS, HTTP/2, proxies, and browser stack (CDP, WebRTC) is required.
  • Experience with async Python and Go is ideal, along with knowledge of Redis, queues, and message brokers.
  • Advanced level proficiency in DevOps tools such as Kubernetes, Helm, Prometheus, and CI/CD is necessary.
  • Experience in analyzing and bypassing bot protection systems is a strong plus.
  • Candidates must be fluent in English, as all documentation and team communication are in English.
  • Strong decision-making skills, mentoring abilities, and accountability for results are essential.

Benefits:

  • The opportunity to participate in developing the company's key product from scratch.
  • High autonomy and influence on architecture and team decisions.
  • A budget for conferences, courses, and work tools is provided.
  • A competitive compensation package is offered.
  • Remote work flexibility is available.

Get realtime job alerts

Be the first to know about new jobs