Remote Remote Tech Lead Engineer (Web scraping & Anti-bot)

Description:

• Infatica.io is a global provider of proxy and DaaS solutions, building a high-load web scraping platform.
• The platform will allow users to submit any URL and receive clean HTML or structured JSON output, without concerns about proxies, CAPTCHAs, or anti-bot systems.
• The position is for an experienced Tech Lead for the web scraping development team.
• The Tech Lead will lead the team, become the technical leader of the platform, drive architectural decisions, and shape the future of the scraping infrastructure.
• Key responsibilities include architecture design, development leadership, anti-bot research and bypass, and DevOps/SRE tasks.
• Architecture design involves creating a high-parallel crawler, session management, anti-bot bypass, and CAPTCHA solver for the data-plane, as well as API, authorization, billing, quotas, and monitoring for the control-plane.
• Development leadership includes team building, establishing development and release processes, and overseeing code quality control and technical decisions.
• Anti-bot research involves analyzing browser and network-level fingerprinting and bypassing various protection systems.
• DevOps/SRE responsibilities include CI/CD setup, scaling configuration, and monitoring organization.

Requirements:

• Candidates must have 5+ years of engineering experience in high-load backend/data platforms.
• Extensive scraping experience is mandatory.
• An excellent understanding of HTTP, TLS, HTTP/2, proxies, and browser stack (CDP, WebRTC) is required.
• Experience with async Python and Go (ideally both), Redis, queues, and message brokers is necessary.
• Advanced level knowledge of DevOps tools such as Kubernetes, Helm, Prometheus, and CI/CD is essential.
• Experience analyzing and bypassing bot protection systems is a strong plus.
• Candidates must be fluent in English, as all documentation and part of the team are English-speaking.
• Strong decision-making skills, mentoring abilities, and accountability for results are required.

Benefits:

• The opportunity to participate in developing the company's key product from scratch.
• High autonomy and influence on architecture and team decisions.
• A budget for conferences, courses, and work tools is provided.
• A competitive compensation package is offered.
• Remote work flexibility is available.