Remote Tech Lead Engineer (Web scraping & Anti-bot)

Description:

• Infatica.io is a global provider of proxy and DaaS solutions, building a high-load web scraping platform that allows users to submit any URL and receive clean HTML or structured JSON output.
• The platform will support both cloud deployment and on-premises deployment in client infrastructure, including on-prem and Kubernetes.
• The company is seeking an experienced Tech Lead for their web scraping development team to lead the team, become the technical leader of the platform, drive architectural decisions, and shape the future of their scraping infrastructure.
• Key responsibilities include architecture design, development leadership, anti-bot research and bypass, and DevOps/SRE tasks.
• Architecture design involves creating a high-parallel crawler, session management, anti-bot bypass, CAPTCHA solver, API, authorization, billing, quotas, monitoring, and infrastructure using microservices, Docker/K8s, CI/CD, and observability.
• Development leadership includes team building, establishing development and release processes, and overseeing code quality control and technical decisions.
• Anti-bot research and bypass tasks involve browser and network-level fingerprinting and protection bypass for various systems.
• DevOps/SRE responsibilities include CI/CD setup, Helm charts, scaling configuration, and monitoring organization.

Requirements:

• Candidates must have 5+ years of engineering experience in high-load backend/data platforms.
• Extensive scraping experience is mandatory.
• An excellent understanding of HTTP, TLS, HTTP/2, proxies, and browser stack (CDP, WebRTC) is required.
• Experience with async Python and Go is ideal, along with knowledge of Redis, queues, and message brokers.
• Advanced level proficiency in DevOps tools such as Kubernetes, Helm, Prometheus, and CI/CD is necessary.
• Experience analyzing and bypassing bot protection systems is a strong plus.
• Candidates must be fluent in English, as all documentation and part of the team are English-speaking.
• Strong decision-making skills, mentoring abilities, and accountability for results are essential.

Benefits:

• The position offers the opportunity to participate in developing the company's key product from scratch.
• Employees will have high autonomy and influence on architecture and team decisions.
• There is a budget for conferences, courses, and work tools to support professional development.
• A competitive compensation package is provided.
• The role includes remote work flexibility, allowing for a better work-life balance.