Remote Senior Software Engineer - Web Scraping Specialist

Description:

• Design, implement, and maintain web scraping processes to gather data from online sources efficiently and accurately.
• Incorporate data cleansing and validation logic to ensure data integrity and accuracy.
• Optimize services for efficiency and scalability, especially with large data volumes or multiple sources.
• Stay updated on legal and ethical considerations related to web scraping.
• Research and select appropriate tools for technical project designs.
• Collaborate with cross-functional teams to gather requirements and propose improvements.
• Drive complex projects with contributions from multiple engineers.
• Mentor engineers through code/design reviews and provide technical direction.
• Champion continual process and practice improvement for efficient and high-quality software delivery.

Requirements:

• 8+ years of backend development experience with expertise in writing efficient, clean, and maintainable code.
• Proficiency in Python.
• Knowledge of best practices for data storage and retrieval of large volumes of scraped data.
• Understanding of web scraping best practices, including handling dynamic content and IP address management.
• Experience in scaling and maintaining backend components in a production environment.
• Familiarity with containerized deployments (docker, kubernetes, terraform) and cloud computing (AWS is a plus).
• Conversant with continuous integration, continuous deployment, and test-driven development practices.
• Demonstrated experience in mentoring engineers and enhancing team performance.
• Strong problem-solving and project management skills.
• Excellent communication and collaboration abilities.

Benefits:

• Remote-first approach with team-building activities and the option to work from offices in Dublin, Poznan, or Bratislava, or fully remote/hybrid.
• Training budget and paid training days every year for upskilling.
• Flat organizational structure with open, honest communication.
• Focus on innovation with projects to evaluate new frameworks, contribute to the open-source community, and research new product applications.
• Indefinite period employment contract.