This job post is closed and the position is probably filled. Please do not apply.
🤖 Automatically closed by a robot after apply link
was detected as broken.
Description:
Brightwheel is seeking a Senior Data Engineer to join the Data Engineering team, playing a key role in the implementation and evolution of their web scraping and data platform.
The position involves crafting and implementing a best-in-class web scraping strategy and infrastructure.
Responsibilities include building and scaling pipelines that manage millions of records across hundreds of sites, enabling insights for the Analytics team and customers.
The role requires using modern tooling to build a robust, extensible, and performant web scraping platform.
The engineer will deliver infrastructure solutions for flexible and repeatable applications across disparate sources and troubleshoot existing data pipelines, models, and solutions.
The position also involves building upon data engineering's CI/CD deployments and infrastructure-as-code for provisioning AWS and third-party services.
Requirements:
Candidates must have 3+ years of work experience as a data engineer or full stack engineer, with proficiency in coding in Python.
A minimum of 3 years of experience building web scraping tools in Python using tools like Beautiful Soup, Scrapy, or Selenium is required.
1-3 years of deployment experience with CI/CD is necessary.
Strong knowledge of HTML, CSS, JavaScript, and browser behavior is essential.
Experience with RESTful APIs and JSON/XML data formats is required.
Candidates should have knowledge of cloud platforms and containerization technologies such as Docker and Kubernetes.
An advanced understanding of at least one big data processing technology (e.g., Spark, Hadoop, Redshift, BigQuery, Snowflake) is needed.
Excellent analytical, problem-solving, and troubleshooting skills are required to manage complex processes and technology issues without guidance.
Benefits:
Brightwheel offers competitive compensation, benchmarked against similar-stage growth companies, with a salary range of $81,000 - $93,500 a year.
Employees are empowered as stakeholders through equity ownership, providing financial upside alongside the company's achievements.
Premium benefits include healthcare coverage (medical, dental, and vision) valued at over $15,000, generous paid parental leave, and flexible paid time off (PTO).
A 401(k) enrollment option is available to help employees plan for the future.
Monthly wellness and productivity stipends are provided to support employee well-being.
The company offers work-life flexibility as a fully remote organization, allowing employees to work from where they thrive.