Description:

Brightwheel is seeking a Staff Data Engineer to join their Data Engineering team.
The role involves implementing and evolving the web scraping and data platform.
The Staff Data Engineer will be responsible for crafting and implementing a best-in-class web scraping strategy and infrastructure.
The position requires building and scaling pipelines that manage millions of records across hundreds of sites, enabling insights for the Analytics team and customers.
The ideal candidate is passionate about data engineering, possesses deep technical skills, and has experience building scalable web scraping platforms.
Responsibilities include using modern tooling to build a robust web scraping platform, delivering reliable data acquisition solutions, troubleshooting and improving existing data pipelines, and building upon CI/CD deployments and infrastructure-as-code for AWS and third-party services.

Requirements:

Candidates must have 5+ years of work experience as a data engineer or full stack engineer, with proficiency in Python.
A minimum of 5 years of experience building web scraping tools in Python, using tools like Beautiful Soup, Scrapy, or Selenium is required.
Candidates should have 3-5 years of deployment experience with CI/CD.
Strong knowledge of HTML, CSS, JavaScript, and browser behavior is necessary.
Experience with RESTful APIs and JSON/XML data formats is required.
Knowledge of cloud platforms and containerization technologies, such as Docker and Kubernetes, is essential.
An advanced understanding of at least one big data processing technology (e.g., Spark, Hadoop, Redshift, BigQuery, Snowflake) is needed.
Excellent analytical, problem-solving, and troubleshooting skills are required to manage complex processes and technology issues without guidance.
Preferred qualifications include 2+ years of experience developing in Airflow, deploying Infrastructure as Code within AWS, deploying microservices and/or APIs in a cloud environment, and using ML/AI workflows for data enrichment.

Brightwheel offers a competitive compensation package, including a base salary and equity.
The benefits package includes premium medical, dental, and vision benefits.
Employees receive generous paid parental leave and a flexible paid time off policy.
A monthly wellness and productivity stipend is provided, along with a Learning & Development stipend.
Brightwheel is committed to internal pay equity and benchmarks compensation against similar-stage growth companies.
The company promotes a diverse and inclusive work environment and is an equal opportunity employer.