Remote Senior Data Engineer: Data Lake

Description:

• Constructor is a next-generation platform for search and discovery in e-commerce, focusing on optimizing metrics like revenue, conversion rate, and profit.
• The company has developed an in-house search engine utilizing transformers and generative LLMs, powering search, recommendations, and shopping agents.
• The Data Lake Team, part of the Data Infrastructure team, develops the Constructor Data Platform, which handles over 1 TB of compressed events daily and manages over 6 PB of data.
• The Senior Data Engineer will work on data platform support, data pipeline development and maintenance, data modeling, and a Data Quality framework.
• Responsibilities include supporting data platforms (PySpark, Databricks, EMR, Luigi, Airflow), optimizing data pipelines, and developing user-facing services for behavioral data ingestion.
• The ideal candidate should have at least 4 years of experience, strong programming skills (preferably in Python), and expertise in big data engineering and cloud platforms (preferably AWS).
• The role involves building various data platform components, incorporating user feedback, and driving improvements.

Requirements:

• Candidates must have a minimum of 4 years of experience in data engineering.
• Strong programming skills, ideally in Python, are required.
• Expertise in big data engineering, web services, and cloud platforms, preferably AWS, is essential.
• Experience with data platform support tools such as PySpark, Databricks, EMR, Luigi, and Airflow is necessary.
• Familiarity with data modeling techniques (bronze, silver, gold) is required.
• Knowledge of developing and maintaining a Data Quality framework built on top of DBT is important.
• Experience in developing user-facing services for behavioral data ingestion using FastAPI, Docker, and AWS ECS is preferred.

Benefits:

• Employees enjoy unlimited vacation time, with a strong encouragement to take at least 3 weeks off per year.
• The company offers a fully remote work environment, allowing employees to choose their location.
• A work-from-home stipend is provided to help set up home offices.
• New employees receive Apple laptops to support their work.
• There is a training and development budget for every employee, refreshed annually.
• Maternity and paternity leave is available for qualified employees.
• Employees will work with a talented team that fosters growth and meaningful impact.
• The position offers a base salary range between $80k and $120k USD, depending on various factors.
• Regular team offsites are organized to promote connection and collaboration.