Remote Data Engineer

Description:

• We are seeking an experienced Data Engineer to design, develop, and maintain robust data pipelines and infrastructure for Acelab, a B2B marketplace that connects architects and designers with building material manufacturers.
• This role will be crucial in managing our data ecosystem, implementing advanced analytics, and supporting our data science and engineering teams in delivering high-quality insights and products.
• Key responsibilities include designing, developing, and maintaining pipelines for importing and cleaning semi-structured data from various sources.
• The Data Engineer will specify, deploy, and manage scalable and reliable data pipeline infrastructure.
• They will design and implement database schemas to efficiently store and retrieve complex and sparse data.
• Collaboration with data science and engineering teams is essential to reconcile datasets and ensure data consistency across systems.
• The role involves developing and maintaining data quality checks and monitoring systems.
• The Data Engineer will optimize data storage and retrieval processes for improved performance and cost-effectiveness.
• Participation in code reviews and contribution to best practices for data engineering is expected.
• Staying up-to-date with the latest trends and technologies in data engineering and big data processing is also a key responsibility.

Requirements:

• The ideal candidate will have experience in data-intensive industries such as e-commerce (e.g., Wayfair, Amazon, Shopify) or similar high-volume data environments.
• A Bachelor's or Master's degree in Computer Science, Data Science, or a related field is required.
• Candidates should have 3+ years of experience in data engineering or a similar role.
• Strong proficiency in SQL and at least one big data processing framework (e.g., Apache Spark, Hadoop) is necessary.
• Some experience with .NET Web API is preferred.
• Experience with cloud platforms (AWS, Azure, or GCP) and their data services is required.
• A solid understanding of data modeling, ETL processes, and data warehousing concepts is essential.
• Familiarity with version control systems (e.g., Git) and CI/CD practices is expected.
• Knowledge of data governance and security best practices is important.
• Strong problem-solving skills and attention to detail are required.
• Excellent communication skills and the ability to work in a collaborative environment are necessary.
• Experience with Agile development methodologies is preferred.

Benefits:

• Employees will have the opportunity to work with some of the brightest minds in AEC, including the former CEO of Revit.
• The position offers unlimited PTO, Sick Days, Paid National Holidays, and more.
• Comprehensive medical, dental, vision, short-term/long-term disability plans, and a 401(k) are provided.
• There are opportunities for growth, creativity, and ownership within the company.
• Flexible and remote work schedules are available to employees.