Description:

This key role requires strong technical skills, the ability to solve complex problems, and a deep understanding of how to structure and manage scalable and robust data architectures and flows.
The position involves collaborating with other BHub responsibilities such as Product Managers, Tech Managers, Data Scientists, and Business Analysts to identify opportunities and critically assess existing and future data architectures and flows.
Responsibilities include implementing and managing the necessary infrastructure for the data platform, focusing on performance and cost.
The role requires strategically critiquing and improving the data architecture by having an overview of potential bottlenecks in data flows.
The candidate will design, build, and maintain robust data pipelines for data ingestion, movement, storage, and processing.
Collaboration with Data Scientists, Software Engineers, Product Managers, and other stakeholders is essential to understand data requirements and implement effective solutions.
The role includes developing and implementing reliable and scalable data integrations from various sources to feed analytical and operational applications.
Ensuring data quality and integrity through data modeling and implementing quality tests is a key responsibility.
The candidate will implement data security and governance practices to protect confidential information.

Requirements:

A completed Bachelor's degree in Engineering, Mathematics, Physics, Economics, Administration, Technology, or a related field is required.
The candidate must have 3 years or more of experience working with data.
Experience in managing data lakes or data warehouses is necessary.
Proficiency in Python and SQL is required.
Knowledge of data modeling frameworks such as dbt is essential.
Experience with workflow managers like Airflow, Dagster, Luigi, etc., is required.
The candidate must have experience developing ETL/ELT flows for large volumes of data.
Experience with cloud data warehouses such as BigQuery, Databricks, or Snowflake is necessary.