Remote Big Data Engineer (Remote in Romania)

Description:

• In this role, you will work closely with cross-functional teams within the Business Analytics & Insights (BAI) department to deliver top-tier data solutions in various domains such as Supply Chain, Finance, Operations, Customer Experience, HR, Risk Management, and Global IT.
• You will play a key part in the technical planning, execution, and maintenance of data migration processes.
• The role requires designing scalable, efficient data pipelines, ensuring data quality and integrity, and staying updated on the latest advancements in cloud and data engineering.
• You will lead the technical planning and execution of data migration, including ingestion, transformation, and storage within Azure Data Factory and Azure Data Lake.
• You will design and implement scalable data pipelines for seamless data movement from various sources using Azure Databricks.
• You will develop reusable frameworks for ingesting large datasets and implement data validation and cleansing mechanisms.
• You will work with real-time streaming technologies to process and ingest data effectively.
• You will provide technical support during and after migration, resolving challenges as they arise.
• You will stay up-to-date on advancements in cloud computing and data engineering, recommending best practices and industry standards.

Requirements:

• You must have 8+ years of IT experience with at least 4 years working with Azure Databricks.
• You should possess strong proficiency in Python for data engineering, along with expertise in PySpark and SQL.
• You need to have knowledge of Azure Data components including Data Factory, Data Lake, SQL Data Warehouse (DW), and Azure SQL.
• You should have experience in data modeling, source system analysis, and developing technical designs for data flows.
• Familiarity with data profiling, cataloging, and mapping processes is required.
• You must have experience with data visualization and exploration tools.

Benefits:

• The position offers the flexibility of remote work from Romania.
• You will have the opportunity to work with cutting-edge technologies in cloud computing and data engineering.
• You will be part of a dynamic team that values collaboration and innovation.
• The role provides a chance to enhance your skills and grow professionally in a supportive environment.