Description:

As a Data Engineer in our team, you will be responsible for assessing complex new data sources and quickly turning these into business insights.
You will support the implementation and integration of these new data sources into our Azure Data platform.
You will review and analyze structured, semi-structured, and unstructured data sources for quality, completeness, and business value.
You will design, architect, implement, and test rapid prototypes that demonstrate the value of the data and present them to diverse audiences.
You will participate in early state design and feature definition activities.
You will be responsible for implementing robust data pipelines using Microsoft and the Databricks Stack.
You will create reusable and scalable data pipelines.
You will collaborate with team members across multiple engineering teams to support the integration of proven prototypes into core intelligence products.
You will need strong communication skills to effectively convey complex data insights to non-technical stakeholders.

Requirements:

You must have advanced working knowledge and experience with relational and non-relational databases.
You should have advanced working knowledge and experience with API data providers.
You need experience building and optimizing Big Data pipelines, architectures, and datasets.
You should possess strong analytic skills related to working with structured and unstructured datasets.
You must have hands-on experience in Azure Databricks utilizing Spark to develop ETL pipelines.
You should have strong proficiency in data analysis, manipulation, and statistical modeling using tools like Spark, Python, Scala, SQL, or similar languages.
You need strong experience in Azure Data Lake Storage Gen2, Azure Data Factory, Databricks, Event Hub, and Azure Synapse.
Familiarity with several technologies such as Event Hub, Docker, Azure Kubernetes Service, Azure DWH, API Azure, Azure Function, Power BI, and Azure Cognitive Services is required.
You should have Azure DevOps experience to deploy the data pipelines through CI/CD.
A minimum of 5-7 years of practical experience as a Data Engineer is required.
A Bachelor’s degree in computer science, software engineering, information technology, or a related field is necessary.
You must have Azure cloud stack in-production experience.

The position offers a remote work environment, allowing for flexibility in your work location.
It is a full-time position, providing job security and stability.
You will be part of a collaborative team, enhancing your professional development and networking opportunities.
The role provides the opportunity to work with cutting-edge technologies in the Azure ecosystem.
You will gain experience in a dynamic and fast-paced environment, contributing to your career growth.