Remote Azure Data Engineer

Description:

• As a Data Engineer in our team, you will be responsible for assessing complex new data sources and quickly turning these into business insights.
• You will support the implementation and integration of these new data sources into our Azure Data platform.
• You will review and analyze structured, semi-structured, and unstructured data sources for quality, completeness, and business value.
• You will design, architect, implement, and test rapid prototypes that demonstrate the value of the data and present them to diverse audiences.
• You will participate in early state design and feature definition activities.
• You will be responsible for implementing robust data pipelines using Microsoft and the Databricks Stack.
• You will create reusable and scalable data pipelines.
• You will collaborate with team members across multiple engineering teams to support the integration of proven prototypes into core intelligence products.
• You will utilize strong communication skills to effectively convey complex data insights to non-technical stakeholders.

Requirements:

• You must have advanced working knowledge and experience with relational and non-relational databases.
• You should have advanced working knowledge and experience with API data providers.
• You need experience building and optimizing Big Data pipelines, architectures, and datasets.
• You must possess strong analytic skills related to working with structured and unstructured datasets.
• You should have hands-on experience in Azure Databricks utilizing Spark to develop ETL pipelines.
• You need strong proficiency in data analysis, manipulation, and statistical modeling using tools like Spark, Python, Scala, SQL, or similar languages.
• You must have strong experience in Azure Data Lake Storage Gen2, Azure Data Factory, Databricks, Event Hub, and Azure Synapse.
• Familiarity with several technologies such as Event Hub, Docker, Azure Kubernetes Service, Azure DWH, API Azure, Azure Function, Power BI, and Azure Cognitive Services is required.
• You should have Azure DevOps experience to deploy the data pipelines through CI/CD.
• A minimum of 5-7 years of practical experience as a Data Engineer is required.
• A Bachelor’s degree in computer science, software engineering, information technology, or a related field is necessary.
• You must have Azure cloud stack in-production experience.

Benefits:

• This position offers the opportunity to work remotely, providing flexibility in your work environment.
• You will be part of a collaborative team that values communication and teamwork.
• You will have the chance to work with cutting-edge technologies in the Azure ecosystem.
• The role provides opportunities for professional growth and development in data engineering.
• You will be involved in impactful projects that turn data into business insights.