Remote Azure Data Engineer

Description:

• We are seeking a highly skilled Data Engineer with strong expertise in Azure Data Factory, Azure Databricks, Oracle, and PostgreSQL.
• The ideal candidate will design and implement robust data pipelines, optimize data flows, and contribute to our cloud data platform initiatives using the Microsoft Azure ecosystem.
• Key responsibilities include designing, building, and maintaining scalable data pipelines using Azure Data Factory and Databricks (Spark-based).
• The candidate will ingest, transform, and orchestrate data from various sources including Oracle and PostgreSQL databases.
• Collaboration with data analysts, data scientists, and other stakeholders to understand data requirements and deliver clean, reliable data is essential.
• The role involves optimizing performance of data workflows, especially within Azure environments.
• Implementing data quality checks, lineage tracking, and monitoring processes is required.
• The candidate will follow and contribute to data governance, security, and compliance policies.
• Participation in code reviews, documentation, and continuous improvement initiatives is expected.

Requirements:

• A Microsoft Certified: Azure Data Engineer Associate (or higher) certification is required.
• Strong hands-on experience with Azure Data Factory and Azure Databricks (PySpark/Scala preferred) is necessary.
• Solid working knowledge of Oracle and PostgreSQL databases, including writing efficient SQL queries, is essential.
• Proficiency in building ETL/ELT workflows and data orchestration on Azure is required.
• Experience with Azure storage solutions (Blob Storage, ADLS Gen2) is necessary.
• A strong understanding of data modeling, warehousing concepts, and performance optimization is required.
• Familiarity with CI/CD pipelines in Azure DevOps is a plus.
• Excellent problem-solving skills and the ability to work independently or in a team are essential.

Benefits:

• The position offers the opportunity to work with cutting-edge technologies in the Microsoft Azure ecosystem.
• Candidates will have the chance to collaborate with a diverse team of data professionals.
• The role provides opportunities for continuous learning and professional development in data engineering.
• Employees will be part of initiatives that contribute to cloud data platform advancements.
• The company promotes a culture of data governance, security, and compliance, ensuring a responsible data environment.