We are seeking a highly skilled Data Engineer with extensive experience in Azure Data Lake to contribute to our dynamic team at Creative Chaos.
The ideal candidate will be responsible for architecting, developing, and optimizing data pipelines that will facilitate the efficient processing of large datasets.
Responsibilities include designing and implementing robust data pipeline solutions within Azure Data Lake.
The candidate will integrate and transform data from various sources to enable comprehensive analytics and reporting.
Ensuring data quality and integrity, implementing data governance practices is a key responsibility.
The role involves collaborating with cross-functional teams to understand data requirements and develop scalable solutions.
Monitoring and optimizing data processing workflows for performance and reliability is essential.
The candidate will document processes and architecture to ensure maintainability and scalability.
Staying abreast of new Azure technologies and best practices for data engineering is expected.
Requirements:
A Bachelor's degree in Computer Science, Information Technology, or a related field is required.
A minimum of 5 years of experience working as a Data Engineer, with a strong emphasis on Azure Data Lake is necessary.
Proficiency in Azure Data Services, particularly Azure Data Lake Storage, Azure Data Factory, and Azure Synapse Analytics is essential.
Demonstrated experience with data modeling, ETL processes, and data warehousing solutions is required.
Strong programming skills in Python, SQL, and familiarity with Java or C# are necessary.
Excellent problem-solving skills and a detail-oriented approach to work are important.
The ability to communicate technical concepts clearly to non-technical stakeholders is required.
Strong organizational skills with the ability to manage multiple priorities and meet deadlines are essential.
Benefits:
The position offers Paid Time Off to support work-life balance.
Employees have the option to Work From Home, providing flexibility.
Health Insurance is provided to ensure employee well-being.
OPD (Outpatient Department) benefits are included for medical needs.
Opportunities for Training and Development are available to enhance skills and career growth.