Description:

The client is seeking a skilled data engineer with a minimum of 3 years’ experience to work with an existing software development team on an ongoing project.
This position will support the design and delivery of secure, scalable, and traceable data pipelines in Azure, focusing on integrating and transforming sensitive, public-facing datasets.
The candidate will build ingestion workflows and transformation logic to support reporting, analytics, and public transparency initiatives.
This role requires experience with Azure-native tools, strong ETL/ELT capabilities, and a strong commitment to data quality, auditability, and responsible data use.
The candidate will be working with an existing software development team in an Agile/Scrum environment.

Requirements:

At least 3 years of experience building and maintaining ETL/ELT pipelines in enterprise environments using Azure-native tools is required.
Hands-on expertise with Azure Data Factory, Dataflows, Synapse Pipelines, or similar orchestration tools is required.
Proficiency in SQL, Python, or PySpark for transformation logic and data cleansing workflows is required.
Experience with Delta Lake, Azure Data Lake Storage Gen2, JSON, and Parquet formats is required.
The ability to build modular, reusable pipeline components using metadata-driven approaches and robust error handling is required.
Familiarity with public data sources, government transparency datasets, and publishing workflows is required.
Knowledge of data masking, PII handling, and encryption techniques to manage sensitive data responsibly is required.
Experience with data quality frameworks, including automated validation, logging, and data reconciliation methods is required.
A strong grasp of DevOps/DataOps practices, including versioning, testing, and CI/CD for data pipelines is required.
Experience supporting data publishing for oversight, regulatory, or open data initiatives is highly desirable.
Certifications such as DP-203 (Azure Data Engineer Associate) or Azure Solutions Architect are a plus.

The position offers a remote work opportunity, allowing for flexibility in work location.
The contract duration is for 12+ months, providing job stability for the duration of the project.
The role involves working in an Agile/Scrum environment, promoting collaboration and continuous improvement.
The candidate will have the opportunity to work with cutting-edge Azure-native tools and technologies.
There is potential for professional growth and development through hands-on experience in data engineering and analytics.