Remote Data Engineer (ETL/ELT)

Description:

• Design, develop, and maintain ETL/ELT pipelines for enterprise data integration.
• Build and optimize data pipelines using Azure Data Factory and/or Microsoft Fabric Data Factory.
• Integrate data from APIs, databases, and file-based sources.
• Implement data validation, quality controls, logging, and monitoring.
• Optimize pipeline performance and troubleshoot production issues.
• Support CI/CD processes and automated deployment of data pipelines.
• Collaborate with cross-functional teams to deliver reliable data solutions.

Requirements:

• Strong experience with Azure Data Factory and/or Microsoft Fabric Data Factory.
• Hands-on experience with Azure Data Lake and Azure SQL.
• Advanced SQL skills.
• Proficiency in Python or another scripting language.
• Experience designing and maintaining production ETL/ELT pipelines.
• Experience integrating APIs, databases, and file-based data sources.
• Knowledge of incremental loading, historical data processing, and data validation.
• Experience implementing logging, monitoring, and error handling.
• Experience with CI/CD for data pipelines.
• Strong troubleshooting and performance optimization skills.

Benefits:

• Opportunity to work with modern Azure technologies.
• Contribute to an international analytics platform.