Remote [Job - 20712] Mid-Level Data Engineer, Colombia

Description:

• We are tech transformation specialists, uniting human expertise with AI to create scalable tech solutions.
• With over 6,500 CI&Ters around the world, we’ve built partnerships with more than 1,000 clients during our 30 years of history.
• Artificial Intelligence is our reality.
• We are looking for a Product Data Engineer to maintain and optimize data pipelines in AWS for product analytics and decision-making.
• This role focuses on ensuring data flow, availability, and performance while optimizing costs.
• Key responsibilities include developing and optimizing scalable data pipelines using Python and AWS services, managing ETL/ELT workflows with tools like Airflow and Glue for data integrity, improving storage efficiency and query performance for large datasets, implementing logging and monitoring for pipeline reliability, and collaborating with cross-functional teams to provide quality data for decision-making.

Requirements:

• Experience with Data Engineering or a related role is required.
• Strong Python proficiency for data processing and automation is necessary.
• Experience with AWS and basic SQL is essential.
• Hands-on experience with ETL orchestration using Apache Airflow is required.
• Familiarity with CI/CD pipelines and version control (Git) is necessary.
• Preferred qualifications include experience with data lake architectures, knowledge of data governance and cost management best practices, and prior experience with IoT data pipelines.

Benefits:

• Our benefits include premium healthcare.
• We offer meal vouchers.
• Maternity and parental leaves are provided.
• A mobile services subsidy is available.
• Sick pay is included.
• Life insurance is offered.
• Employees have access to CI&T University.
• Colombian holidays and paid vacations are part of the benefits package.
• Many other benefits are also available.