Remote AD - Data Engineer B. - Job6313

Description:

• We are seeking a skilled Data Engineer to join our dynamic team.
• The ideal candidate will have a strong background in data processing and analytics, with expertise in Python and SQL.
• You will be responsible for designing, building, and maintaining scalable data pipelines and ensuring the integrity and availability of data for analysis.
• This role requires collaboration with data scientists, analysts, and other stakeholders to support data-driven decision-making across the organization.
• Location: We are seeking talents from Colombia.
• Job responsibilities include designing, developing, and maintaining robust data pipelines to process large volumes of data from various sources.
• You will collaborate with data scientists and analysts to understand data requirements and deliver high-quality datasets.
• You will optimize data storage and retrieval processes to improve performance and efficiency.
• Implementing data quality checks and monitoring to ensure the accuracy and reliability of data is also part of your responsibilities.
• You will work with cloud-based technologies, particularly Databricks, to manage and analyze data.
• Participation in Agile development processes, including sprint planning and retrospectives using Jira, is expected.
• You will document data processes, architectures, and workflows for future reference and compliance.
• Staying updated with industry trends and best practices in data engineering and analytics is essential.

Requirements:

• Proficient in Python as a core programming language for data manipulation and analysis.
• Strong knowledge of SQL for querying databases and performing data transformations.
• Experience with PySpark for processing large datasets in a distributed computing environment.
• Familiarity with Databricks is a plus, enabling efficient data processing and collaboration.
• Understanding of data warehousing concepts and ETL processes is required.
• Experience working in Agile environments, particularly with Scrum methodologies (not as a Scrum Master).
• Proficient in using Jira for project management and tracking progress.
• A minimum of 3 years of experience in data engineering or related fields is necessary.
• A proven track record of building and maintaining data pipelines in production environments is essential.
• Excellent communication skills to effectively collaborate with cross-functional teams are required.
• Strong problem-solving abilities and attention to detail are necessary.

Benefits:

• The position offers the opportunity to work remotely, providing flexibility in your work environment.
• You will be part of a dynamic team that values collaboration and innovation.
• The role allows for professional growth and development in the field of data engineering and analytics.
• You will have the chance to work with cutting-edge technologies and industry best practices.
• Participation in Agile development processes fosters a collaborative and efficient work culture.