Remote Senior Data Engineer

Description:

• IT Labs is seeking a Senior Data Engineer who is passionate about innovation, collaboration, and delivering exceptional solutions.
• The role involves building scalable, high-performance data systems and pipelines, with a deep understanding of data engineering principles.
• The Senior Data Engineer will enable seamless data integration and transformation to power critical business insights.
• This position requires crafting reliable solutions for complex challenges and understanding the importance of data-driven decision-making.
• The ideal candidate thrives on solving complex data challenges, enjoys collaborating with cross-functional teams, and is driven to create impactful solutions.

Requirements:

• The candidate must design, build, and maintain scalable ETL/ELT pipelines to process structured and unstructured data.
• They should implement robust workflows for batch and real-time data processing using modern frameworks and tools.
• Developing and optimizing data architectures to ensure performance, scalability, and reliability is essential.
• The role requires designing data integration strategies to consolidate data from multiple sources into a centralized repository.
• Building and managing data warehouses or data lakes optimized for analytics and reporting needs is necessary.
• The candidate must develop and maintain data models, schemas, and documentation to support business intelligence and data science teams.
• Implementing processes to monitor and ensure data quality, integrity, and accuracy is required.
• Continuous monitoring, debugging, and optimizing data pipelines and storage solutions for efficiency and reliability is expected.
• Staying updated on emerging trends and technologies in data engineering is crucial.
• Strong problem-solving and critical thinking abilities are necessary.
• Excellent communication and collaboration skills are required, with the ability to explain complex technical concepts to non-technical stakeholders.
• A proactive mindset with a focus on continuous improvement is essential.
• The candidate should have a minimum of 6 years of experience in a Data Engineering role with demonstrated expertise in building and managing scalable data pipelines, architectures, and systems.
• Expertise in programming languages such as Python and R is required.
• Advanced SQL skills, including query optimization and performance tuning, are necessary.
• Proficiency in big data frameworks such as Apache Spark, Hadoop, or Kafka is essential.
• Experience with relational databases (e.g., PostgreSQL, MySQL) and NoSQL databases (e.g., MongoDB, Cassandra) is required.
• Hands-on experience with cloud-based data warehouses like Snowflake, Redshift, or BigQuery is necessary.
• Strong knowledge of cloud platforms such as AWS, Azure, or GCP, including services like S3, Lambda, EMR, or Databricks, is required.
• Proficiency with Git for version control and knowledge of CI/CD pipelines for deploying data solutions is essential.
• Familiarity with monitoring tools like Datadog, Prometheus, or similar to track data pipeline performance is necessary.

Benefits:

• The position offers a choice of contract: Contract or B2B.
• There is an unlimited working-from-anywhere policy.
• Employees receive 10 Days PTO after 4 months of working at IT Labs.
• Referral bonuses are available.
• The role involves working on international projects.
• Employees can participate in virtual knowledge sharing sessions, events, and team hangouts.