Remote Data Engineer Analyst

Description:

• Design, build, and maintain scalable data pipelines and ingestion frameworks for batch processing, streaming, and CDC patterns.
• Develop and optimize data processing workflows using Apache Spark and PySpark.
• Implement and manage data lake architectures on AWS, utilizing S3 and Apache Iceberg.
• Work with AWS services like Glue, Athena, and Lambda for data processing and querying.
• Manage data access controls and security configurations using AWS IAM.
• Collaborate with data analysts, scientists, and engineers to deliver production-ready solutions.
• Monitor pipeline health and troubleshoot data quality issues.
• Document data flows, architecture decisions, and engineering standards.

Requirements:

• Advanced experience with AWS services (Glue, S3, Athena, IAM).
• Proficiency in Apache Spark/PySpark for data processing.
• Knowledge of data lake architectures and Apache Iceberg.
• Familiarity with data ingestion patterns and SQL for querying.
• Understanding of data modeling and large-scale data processing.
• Ability to communicate technical concepts to non-technical stakeholders.
• Experience with infrastructure-as-code or pipeline orchestration tools is a plus.
• 2+ years of experience in Data Engineering or related roles.
• Advanced English proficiency required.

Benefits:

• Christmas Bonus, Saving Fund, Food/grocery vouchers, Home Office allowance.
• MetLife Life and Medical Insurance with optional dependents coverage.
• Vacation days with annual increases, vacation premium, and official holidays.
• Flexible working options for work-life balance.
• Learning opportunities including study plans and English lessons.