Remote Senior Big Data Engineer Airflow and Oozie (GCP)

Description:

• Develop scalable and robust code for batch processing systems using technologies like Hadoop, Oozie, Pig, Hive, Map Reduce, Spark (Java), Python, and Hbase.
• Manage and optimize data workflows using Oozie and Airflow within the Apache Hadoop ecosystem.
• Utilize GCP for scalable big data processing and storage solutions.
• Implement automation/DevOps best practices for CI/CD, IaC, etc.
• Work in a remote environment, requiring strong communication skills and the ability to solve complex problems independently.

Requirements:

• Proficiency in Oozie, Airflow, Map Reduce, Java, Python, Pig, and SQL.
• Experience with GCP managed services and cloud-based batch processing systems.
• Expertise in the Apache Hadoop ecosystem with Oozie, Pig, Hive, Map Reduce.
• Familiarity with BigTable and Redis.
• Hands-on experience in public cloud platforms, particularly GCP.
• Ability to devise effective solutions for complex challenges and think critically.
• Strong written and verbal communication skills for remote collaboration.
• Experience in engineering batch processing systems at scale.
• Google Associate Cloud Engineer Certification or other Google Cloud Professional level certification.
• 10+ years of experience in customer-facing software/technology or consulting.
• 5+ years of experience with “on-premises to cloud” migrations or IT transformations.
• 5+ years of experience building and operating solutions on GCP, AWS, or Azure.
• Technical degree in Computer Science, software engineering, or related field.

Benefits:

• Opportunity to work with a dynamic team in a remote setting.
• Utilize cutting-edge technologies like Hadoop, Oozie, Airflow, and GCP.
• Develop solutions for batch processing systems at scale.
• Continuous learning and growth opportunities in cloud technologies.
• Competitive salary and benefits package.
• Join a company recognized as a best place to work, committed to equal employment opportunity.