Remote Senior Big Data Engineer

Description:

• Design, architect, and implement scalable big data infrastructure like data lakes, data warehouses, and streaming data platforms using technologies such as Hadoop, Spark, and Kafka.
• Develop, deploy, and manage data pipelines for ingesting, processing, and transforming large volumes of structured and unstructured data from diverse sources.
• Design and implement data models and schemas to support analytical and operational requirements in a distributed environment.
• Integrate data from various sources, ensuring data consistency, quality, and completeness.
• Optimize data pipelines and queries for performance and efficiency to improve system scalability and reliability.
• Implement monitoring and alerting systems to track big data platform performance and health.
• Ensure data security, privacy, and compliance with regulatory requirements.
• Document big data infrastructure and pipelines, providing clear documentation for team collaboration.
• Collaborate with cross-functional teams to deliver big data solutions that meet business needs.
• Mentor junior engineers in big data engineering best practices and technologies.

Requirements:

• Bachelor's degree or higher in Computer Science, Engineering, Mathematics, or related field.
• 5+ years of experience in big data engineering focusing on infrastructure and pipelines.
• Proficiency in Java, Scala, or Python, and experience with technologies like Hadoop, Spark, Kafka, Hive, HBase.
• Strong understanding of distributed systems, parallel processing, and optimizing data pipelines.
• Experience with cloud platforms like AWS, Azure, or Google Cloud and cloud-based big data services.
• Familiarity with SQL, NoSQL databases, data warehousing, and ETL/ELT processes.
• Strong problem-solving skills, analytical thinking, and troubleshooting abilities.
• Excellent communication and collaboration skills for working in cross-functional teams.

Benefits:

• Competitive salary ranging from $170,000 to $230,000 per year.
• Comprehensive health, dental, and vision insurance plans.
• Flexible work hours and remote work options.
• Generous vacation and paid time off.
• Professional development opportunities including training programs and conferences.
• State-of-the-art technology environment with cutting-edge tools.
• Vibrant and inclusive company culture with growth opportunities.
• Exciting projects with real-world impact in big data innovation.