Remote Senior Data Pipeline Developer

Description:

• Design and implement data pipeline solutions for efficient data ingestion, processing, and delivery from various sources to target systems.
• Develop and maintain data ingestion processes to collect data from databases, APIs, files, and streaming sources.
• Transform and cleanse data in the pipeline to meet business requirements and enable downstream analytics.
• Implement workflow orchestration and automation solutions to manage data pipeline workflows.
• Optimize data pipeline performance through parallel processing and partitioning for scalability.
• Implement monitoring and alerting systems to track data pipeline performance and health.
• Establish error handling and retry mechanisms for data processing failures.
• Document data pipeline designs, processes, and best practices for team collaboration.
• Collaborate with cross-functional teams to deliver data pipeline solutions that meet business needs.
• Mentor junior developers and facilitate knowledge sharing sessions within the team.

Requirements:

• Bachelor's degree or higher in Computer Science, Engineering, Mathematics, or related field.
• 5+ years of experience in data engineering focusing on data pipeline solutions.
• Proficiency in data pipeline technologies like Apache Kafka, Apache NiFi, or Apache Airflow.
• Strong programming skills in Python, Java, or Scala with experience in Apache Spark or Apache Beam.
• Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform.
• Strong understanding of data integration concepts and techniques.
• Problem-solving skills to troubleshoot complex data pipeline issues.
• Excellent communication and collaboration skills for working in cross-functional teams.

Benefits:

• Competitive salary ranging from $170,000 to $230,000 per year.
• Comprehensive health, dental, and vision insurance plans.
• Flexible work hours and remote work options.
• Generous vacation and paid time off.
• Professional development opportunities including training programs and conferences.
• State-of-the-art technology environment with cutting-edge tools.
• Vibrant and inclusive company culture with growth opportunities.
• Exciting projects with real-world impact in data-driven innovation.