Remote Lead Data Pipeline Developer

Description:

• Lead the design, implementation, and optimization of data pipeline solutions to enable efficient data ingestion, processing, and delivery.
• Provide technical leadership to a team of developers, fostering a culture of excellence and innovation.
• Develop and maintain data ingestion processes from various sources like databases, APIs, files, and streaming sources.
• Cleanse, enrich, and transform data as it moves through the pipeline to meet business needs.
• Implement workflow orchestration and automation solutions to manage data pipeline workflows efficiently.
• Optimize data pipeline performance through parallel processing and partitioning techniques.
• Monitor and track data pipeline performance, proactively identifying and resolving issues.
• Implement error handling and retry mechanisms to ensure data reliability and consistency.
• Define best practices for data pipeline development and promote clear documentation.
• Collaborate with cross-functional teams to deliver data pipeline solutions that meet business requirements.
• Mentor and coach junior developers, providing guidance and support for skill development.

Requirements:

• Bachelor's degree or higher in Computer Science, Engineering, Mathematics, or related field.
• 8+ years of experience in data engineering, with a focus on designing, building, and optimizing data pipeline solutions.
• Proven leadership experience in leading data pipeline development teams and delivering complex projects.
• Proficiency in data pipeline technologies like Apache Kafka, Apache NiFi, Apache Airflow, or similar.
• Strong programming skills in languages such as Python, Java, or Scala, with experience in data processing frameworks like Apache Spark or Apache Beam.
• Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform, and services like AWS Glue, Azure Data Factory, or Google Dataflow.
• Strong understanding of data integration concepts and techniques, with experience integrating data from diverse sources.
• Excellent problem-solving skills, analytical thinking, and troubleshooting abilities.
• Strong communication and collaboration skills to interact effectively with technical and non-technical stakeholders.

Benefits:

• Competitive salary ranging from $190,000 to $270,000 per year, based on experience and qualifications.
• Comprehensive benefits package including health insurance, retirement plans, and wellness programs.
• Flexible work arrangements with remote work options and flexible hours.
• Generous vacation and paid time off.
• Professional development opportunities with access to training programs, conferences, and workshops.
• State-of-the-art technology environment with cutting-edge tools and resources.
• Vibrant and inclusive company culture with growth and advancement opportunities.
• Exciting projects with real-world impact at the forefront of data-driven innovation.