Remote Tech Lead Data Engineering

Description:

• We are looking for a highly skilled and motivated Tech Lead of Data Engineering to spearhead the development of scalable and efficient data engineering solutions.
• The ideal candidate will possess deep expertise in Python, PySpark, AWS services, and streaming data platforms, with a proven ability to integrate complex data sources and develop distributed data processing frameworks.
• This role requires a strong technical leader who can guide the team, solve complex challenges, and deliver optimal solutions that align with client requirements.
• Healthcare experience is an added benefit.
• Key responsibilities include providing hands-on technical leadership, designing and implementing data engineering solutions, and leading by example in adopting best practices for coding, testing, and deployment.
• Responsibilities also involve designing and developing robust ETL pipelines using AWS Glue, Lambda, and other AWS services, implementing complex data transformations, and integrating data from multiple sources.
• The role includes developing distributed data processing frameworks, optimizing performance for batch and real-time workloads, and providing optimal data engineering solutions aligned with client requirements.
• Collaboration with architects to design scalable and secure data solutions leveraging AWS cloud services is essential.
• The candidate will utilize AWS services to build efficient and scalable cloud-based solutions and stay updated with the latest AWS services and features.
• Stakeholder collaboration is crucial, requiring effective communication of progress, challenges, and solutions to both technical and non-technical stakeholders.

Requirements:

• A Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field is required.
• The candidate must have 10+ years of experience in data engineering.
• Strong hands-on expertise in Python, PySpark, and AWS services for data processing and integration is necessary.
• Extensive knowledge of distributed data processing frameworks and best practices is required.
• A strong problem-solving and solution-oriented mindset to deliver optimal results is essential.
• Excellent knowledge of data integration techniques and cloud-based architecture is needed.
• Proficiency in implementing complex data transformations and scalable data workflows is required.
• Exceptional team leadership and mentoring abilities are necessary.
• Strong communication skills for effective stakeholder collaboration are required.
• Preferred qualifications include AWS Certified Solutions Architect certification or equivalent and familiarity with Terraform or CloudFormation for AWS infrastructure as code.
• Experience in the Wealth Management domain is also preferred.

Benefits:

• Be a key player in building cutting-edge data engineering solutions for large-scale projects.
• Work with a talented and collaborative team in a dynamic environment.
• Competitive salary, benefits, and opportunities for career growth are offered.