Remote Big Data Engineer

Description:

• Our client is seeking a talented Big Data Engineer to work on internal technical initiatives in data engineering, data analytics, and software integration.
• This is a highly technical role in a true big data environment hosted on AWS Cloud.
• The ideal candidate will have 3-6 years of experience, with a strong focus on building data pipelines, optimizing algorithms, and advanced SQL querying, rather than traditional ETL pipelines.
• Responsibilities include designing, building, and optimizing data pipelines to support business initiatives.
• The candidate will collaborate with internal business stakeholders to improve data engineering and analytics capabilities.
• The role involves optimizing algorithms and working on complex SQL queries for data solutions.
• The engineer will work within an AWS environment, particularly EMR, to manage and process large data sets.
• Development will utilize Python, Java, or Scala, alongside test-driven development practices.
• The candidate will also build and maintain unit tests to ensure code quality.

Requirements:

• The candidate must have 3-6 years of hands-on experience in data engineering.
• Strong expertise in Python (or Java/Scala) is required, with proven coding proficiency.
• Advanced experience in SQL, specifically for structuring complex queries, is necessary.
• Experience in building data pipelines (not ETL) and optimizing algorithms is essential.
• Knowledge of AWS EMR and experience working in a big data environment is required.
• Familiarity with Spark and test-driven development is also necessary.
• A Bachelor's degree in Computer Science, Mathematics, Physics, or Electrical Engineering is preferred.
• Candidates from the DMV area are preferred, though remote options may be available for exceptional candidates.

Benefits:

• The position offers a fully remote work environment.
• It provides an opportunity to work on cutting-edge big data technologies in a dynamic team.
• The role allows for collaboration with internal business stakeholders to enhance data capabilities.
• The candidate will gain experience in a true big data environment hosted on AWS Cloud.
• There is potential for career growth and development in data engineering and analytics.