Remote Data Engineer II (Remote)

Description:

• The Data Engineer II position at HackerRank is a full-time remote role within India.
• Responsibilities include evaluating technologies, developing POCs, solving technical challenges, and proposing innovative solutions for technical and business problems.
• The role involves building high-quality, scalable, and reliable business applications to delight stakeholders, customers, and partners.
• Designing, building, and maintaining streaming and batch data pipelines that can scale is a key aspect of the position.
• The Data Engineer II will work on architecting, developing, and maintaining the Modern lake house Platform using AWS native infrastructure.
• Designing complex data models to deliver insights and enable self-service is part of the role.
• Taking ownership of scaling, performance, security, and reliability of the data infrastructure is a crucial responsibility.
• The position also involves hiring, guiding, and mentoring junior engineers, participating in code reviews, and collaborating with remote and cross-functional teams.

Requirements:

• Candidates should have 3+ years of experience in designing, developing, and maintaining data engineering & BI solutions.
• Experience with Data Modeling for Big Data Solutions is required.
• Proficiency in Spark, Spark Structured Streaming (PySpark or Scala Spark) is necessary.
• Familiarity with database technologies like Redshift or Trino is essential.
• Experience with BI Solutions like Looker, Power BI, Amazon Quicksight, Tableau is a plus.
• Knowledge of ETL Design & Orchestration using platforms like Apache Airflow, MageAI is advantageous.
• Ability to query massive datasets using Languages like SQL, Hive, Spark, Trino is required.
• Experience with performance tuning complex data warehouses and queries is necessary.
• Candidates should be self-driven, initiative takers with good communication skills, ability to lead and mentor junior engineers, work with cross-functional teams, and drive architecture decisions.
• Knowledge of Kafka, Kafka Connect, and related technologies is a bonus.

Benefits:

• The position offers a one-time home office set up stipend and a monthly Remote Work Enablement Stipend.
• Professional Development Reimbursement is provided.
• Wellbeing Benefits such as Headspace are included.
• Flexible paid time off, paid leave for new parents, and flexible work hours are part of the benefits package.
• Insurance for all employees (term life, personal accident, medical) along with medical insurance for their dependents is provided.
• Employee stock options are available.