Remote Data Engineer II (Remote)

Description:

• At HackerRank, we help over 2,500 prestigious companies find, hire, and upskill developer talent using our SaaS-based Developer Skills Platform.
• This position is full-time and remote within India.
• You will evaluate technologies, develop POCs, solve technical challenges, and propose innovative solutions for technical and business problems.
• You will delight stakeholders, customers, and partners by building high-quality, well-tested, scalable, and reliable business applications.
• You will design, build, and maintain streaming and batch data pipelines that can scale.
• You will architect, develop, and maintain our Modern lake house Platform using AWS native infrastructure.
• You will design complex data models to deliver insights and enable self-service.
• You will take ownership of scaling, performance, security, and reliability of our data infrastructure.
• You will hire, guide, and mentor junior engineers.
• You will work in an agile development environment and participate in code reviews.
• You will collaborate with remote development teams and cross-functional teams.

Requirements:

• You must have 3+ years of experience with designing, developing, and maintaining data engineering and BI solutions.
• You should have experience with data modeling for big data solutions.
• You need experience with Spark and Spark Structured Streaming (PySpark or Scala Spark).
• You should have experience with database technologies like Redshift or Trino.
• Experience with BI solutions like Looker, Power BI, Amazon Quicksight, or Tableau is a big plus.
• Experience with ETL design and orchestration using platforms like Apache Airflow or MageAI is a big plus.
• You must have experience querying massive datasets using languages like SQL, Hive, Spark, or Trino.
• You should have experience with performance tuning complex data warehouses and queries.
• You need to be able to solve problems of scale, performance, security, and reliability.
• You should be self-driven, an initiative taker with good communication skills, and able to lead and mentor junior engineers while working with cross-functional teams.
• Knowledge of Kafka, Kafka Connect, and related technologies is a huge bonus.

Benefits:

• We offer a one-time home office setup stipend.
• You will receive a monthly remote work enablement stipend.
• We provide professional development reimbursement.
• You will have access to wellbeing benefits (e.g., Headspace).
• We offer flexible paid time off, paid leave for new parents, and flexible work hours.
• Insurance is provided for all employees (term life, personal accident, medical) along with medical insurance for their dependents.
• Employees are eligible for stock options.