Description:

The Data Engineer will participate in the migration of Datastage jobs to Snowpark.
Responsibilities include reverse engineering the logic of existing Datastage jobs and accurately translating them into Snowpark.
The role requires performing thorough unit testing of developed Snowpark code to ensure functionality and data quality.
The engineer will use Airflow for the orchestration of Snowpark jobs.
Unit testing and parallel run testing will be performed, comparing the output of migrated Snowpark jobs with the original Datastage jobs using production data in the development environment.
Documentation of developed code and processes is required.
The position is remote and requires effective collaboration within the India Time Zone.

Requirements:

A Bachelor's degree in Computer Science, Engineering, or a related field is required.
The candidate must have 5 years of experience in Snowflake and at least 24 months of experience in Snowpark.
Experience with Airflow is necessary.
Familiarity with Snowflake on Azure is required.
The candidate should have experience with at least one ETL/ELT tool, with Datastage experience being a significant plus.
A solid understanding of SQL and data warehousing concepts is essential.
Familiarity with scripting languages such as Python is required.
The ability to understand and translate existing data processing logic is necessary.
Strong problem-solving and analytical skills are required.
Excellent communication and collaboration skills are essential, as the candidate will be working in a remote team environment.
The ability to work independently and manage tasks effectively within deadlines is required.

The position offers the flexibility of remote work.
The role allows for collaboration within a dynamic team environment.
Employees will have the opportunity to work with cutting-edge technologies in cloud data services.
The position provides a chance to enhance skills in Snowflake and Snowpark through hands-on experience.
The role supports professional growth and development in the field of data engineering.