The position is for a Lead Data Engineer with over 10 years of experience in Data Engineering and Data Analysis.
The candidate must have hands-on experience with the Hadoop Stack of Technologies, including Hadoop, PySpark, HBase, Hive, Pig, Sqoop, Scala, Flume, HDFS, and Map Reduce.
Proficiency in Python and Kafka is required.
A good understanding of database concepts, data design, data modeling, and ETL processes is essential.
The role involves analyzing, designing, and coding ETL programs, which include data pre-processing, data extraction, data ingestion, data quality, data normalization, and data loading.
Experience in delivering projects using Agile methodology and familiarity with Jira is necessary.
The candidate should have experience in client-facing roles, demonstrating good communication and thought leadership skills to coordinate deliverables across the Software Development Life Cycle (SDLC).
A good understanding of machine learning models and artificial intelligence is preferred.
Familiarity with data components, data processing, and data analytics on AWS is a plus.
Experience with data modeling tools like Erwin is also beneficial.
A Master's or Bachelor's degree in computer science or equivalent fields is required.
Requirements:
Candidates must have 10+ years of experience in Data Engineering and Data Analysis.
Hands-on experience with the Hadoop Stack of Technologies is mandatory.
Proficiency in Python and Kafka is required.
A solid understanding of database concepts, data design, data modeling, and ETL processes is essential.
Experience in analyzing, designing, and coding ETL programs is necessary.
Familiarity with Agile methodology and Jira is required.
Candidates should have experience in client-facing roles with strong communication and leadership skills.
A good understanding of machine learning models and artificial intelligence is preferred.
Knowledge of data components, data processing, and data analytics on AWS is a plus.
Experience with data modeling tools like Erwin is beneficial.
A Master's or Bachelor's degree in computer science or equivalent fields is required.
Benefits:
The job offers an opportunity to work with advanced data technologies and methodologies.
Candidates will gain experience in a client-facing role, enhancing their communication and leadership skills.
The position allows for involvement in Agile project delivery, providing a dynamic work environment.
There is potential for professional growth and development in the fields of data engineering and analysis.
The role may provide exposure to machine learning and artificial intelligence, expanding the candidate's skill set.
Working with AWS data components and analytics can enhance technical expertise in cloud technologies.
