Description:

Design and develop scalable and reliable data pipelines to ensure high availability and performance.
Construct intricate data sets aligning with functional and non-functional business requirements.
Identify, plan, and implement process enhancements like automation, data delivery optimization, and infrastructure redesign.
Implement best practices for data storage, processing, and retrieval.
Collaborate with stakeholders to understand data requirements and implement solutions.
Optimize data workflows for performance and efficiency.
Maintain data security and compliance with privacy regulations.
Stay updated on emerging technologies and industry trends.
Mentor junior data engineers in the team.

Requirements:

Bachelor's or Master's degree in computer science, engineering, or related field.
Minimum 7 years of industry experience as a data engineer.
Strong programming skills in Python, Scala, or Java.
Experience with Apache Kafka, Apache Spark, or AWS Glue for data pipelines.
Proficiency in SQL and databases like PostgreSQL, MySQL, or MongoDB.
Knowledge of cloud platforms, especially Azure.
Familiarity with data modeling, ETL processes, and data warehousing.
Strong problem-solving and troubleshooting abilities.
Excellent communication and collaboration skills.
Ability to work effectively in cross-functional teams.
Detail-oriented and proactive mindset.