Remote Senior Data Engineer

Description:

• Udacity, now an Accenture company, is on a mission to transform talent in digital technologies through an immersive online learning platform.
• The Data Engineering Team is seeking a Senior Data Engineer to design and develop company-wide data solutions.
• The ideal candidate will collaborate with data analysts, data scientists, and business stakeholders to understand and generalize data for common fact tables.
• This role is part of a global Data Team consisting of Software Engineers, Data Analysts, and Data Scientists primarily located in India and North America.
• The system involves a cloud-based data lake built on AWS, utilizing technologies such as Apache Spark, Airflow, Postgres, and Redshift.
• Responsibilities include designing infrastructure and tools for data, analytics, and reporting, generalizing data points for multi-dimensional data stores, and building a lakehouse for analytics and AI use cases.
• The candidate will work with stakeholders to translate requirements into engineering solutions and promote effective agile software development practices.

Requirements:

• A BS or MS in Computer Science, MIS, or related degrees is required.
• A minimum of 6 years of experience in the software industry, with at least 3 years in data engineering, is necessary.
• Solid understanding and experience with Agile software development methodologies, including test-driven development, are essential.
• A good understanding of building robust data processing pipelines and a proven track record of implementation is required.
• The candidate must have the ability to trace, identify, and resolve issues in data, infrastructure, and code.
• Hands-on experience with Apache Spark, cloud data storage, and relational databases is required.
• Experience working on cloud platforms, preferably AWS, is necessary.
• Proficiency in Python, Scala, and SQL is required.
• Experience with generative AI is desired.
• Experience working with remote teams based in the US or Europe is a strong plus.

Benefits:

• Udacity offers the flexibility of working from home, with in-person collaboration spaces in Mountain View, Cairo, Dubai, and Noida.
• Flexible working hours are provided.
• Paid time off is included.
• Comprehensive medical insurance coverage is available for employees and their dependents.
• Employee wellness resources and initiatives, including access to wellness platforms like Headspace, are offered.
• A quarterly wellness day off is provided.
• Personalized career development opportunities are available.
• Employees have unlimited access to Udacity Nanodegrees.