Remote Lead Data Engineer

Description:

• Experian is a global data and technology company that empowers opportunities for individuals and businesses worldwide.
• The company operates across various markets, including financial services, healthcare, automotive, agribusiness, and insurance.
• The Lead Data Engineer will join the Ascend Cloud Foundation Platform team and report to the Senior Client Delivery Manager.
• The role involves leading an Agile technical team, building data pipelines and data lakes, and delivering quality software.
• Responsibilities include collaborating with risk, security, and compliance teams to ensure adherence to regulatory requirements, understanding overlapping technical requirements, and owning the codebase and technical applications.

Requirements:

• Candidates must have strong experience with DevOps and Infrastructure as Code (IaC) tooling, including Terraform, CI/CD pipelines, Git, and Jenkins.
• A strong background in developing on Apache Spark and Hadoop is required.
• Candidates should have extensive experience with AWS cloud services, including AWS Glue, S3, and Step Functions.
• Experience in building data pipelines and data lakes is essential.
• Familiarity with the full development lifecycle and application lifecycle management tools such as BitBucket and Jira is necessary.
• Significant programming experience in Scala or Python is required, along with knowledge of configuration as code principles and API integration.
• The ability to explain technical solutions to both technical and non-technical audiences is important.
• Candidates must be able to write clean, scalable, and reusable code that adheres to SOLID principles and common design patterns.
• The ability to analyze and compare large data sets is required.
• Experience with AWS services such as Functions, Lambdas, EventBridge, SQS, and Lake Formation is necessary.
• Familiarity with automated testing methodologies is also required.

Benefits:

• The position offers hybrid working arrangements.
• A competitive compensation package and discretionary bonus are included.
• Core benefits encompass a pension plan, Bupa healthcare, a sharesave scheme, and more.
• Employees receive 25 days of annual leave, 8 bank holidays, and 3 volunteering days, with the option to purchase additional leave.
• Experian promotes a people-first culture that emphasizes diversity, equity, inclusion, work/life balance, development, and wellness.
• The company has received multiple awards for its workplace culture, including recognition as one of the World's Best Workplaces™ and Great Place To Work™ in various countries.