Remote Senior Data Engineer - Pipelines de Datos en AWS

Posted

Apply now
Please, let DaCodes know you found this job on RemoteYeah. This helps us grow 🌱.

Description:

  • DaCodes is a high-impact software and digital transformation firm with over 10 years of experience.
  • The company has a team of more than 220 talented professionals, known as #DaCoders, who work on innovative technological solutions for clients in LATAM and the United States.
  • The position is for a Senior Data Engineer specializing in data ingestion and orchestration in AWS, data lake and data warehouse modeling, large-scale data processing, data quality assurance, and data governance.
  • The ideal candidate should have experience in building and automating data ingestion pipelines, data modeling in open-table formats, processing with Spark and Lambda, and experience in CI/CD and observability for data environments.
  • Responsibilities include building batch or micro-batch pipelines for event ingestion, automating specific campaign DAGs, modeling data in partitioned open-table formats, performing ELT loads, developing data transformations, implementing data quality tests, managing infrastructure pipelines, ensuring data security and governance, and exposing semantic models for BI tools.

Requirements:

  • Proven experience in AWS native architectures for data ingestion and orchestration is required.
  • Advanced knowledge of tools and services for large-scale data processing, including Spark, Lambda, and Kinesis, is necessary.
  • Solid understanding of open-table data modeling and data lake and data warehouse architectures is essential.
  • Proficiency in programming with Python or Scala for ETL/ELT and transformations is required.
  • Experience in data quality assurance and continuous monitoring using tools like Great Expectations and Datadog is necessary.
  • Knowledge of cloud security, encryption, and data governance is required.
  • Proficiency in English is preferred for effective technical communication with international teams, but it is not mandatory.
  • Desirable skills include automatic pipeline generation using Terraform or CDK, experience with real-time feature serving systems, competence in FinOps, designing schemas for gamification and ad-tech, and knowledge of experimentation frameworks.

Benefits:

  • Work with global brands and disruptive startups.
  • Remote work or home office options are available.
  • If hybrid or in-person work is required, this will be communicated from the first session.
  • Flexible working hours according to the assigned project or team.
  • Work schedule is from Monday to Friday.
  • Legal benefits apply for employees in Mexico.
  • A day off on your birthday is provided.
  • Major medical expenses insurance is available for employees in Mexico.
  • Life insurance is provided for employees in Mexico.
  • Work in multicultural teams.
  • Access to courses and certifications is offered.
  • Participate in meetups with special guests from the IT field.
  • Engage in virtual integration events and interest groups.
  • English classes are available.
  • Opportunities for advancement within various business lines are provided.
  • The company is proudly certified as a Great Place to Work.
Apply now
Please, let DaCodes know you found this job on RemoteYeah . This helps us grow 🌱.
About the job
Report this job

Job expired or something else is wrong with this job?

Report this job
Leave a feedback