Remote Senior Data Engineer - Pipelines de Datos en AWS
Posted
Apply now
Please, let DaCodes know you found this job
on RemoteYeah.
This helps us grow 🌱.
Description:
DaCodes is a high-impact software and digital transformation firm with over 10 years of experience.
The company has a team of more than 220 talented professionals, known as #DaCoders, who work on innovative technological solutions for clients in LATAM and the United States.
The position is for a Senior Data Engineer specializing in data ingestion and orchestration in AWS, data lake and data warehouse modeling, large-scale data processing, data quality assurance, and data governance.
The ideal candidate should have experience in building and automating data ingestion pipelines, data modeling in open-table formats, processing with Spark and Lambda, and experience in CI/CD and observability for data environments.
Responsibilities include building batch or micro-batch pipelines for event ingestion, automating specific campaign DAGs, modeling data in partitioned open-table formats, performing ELT loads, developing data transformations, implementing data quality tests, managing infrastructure pipelines, ensuring data security and governance, and exposing semantic models for BI tools.
Requirements:
Proven experience in AWS native architectures for data ingestion and orchestration is required.
Advanced knowledge of tools and services for large-scale data processing, including Spark, Lambda, and Kinesis, is necessary.
Solid understanding of open-table data modeling and data lake and data warehouse architectures is essential.
Proficiency in programming with Python or Scala for ETL/ELT and transformations is required.
Experience in data quality assurance and continuous monitoring using tools like Great Expectations and Datadog is necessary.
Knowledge of cloud security, encryption, and data governance is required.
Proficiency in English is preferred for effective technical communication with international teams, but it is not mandatory.
Desirable skills include automatic pipeline generation using Terraform or CDK, experience with real-time feature serving systems, competence in FinOps, designing schemas for gamification and ad-tech, and knowledge of experimentation frameworks.
Benefits:
Work with global brands and disruptive startups.
Remote work or home office options are available.
If hybrid or in-person work is required, this will be communicated from the first session.
Flexible working hours according to the assigned project or team.
Work schedule is from Monday to Friday.
Legal benefits apply for employees in Mexico.
A day off on your birthday is provided.
Major medical expenses insurance is available for employees in Mexico.
Life insurance is provided for employees in Mexico.
Work in multicultural teams.
Access to courses and certifications is offered.
Participate in meetups with special guests from the IT field.
Engage in virtual integration events and interest groups.
English classes are available.
Opportunities for advancement within various business lines are provided.
The company is proudly certified as a Great Place to Work.
Apply now
Please, let DaCodes know you found this job
on RemoteYeah
.
This helps us grow 🌱.