Remote Senior Data Engineer (GCP/Databricks)

at leadtech

Posted 1 day ago 0 applied

Description:

  • We are looking for a Senior Data Engineer to design, develop, and optimize our data infrastructure on Google Cloud Platform (GCP).
  • You will architect scalable pipelines using Databricks, BigQuery, Google Cloud Storage, Apache Airflow, dbt, Dataflow, and Pub/Sub, ensuring high availability and performance across our ETL/ELT processes.
  • You will leverage great expectations to enforce data quality standards.
  • The role also involves building our Data Mart (Data Mach) environment, containerizing services with Docker and Kubernetes (K8s), and implementing CI/CD best practices.
  • A successful candidate has extensive knowledge of cloud-native data solutions, strong proficiency with ETL/ELT frameworks (including dbt), and a passion for building robust, cost-effective pipelines.

Requirements:

  • You must have 3+ years of professional experience in data engineering, with at least 1 year in mobile data.
  • A proven track record building and maintaining BigQuery environments and Google Cloud Storage-based data lakes is required.
  • You should have deep knowledge of Apache Airflow for scheduling/orchestration and ETL/ELT design.
  • Experience implementing dbt for data transformations, RabbitMQ for event-driven workflows, and Pub/Sub + Dataflow for streaming/batch data pipelines is necessary.
  • Familiarity with designing and implementing Data Mart (Data Mach) solutions, as well as using Terraform for Infrastructure as Code (IaC) is expected.
  • Strong coding capabilities in Python, Java, or Scala, plus scripting for automation are essential.
  • You should have experience with Docker and Kubernetes (K8s) for containerizing data-related services.
  • Hands-on experience with CI/CD pipelines and DevOps tools (e.g., Terraform, Ansible, Jenkins, GitLab CI) to manage infrastructure and deployments is required.
  • Proficiency in Great Expectations (or similar) to define and enforce data quality standards is necessary.
  • Expertise in designing systems for data lineage, metadata management, and compliance (GDPR, CCPA) is expected.
  • A strong understanding of OLTP (Online Transaction Processing) and OLAP (Online Analytical Processing) systems is required.
  • Excellent communication skills for both technical and non-technical audiences are essential.
  • A high level of organization, self-motivation, and problem-solving aptitude is necessary.

Benefits:

  • At Leadtech, we prioritize your growth with a flexible career path, personalized internal training, and an annual budget for external learning opportunities.
  • You will benefit from a flexible schedule with flextime and the option of working fully remote or from our Barcelona office, along with free Friday afternoons and a 35-hour workweek in July and August.
  • We offer a competitive salary, full-time permanent contract, and top-tier private health insurance (including dental and psychological services).
  • You will receive 25 days of vacation plus your birthday off, with flexible vacation options and no blackout days.
  • If you choose to work in our Barcelona office, you will enjoy free coffee, fresh fruit, snacks, a game room, and a rooftop terrace with stunning Mediterranean views.
  • Additional benefits include ticket restaurant and nursery vouchers, paid directly from your gross salary.