Description:

The position is for a Data Engineer with Experience.com, a company focused on enhancing experience management.
The role is remote and requires a minimum of 4 years of experience.
Responsibilities include designing, building, and maintaining scalable ETL/ELT pipelines using PySpark and SQL.
The engineer will work on data extraction, transformation, and loading processes from multiple sources into data warehouses like BigQuery.
The role involves leveraging GCP data analytics tools such as BigQuery, DataProc, and Cloud Functions for data processing and analysis.
The engineer will optimize data workflows for benchmarking, performance, and tuning to ensure efficiency and reliability.
Collaboration with engineering and analytics teams is essential to develop data integration solutions that meet business needs.
Ensuring data accuracy and quality through strong in-memory applications and database designs is a key responsibility.
The engineer will implement monitoring and alerting for pipelines and workflows to maintain data consistency and resolve issues.

Requirements:

Candidates must have 4+ years of experience with PySpark and SQL for building scalable ETL pipelines.
Strong proficiency in Python programming is required.
Knowledge of the GCP Data Analytics ecosystem, including BigQuery, PySpark, and SQL, is essential.
Experience with Airflow/Composer for workflow orchestration is necessary.
Candidates should have experience with in-memory applications, database design, and data integration.
Strong analytical thinking and problem-solving abilities are a must.
Familiarity with data pipeline mechanisms such as Kafka or Pub/Sub and Cloud Functions is preferred.
Hands-on experience with Elasticsearch and MongoDB is also preferred.

The position offers the opportunity to work remotely, providing flexibility in the work environment.
Employees will be part of a company that values experience and aims to drive impactful business outcomes.
The role allows for collaboration with engineering and analytics teams, enhancing professional growth and development.
Experience.com is backed by reputable investors, providing stability and growth potential for employees.
The company culture emphasizes the importance of every experience, contributing to a meaningful work atmosphere.