Description:

Wizard is seeking a Senior Data Engineer to enhance its data collection, storage, and analysis capabilities.
This role is critical for strengthening the data infrastructure to support data-driven decision making and growth initiatives.
Responsibilities include developing and maintaining scalable data infrastructure for batch and real-time data processing, building and optimizing ETL pipelines, collaborating with data scientists and cross-functional teams, designing backend data solutions for microservices architecture, and managing integrations with third-party e-commerce platforms.

Requirements:

Candidates must have 5+ years of professional experience in software development with a strong focus on data engineering.
A Bachelor's degree in Computer Science or a related field, or equivalent practical experience is required.
Proficiency in Python and experience implementing software engineering best practices are necessary.
Strong expertise in building ETL pipelines using tools such as Apache Spark, Databricks, or Hadoop is required, with Spark experience being mandatory.
A solid understanding of distributed computing and data modeling for scalable systems is essential.
Hands-on experience with NoSQL databases like MongoDB, Cassandra, DynamoDB, or CosmosDB is required.
Proficiency in real-time stream processing systems such as Kafka, AWS Kinesis, or GCP Data Flow is necessary.
Experience with Delta Lake, Parquet files, and cloud platforms (AWS, GCP, or Azure) is required.
Familiarity with caching and search technologies such as Redis, Elasticsearch, or Solr is preferred.
Knowledge of message queuing systems like RabbitMQ, AWS SQS, or GCP Cloud Tasks is necessary.
Candidates should advocate for Test-Driven Development (TDD) and be experienced in using version control tools like GitHub or Bitbucket.

The expected salary for this role ranges from $165,000 to $210,000, depending on experience and level.
Employees will have the opportunity to work remotely from anywhere in the USA.
Joining Wizard means being part of a dynamic team that is revolutionizing the shopping experience through innovative technology.