Description:

The Senior Data Engineer will be responsible for maintaining, extending, and improving existing data/ML workflows, as well as implementing new ones to handle high-velocity data.
They will provide interfaces and systems for ML engineers and researchers to build datasets on demand and influence data storage and processing strategies.
Collaboration with the ML team, frontend, and backend teams to enhance the data platform will be a key aspect of the role.
The Senior Data Engineer will focus on reducing time-to-deployment for dashboards and ML models, establishing best practices, and developing pipelines for efficient dataset building and usage.
Working with large datasets under performance constraints similar to those at major companies and iterating quickly to deploy new products or features to millions of users will also be part of the responsibilities.

Requirements:

The ideal candidate should be thoughtful, conscientious, and self-directed.
They must have experience with data engineering services on major cloud providers and a minimum of 3 years of experience in a data role involving designing and building data stores, feature engineering, and reliable data pipelines handling high loads.
Proven ability to make independent decisions on data processing strategy and architecture is required.
At least 2 years of professional software development experience in a role other than data engineering is necessary.
Significant experience in coding and developing in Python, building and maintaining distributed data pipelines, working with Kafka infrastructure and applications, and a deep understanding of SQL and NoSQL databases (preferably Clickhouse) are essential.
Familiarity with public cloud providers (AWS or Azure), experience with CI/CD and orchestration platforms (Kubernetes, containerization, and microservice design), and understanding of distributed systems and architectures are also required.

This position offers a fully remote work setup with flexible working hours.
The Senior Data Engineer will be part of an inspiring team of colleagues spread worldwide.
They will enjoy modern development and deployment workflows, emphasizing shipping early and often.
The role promises high impact with lots of users, happy customers, high growth, and cutting-edge R&D.
The organization has a flat structure, allowing direct interaction with customer teams, and is committed to creating an inclusive environment for all team members.