Fluent is building the next generation advertising network, Partner Monetize & Advertiser Acquisition, with a vision to create an ML/AI first network of advertisers and publishers to enhance relevancy in E-commerce for everyday shoppers.
As a Senior Data Engineer, you will utilize your Databricks and Spark expertise to develop enterprise-grade data products that support Fluent’s business lines.
These data products will provide sophisticated representations of customer journeys and marketplace activity across the ecosystem.
You will collaborate with Data Architects, Data Scientists, and Product Managers to convert Enterprise Data Models into optimized physical data models and real-time pipelines.
The role involves elevating standards in code quality, observability, and architecture design while actively contributing as a hands-on engineer.
This position is fully remote in Ontario, with occasional travel to NYC or Toronto offices.
Requirements:
You must have 5+ years of experience in Data Engineering, with strong expertise in Spark (PySpark) and SQL.
A minimum of 3+ years of hands-on experience building pipelines on Databricks, including Workflows, Notebooks, and Delta Lake, is required.
A deep understanding of the Apache Spark distributed processing model and its internals is essential.
Strong experience with streaming data architectures and event-driven processing using Kafka is necessary.
Familiarity with Databricks metrics, observability, and monitoring features is expected.
You should have an understanding of Unity Catalog and Lakehouse architecture.
Knowledge of idempotent processing patterns and robust data modeling is required.
Proficiency in Git-based, CI/CD-driven development workflows is necessary.
Strong debugging, optimization, and performance tuning skills are essential.
Proven experience in building large-scale data pipelines that handle massive volumes of data is required.
Benefits:
Competitive compensation is offered for this position.
Ample career and professional growth opportunities are available.
The new headquarters features an open floor plan designed to enhance collaboration.
Health, dental, and vision insurance are provided.
Pre-tax savings plans and transit/parking programs are included.
A 401K plan with a competitive employer match is available.
Opportunities for volunteer and philanthropic activities throughout the year are encouraged.
Educational and social events are organized regularly.
You will have the amazing opportunity to work for a high-flying performance marketing company.
