Remote Senior Data Engineer (Databricks)

Description:

• Fluent is building the next generation advertising network, Partner Monetize & Advertiser Acquisition, with a vision to create an ML/AI first network of advertisers and publishers to enhance relevancy in E-commerce for everyday shoppers.
• As a Senior Data Engineer, you will utilize your Databricks and Spark expertise to develop enterprise-grade data products that support Fluent’s business lines.
• These data products will provide sophisticated representations of customer journeys and marketplace activity across the ecosystem.
• You will collaborate with Data Architects, Data Scientists, and Product Managers to convert Enterprise Data Models into optimized physical data models and real-time pipelines.
• The role involves elevating standards in code quality, observability, and architecture design while actively contributing as a hands-on engineer.
• This position is fully remote in Ontario, with occasional travel to NYC or Toronto offices.

Requirements:

• You must have 5+ years of experience in Data Engineering, with strong expertise in Spark (PySpark) and SQL.
• A minimum of 3+ years of hands-on experience building pipelines on Databricks, including Workflows, Notebooks, and Delta Lake, is required.
• A deep understanding of the Apache Spark distributed processing model and its internals is essential.
• Strong experience with streaming data architectures and event-driven processing using Kafka is necessary.
• Familiarity with Databricks metrics, observability, and monitoring features is expected.
• You should have an understanding of Unity Catalog and Lakehouse architecture.
• Knowledge of idempotent processing patterns and robust data modeling is required.
• Proficiency in Git-based, CI/CD-driven development workflows is necessary.
• Strong debugging, optimization, and performance tuning skills are essential.
• Proven experience in building large-scale data pipelines that handle massive volumes of data is required.

Benefits:

• Competitive compensation is offered for this position.
• Ample career and professional growth opportunities are available.
• The new headquarters features an open floor plan designed to enhance collaboration.
• Health, dental, and vision insurance are provided.
• Pre-tax savings plans and transit/parking programs are included.
• A 401K plan with a competitive employer match is available.
• Opportunities for volunteer and philanthropic activities throughout the year are encouraged.
• Educational and social events are organized regularly.
• You will have the amazing opportunity to work for a high-flying performance marketing company.