Welcome to RemoteYeah 2.0! Find out more about the new version here.

Remote Senior Data Engineer (Databricks)

at Fluent, LLC

Posted 11 hours ago 4 applied

Description:

  • Fluent is building the next generation advertising network, Partner Monetize & Advertiser Acquisition, with a vision to create an ML/AI first network of advertisers and publishers to enhance relevancy in E-commerce for everyday shoppers.
  • As a Senior Data Engineer, you will utilize your Databricks and Spark expertise to develop enterprise-grade data products that support Fluent’s business lines.
  • These data products will provide sophisticated representations of customer journeys and marketplace activity across the ecosystem.
  • You will collaborate with Data Architects, Data Scientists, and Product Managers to convert Enterprise Data Models into optimized physical data models and real-time pipelines.
  • The role involves elevating standards in code quality, observability, and architecture design while actively contributing as a hands-on engineer.
  • This position is fully remote in Ontario, with occasional travel to NYC or Toronto offices.

Requirements:

  • You must have 5+ years of experience in Data Engineering, with strong expertise in Spark (PySpark) and SQL.
  • A minimum of 3+ years of hands-on experience building pipelines on Databricks, including Workflows, Notebooks, and Delta Lake, is required.
  • A deep understanding of the Apache Spark distributed processing model and its internals is essential.
  • Strong experience with streaming data architectures and event-driven processing using Kafka is necessary.
  • Familiarity with Databricks metrics, observability, and monitoring features is expected.
  • You should have an understanding of Unity Catalog and Lakehouse architecture.
  • Knowledge of idempotent processing patterns and robust data modeling is required.
  • Proficiency in Git-based, CI/CD-driven development workflows is necessary.
  • Strong debugging, optimization, and performance tuning skills are essential.
  • Proven experience in building large-scale data pipelines that handle massive volumes of data is required.

Benefits:

  • Competitive compensation is offered for this position.
  • Ample career and professional growth opportunities are available.
  • The new headquarters features an open floor plan designed to enhance collaboration.
  • Health, dental, and vision insurance are provided.
  • Pre-tax savings plans and transit/parking programs are included.
  • A 401K plan with a competitive employer match is available.
  • Opportunities for volunteer and philanthropic activities throughout the year are encouraged.
  • Educational and social events are organized regularly.
  • You will have the amazing opportunity to work for a high-flying performance marketing company.