Description:

The Staff Data Engineer will be responsible for building and maintaining highly scalable, reliable, and efficient data pipelines for both inbound and outbound messaging stacks.
They will also work on internal engineering solutions, providing data insights interfaces for real-time decision-making.
Responsibilities include overseeing the design, construction, testing, and maintenance of advanced data architectures and pipelines.
The role involves driving the development of innovative data solutions, creating and enforcing best practices for data architecture, and providing mentorship to junior engineers.
The Staff Data Engineer will collaborate with senior leadership, participate in long-term planning for data infrastructure, lead cross-functional projects, and ensure timely delivery aligned with business objectives.
They will also coordinate with stakeholders to define project requirements, scope, and continuously monitor and enhance the performance of data systems and pipelines.

Requirements:

3+ years of Java development experience.
5+ years of experience with Big Data processing tools like Apache Spark, SparkSQL.
Experience with Lakehouse technologies such as Apache Hudi, Apache Iceberg, Databricks Delta Lake.
Proficiency in building AI/ML pipelines and deep technical understanding of ETL tools, low-latency data stores, data warehouses, and data catalogs.
Familiarity with data testing and verification tooling, cloud services (preferably AWS), Key-Value, Streaming, and Search Database technologies.
Readiness to participate in the on-call rotation.