Description:

We are seeking a talented Scala Spark Application Developer to join our early-stage startup team and drive the core development of our platform's dataplane.
This role focuses on building a sophisticated product platform rather than typical services or project-based work.
You will design and develop the dataplane of our platform, which is a cutting-edge Spark-based analytics engine with embedded inductive learning capabilities.
The position involves architecting and implementing the mathematical and computational core that powers our anomaly detection algorithms.
You will work with complex statistical models, real-time data processing, and concurrent systems that operate at enterprise scale across multiple cloud environments.
Your responsibilities include designing and implementing the core dataplane architecture, developing statistical algorithms, building high-performance data processing pipelines, and optimizing query performance.
You will also establish best practices for functional programming and mentor team members on Scala and Spark optimization techniques.
Collaboration with the CTO and customers is essential to embed statistical models into the Spark execution engine.

Requirements:

A minimum of 3 years of experience with Scala development and distributed systems is required.
You must have at least 2 years of hands-on experience with Apache Spark development.
A strong background in statistics, linear algebra, and mathematical analysis is necessary.
Advanced SQL skills with experience in query optimization and performance tuning are required.
Proficiency in asynchronous and concurrent programming patterns in Scala is essential.
A deep understanding of functional programming concepts and their practical application is needed.
Experience with large-scale data processing, ETL pipelines, and data quality frameworks is required.
Familiarity with multiple datastores such as PostgreSQL, Snowflake, and RedShift is necessary.
Proficiency with Git and collaborative development workflows is required.

We offer a competitive salary and equity to attract great talent.
Employees enjoy unlimited vacation, allowing them to take the time they need without the stress of missing important meetings.
Comprehensive benefits package including medical, dental, and vision insurance is provided.
You will work with a passionate and dedicated team in a fun environment.
The company promotes a culture of collaboration and ongoing professional development.