Description:

Tecton helps companies unlock the full potential of their data for AI applications by streamlining the complex process of preparing and delivering data to models.
The company is funded by Sequoia Capital, Andreessen Horowitz, and Kleiner Perkins, with strategic investments from Snowflake and Databricks.
Tecton has a fast-growing, distributed team with offices in San Francisco and New York City, comprising experienced professionals from leading tech companies.
The company is building Rift, a fully managed compute environment for data scientists to construct powerful batch and streaming pipelines in Python, leveraging popular open-source technologies.
As a staff-level engineer on the Batch Compute team, the role involves architecting, designing, and scaling core compute engines and storage architecture for Tecton customers.
Responsibilities include owning large technical domains, leading multi-engineer projects, improving engineering practices, and developing a deep understanding of customer challenges in building ML systems.
The position requires versatility as the engineering team is small but growing.

Requirements:

Candidates must have experience working in large Python, Java, Kotlin, or Go codebases and running cloud-native Spark systems such as AWS EMR, Databricks, or GCP Dataproc.
Experience in performance tuning of Spark, Ray, Maestro, or Airflow jobs is required.
Knowledge of data formats like Parquet, Avro, Arrow, Iceberg, or Delta Lake and object storage such as S3 or GCS is necessary.
Expertise in cloud-scale query performance, query optimization, query planning, heuristic query execution techniques, and cost-driven optimizations is essential.
Candidates should have experience with the internals of distributed systems, SQL/NoSQL databases, data lakes, or data warehouses.
Strong communication skills and the ability to write detailed technical specifications are required.
Candidates should be excited about coaching and mentoring junior engineers.
A BSc, MS, or PhD in Computer Science or related fields is required.
A minimum of 8 years of experience in building product software systems and 5 years of technical leadership experience for a group of engineers is necessary.

Tecton values diversity and is committed to creating an inclusive environment for all employees and applicants.
The company provides accommodations upon request during the application and interview process.
Tecton participates in E-Verify and will provide the federal government with Form I-9 information to confirm work authorization in the U.S.