Description:

As a Founding Data Engineer at Hyperspell, you will take full ownership of our end-to-end data ingestion pipeline.
You will play a critical role in designing and implementing our data ingestion pipeline during the early stages of building our platform.
Your responsibilities will include defining the architecture, setting best practices, and establishing scalable processes for data ingestion, transformation, and storage.
You will design, build, and manage ETL pipelines that can handle data from multiple sources with high reliability and security.
You will work directly with tools like Apache NiFi, Airflow, and/or Flink to ensure data flows through our system, ready for efficient retrieval and analysis.
This role is ideal for someone with a strong background in building scalable ETL solutions at large companies or with early-stage startup experience.
You will be part of a small, talented team and have the freedom to set technical standards and make key decisions that will shape Hyperspell’s future.

Requirements:

You must have strong experience building production ETL pipelines, with demonstrated expertise in designing, implementing, and managing ETL processes at scale, ideally in large companies or high-volume environments.
Proficiency with Apache Flink, Airflow, and NiFi is required, along with hands-on experience in setting up and managing these tools to optimize data flow and orchestrate complex workflows.
You should possess knowledge of data transformation best practices, including skills in extracting, chunking, and preparing data for efficient retrieval and embedding.
Experience in scaling data infrastructure is necessary, including the ability to design and optimize data pipelines for scalability and setting up monitoring for high data volumes.
Strong problem-solving skills are essential, as you will need to navigate complex data integration challenges and make informed decisions about tools, architecture, and processes.
An early-stage startup mindset is required; you should be comfortable with ambiguity, excited about building foundational systems, and ready to take ownership of large parts of the data pipeline.

You will have the opportunity to work in a dynamic startup environment where your contributions will directly impact the company's future.
You will be part of a small, talented team, allowing for close collaboration and the ability to influence technical standards and decisions.
The role offers the chance to establish best practices and mentor future team members, contributing to a high-performance engineering culture.
You will have the freedom to innovate and implement your ideas in building a secure and efficient data access platform for AI applications.