Description:

Join the Data Foundry team as a Data Engineer, bridging model training and data annotation teams.
Build pipelines and infrastructure to transform raw data into high-quality datasets for AI.

Requirements:

3+ years of experience in data engineering.
Degree in Computer Science, Data Engineering, or equivalent technical background.
Solid understanding of the ML training lifecycle and dataset suitability for model training.
Familiarity with layered data architecture patterns (e.g., Medallion Architecture).
Proficiency in Python for data manipulation and pipeline development.
Experience with workflow orchestration tools (e.g., Airflow, Prefect).
Knowledge of distributed data processing (e.g., Spark, Databricks).
Strong SQL skills for data modeling and query optimization.
Experience with streaming systems (e.g., Kafka, Kinesis).

Skills