Description:

Bodo is redefining what’s possible with Python for analytics, data engineering, and AI by developing the world’s first auto-parallelizing Python compiler.
The company aims to deliver HPC-level performance and efficiency for large-scale data processing.
Bodo's technology empowers organizations to achieve new levels of efficiency, speed, and accuracy in data analytics and AI.
The Senior Software Engineer will serve as the Technical Lead, focusing on designing, developing, and maintaining data pipelines that integrate data infrastructure and AI training infrastructure.
Responsibilities include architecting a Python package for creating scalable pipelines from raw data to trained AI models, which involves data filtering, cleaning, visualization, synthetic data creation, and ML training integration.
The role requires working with large datasets to develop both generic and fine-tuned AI models, particularly LLMs, using the developed package.
Continuous improvement of the package by incorporating state-of-the-art techniques and frameworks is expected.

Requirements:

Candidates must have 10+ years of experience in data engineering or similar roles, with a strong background in designing and implementing complex AI and ML solutions.
Proficiency in building large-scale data processing pipelines with AI training is required, along with familiarity with distributed workloads such as multiprocessing, MPI, Ray, Dask, and Spark.
Experience in developing end-to-end pipelines for model training, including handling structured and unstructured data, cleaning, creating synthetic data, and actual training is essential.
Familiarity with AI technologies throughout the training journey, particularly with Pytorch, Horovod, and Tensorflow, is necessary.
Candidates should demonstrate the ability to take extreme ownership over their work and possess excellent problem-solving and communication skills.
Active contributions to GitHub are considered a significant plus.
Experience in building data pipelines specifically for ML training, ideally using Ray, is a must.

Bodo offers comprehensive health, dental, and vision insurance plans to its employees.
Employees receive the latest Apple MacBook equipment to support their work.
Generous employee equity awards are provided, allowing employees to share in Bodo’s success.
The company offers paid parental leave and flexible remote work options.
A 401K plan and HSA are available for financial and healthcare needs.
Employees have access to training and learning opportunities that align with their career growth.