Description:

Join Baseten, a company revolutionizing AI deployment with cutting-edge inference infrastructure.
The company is backed by premier investors and trusted by leading enterprises and AI-driven innovators.
As a Senior Infrastructure Software Engineer, you will architect and lead the development of the ML inference platform that powers production AI applications.
You will make key technical decisions for the infrastructure enabling developers to deploy, scale, and monitor ML models with high performance and reliability.
Responsibilities include designing scalable infrastructure systems, optimizing Kubernetes deployments, enhancing the inference orchestration layer, defining monitoring strategies, developing GPU capacity management solutions, establishing automation standards, and mentoring junior engineers.

Requirements:

A Bachelor's degree or higher in Computer Science or a related field is required.
A minimum of 5 years of experience building production infrastructure systems is necessary.
Expert-level proficiency in Go is required, with Python experience being a plus.
Deep expertise with Kubernetes in production environments is essential.
Extensive experience with major cloud providers (AWS, GCP) and neo-cloud providers (Crusoe, DigitalOcean, Nebius) is a plus.
An advanced understanding of distributed systems concepts and performance tuning is required.
Proven experience designing observability systems is necessary.
A track record of leading technical initiatives and mentoring engineers is essential.
Experience with ML/AI workloads and MLOps platforms is highly valued.

The position offers a competitive compensation package, including unlimited PTO, 401k, covered healthcare premiums, and a remote-first culture.
You will have a unique opportunity to be part of a rapidly growing startup in an exciting engineering field.
The company promotes an inclusive and supportive work culture that fosters learning and growth.
You will gain exposure to a variety of ML startups, providing unparalleled learning and networking opportunities.