Description:

Join Baseten, a company revolutionizing AI deployment with cutting-edge inference infrastructure.
Work in a dynamic team backed by premier investors and trusted by leading enterprises and AI-driven innovators.
As a Senior Infrastructure Software Engineer, you will architect and lead the development of the ML inference platform that powers production AI applications.
Make key technical decisions for the infrastructure enabling developers to deploy, scale, and monitor ML models with high performance and reliability.
Responsibilities include designing scalable infrastructure systems, optimizing Kubernetes deployments, enhancing inference orchestration, defining monitoring strategies, developing GPU capacity management solutions, establishing automation standards, and mentoring junior engineers.

Requirements:

A Bachelor's degree or higher in Computer Science or a related field is required.
A minimum of 5 years of experience building production infrastructure systems is necessary.
Expert-level proficiency in Go is required, with Python experience being a plus.
Deep expertise with Kubernetes in production environments is essential.
Extensive experience with major cloud providers (AWS, GCP) and neo-cloud providers (Crusoe, DigitalOcean, Nebius) is a plus.
An advanced understanding of distributed systems concepts and performance tuning is required.
Proven experience designing observability systems is necessary.
A track record of leading technical initiatives and mentoring engineers is essential.
Experience with ML/AI workloads and MLOps platforms is highly valued.

Enjoy a competitive compensation package that includes unlimited PTO, a 401k plan, covered healthcare premiums, and a remote-first culture.
Be part of a rapidly growing startup in one of the most exciting engineering fields of our era.
Experience an inclusive and supportive work culture that fosters learning and growth.
Gain exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.