Description:

The position is for a Staff Software Engineer specializing in Big Data and Generative AI, located in the United States and available for remote work.
The role involves being a thought leader and innovator, driving the vision for various products and platforms, and designing and launching strategic machine learning solutions.
Responsibilities include leading the end-to-end software development lifecycle, which encompasses design, testing, deployment, and operations.
The engineer will lead technical discussions, participate in design and code reviews, and implement solutions.
The role requires crafting high-performance Big Data Lakehouse architectures such as Hudi, Delta, or Iceberg.
The engineer will develop a Big Data Platform to address big data pipeline and processing challenges.
Mentoring and developing other engineers on the team, establishing technical direction, and fostering team culture are key aspects of the role.
The position emphasizes upholding high standards of technical rigor and operational excellence, building resilient and scalable systems, and championing process improvements.

Requirements:

A degree in mathematics, computer science, or a related discipline is required.
Candidates must have 5+ years of experience in the complete software development lifecycle, including design, coding, code reviews, testing, build processes, deployments, and operations.
A minimum of 4 years of experience in Spark/PySpark with in-depth knowledge of its advanced features and libraries is necessary.
Candidates should have at least 3 years of experience with Data Lakehouse solutions such as Hudi, Iceberg, or Delta, along with in-depth knowledge of their advanced features and libraries.
A minimum of 2 years of experience in leading the design and architecture of large distributed systems, preferably on cloud platforms like AWS, Azure, or Google Cloud, is required.
Proficiency in Docker, Kubernetes, and modern CI/CD practices is essential.

The company fosters an inclusive workplace that embraces diversity and creates an atmosphere where all employees can thrive.
Employees are encouraged to apply regardless of their background, with a commitment to preventing discrimination and harassment.
The opportunity to work with a team of highly talented engineers and advance in a dynamic environment is provided.
Employees can expect to be part of a company that is a global leader in networking solutions, contributing to significant digital transformation efforts for over 50,000 customers worldwide.