Remote Lead Engineer, Reinforcement Learning & Scenario Generation

Description:

• Serve Robotics is seeking a Lead Engineer for Reinforcement Learning and Scenario Generation to enhance robotic deliveries in urban environments.
• The role involves building scalable training pipelines and generating high-fidelity synthetic scenarios for the company's sidewalk robot.
• Responsibilities include developing RL algorithms for terrain intelligence and social navigation, designing and optimizing large-scale RL training pipelines, and implementing curriculum learning and multi-agent RL strategies.
• The engineer will also create automated tools for experiment orchestration, develop procedural generation pipelines, and collaborate with various teams to translate real-world failures into synthetic simulation cases.
• The position requires working with 3D assets and traffic models, debugging simulation performance, and documenting tools and workflows for internal users.

Requirements:

• A Master’s degree in Robotics, AI, Computer Science, Mathematics, or a related field is required.
• Candidates must have 7+ years of professional experience with transformer-based AI models in complex navigation or manipulation tasks within AV or robotics solutions.
• A minimum of 3 years of technical leadership or architecture experience is necessary.
• Strong experience with Reinforcement Learning techniques such as PPO, SAC, A3C, DQN, or multi-agent RL is essential.
• Hands-on experience with distributed training frameworks like Ray RLlib, Accelerate, or Kubernetes is required.
• Proficiency in Python and C++ for performance-critical simulation or graphics pipelines is needed.
• Experience in building or modifying simulation environments such as Isaac Sim, Unity, or CARLA is necessary.
• Knowledge of procedural generation techniques and experience with GPU compute, containers, and cloud infrastructure is required.

Benefits:

• The base salary range for this position is $190k - $230k USD for candidates in the U.S. and $160k - $190k CAD for candidates in Canada.
• The company offers the opportunity to work remotely across the United States.
• Employees will be part of a diverse and agile team focused on solving real-world problems through innovative technology.