Remote Staff MLSys Engineer - Kernel Optimization

Description:

• OctoAI, a leading startup in generative AI, is seeking a Staff MLSys Engineer specializing in Kernel Optimization for remote work.
• The company's platform, OctoAI, provides generative AI infrastructure for developers to run, tune, and scale models efficiently.
• The role involves developing and optimizing high-performance computing kernels with a focus on GPU acceleration.
• Responsibilities include implementing programming solutions in C/C++ and Python, deep diving into GPU performance optimizations, and collaborating on machine learning compilers or frameworks.
• The ideal candidate will have a degree in Computer Science or related fields, strong programming skills, and experience in GPU performance optimizations.

Requirements:

• Bachelor's, Master’s, or PhD’s degree in Computer Science, Electrical Engineering, or a related field.
• Strong programming skills in C/C++ and Python.
• Deep understanding and experience in GPU performance optimizations.
• Extensive experience with kernel optimizations on CUDA or other accelerators.
• Experience contributing to innovative OSS/closed source projects like Cutlass, FlashAttention, FlashInfer, mlc-llm, vllm.
• (Preferred) Experience with machine learning compilers or frameworks such as TVM, MLIR, Pytorch, Tensorflow, ONNX Runtime, TensorRT.

Benefits:

• Comprehensive Healthcare coverage for employees and dependents, including Medical, Dental, Vision, Life Insurance, and Disability Insurance.
• Competitive Compensation with a mix of salary, bonuses, and stock options.
• Financial Benefits like Flexible Spending Accounts, Health Savings Account, and 401(k) options.
• Flexible Work Options including remote and teleworking capabilities.
• Work-Life Balance with flexible hours, generous time off policies, company-sanctioned downtime, and paid holidays.
• Parental Benefits with comprehensive leave plans for new parents.
• Volunteer Time Off (VTO) for community service.
• Additional Leaves including disability, paid family medical leave, and paid military leave.