Remote ML Lead, AI Data Labeling

Description:

• Lead the design and development of domain benchmarks for AI evaluation across various industries (finance, legal, healthcare).
• Serve as the primary technical contact for ML and product teams at AI-focused clients, translating technical requirements into operational specs.
• Collaborate with recruiting and operations to build expert pipelines for data production and ensure quality control.
• Identify and address technical gaps during client interactions to drive account expansion.

Requirements:

• 5 to 8 years of applied ML experience with a focus on evaluation and benchmark work.
• Proficiency in modern LLM evaluation techniques and statistical analysis.
• Strong programming skills in Python and familiarity with model APIs.
• Excellent client-facing communication skills and the ability to present technical concepts to diverse audiences.
• Light commercial instinct to identify and propose solutions to client problems.

Benefits:

• Opportunity to build a new business unit and influence at a fast-growing startup.
• Fast-track career growth towards leadership roles within the company.
• Comprehensive medical, dental, and vision insurance.
• 401k match with immediate vesting and additional perks like health savings accounts.
• Paid time off including vacation, holidays, and parental leave.