Remote Member of Technical Staff, Data Analysis and Evaluation

Description:

• Play a pivotal role in ensuring the quality, reliability, and performance of large language models (LLMs).
• Design and conduct data collection tasks, assess dataset quality, and analyze model robustness.
• Collaborate with cross-functional teams to improve AI systems' effectiveness.

Requirements:

• Extremely strong software engineering skills.
• Expertise in data collection tasks and working with human annotators.
• Strong statistical skills and experience in evaluating scientific experiments.
• Experience analyzing datasets for quality and biases.
• Hands-on experience training LLMs on distributed infrastructures.
• Familiarity with evaluating ML systems' generalisability and robustness.
• Proficiency in Python and ML frameworks (e.g., PyTorch, TensorFlow).
• Excellent communication skills for collaboration and presentation.
• One or more papers at top-tier venues (e.g., NeurIPS, ICML).

Benefits:

• Open and inclusive culture and work environment.
• Work with a cutting-edge AI research team.
• Weekly lunch stipend, in-office lunches & snacks.
• Full health and dental benefits, including mental health budget.
• 100% Parental Leave top-up for up to 6 months.
• Personal enrichment benefits for arts, fitness, and workspace improvement.
• Remote-flexible work with offices in major cities and co-working stipend.
• 6 weeks of vacation (30 working days!).