Description:

LMArena is seeking a Senior Machine Learning Engineer to help scale and strengthen the core infrastructure that powers real-world AI evaluation.
The role involves shaping how the company builds, deploys, and improves model benchmarking systems, working across data pipelines, inference APIs, and new evaluation methodologies.
The engineer will play a foundational role in applying technical expertise to a platform trusted by millions and help define how cutting-edge AI is assessed in real-world scenarios.
Responsibilities include architecting and building core modeling for data and evaluation products, owning the full stack data, model training, and evaluation pipelines, and fostering a culture of feedback and rapid product iteration.
The engineer will conduct research into state-of-the-art evaluation methods and contribute to the long-term vision for a centralized, scalable evaluation platform.

Requirements:

Strong programming skills with the ability to work across the stack in a typical recommendation system or LLM stack are required.
Candidates should have experience in deep learning, language models, or reward model training.
Experience working with LLM for fine-tuning, prompt engineering, and function calling is necessary.
The ideal candidate should be self-motivated with a willingness to take ownership of tasks and have a passion for shipping quality products.
A minimum of 4 years of industry experience or relevant projects is required.
A solid understanding of statistics and various tools and methodologies for evaluating uncertainty specific to the product being shipped is essential.

The position offers a salary range of $210k - $250k plus equity, with actual compensation depending on job-related knowledge, skills, experience, and candidate location.
Employees will receive a competitive salary and meaningful equity.
Comprehensive healthcare coverage, including medical, dental, and vision, is provided.
The opportunity to work on cutting-edge AI with a small, mission-driven team is available.
The company fosters a culture that values transparency, trust, and community impact.