Remote Software Engineer

Description:

• Design and ship features end to end: data model, API, background workers, and UI.
• Build and improve evaluation processes for agents and models, ensuring reliability and trust in results.
• Enhance quality-checking methods for benchmark tasks and integrate new models and benchmarks efficiently.
• Maintain system performance and reliability as usage scales, including efficient queries and safe migrations.
• Review code and maintain consistency in the codebase.

Requirements:

• 5+ years of experience in building and operating production backend systems.
• Bachelor's degree in Software Engineering, Computer Science, or related field.
• Proficient in Python, experience with Django, PostgreSQL, and task queues like Celery.
• Hands-on experience in LLM evaluation and understanding of benchmark task construction.
• Strong judgment on task quality and ability to identify ambiguous instructions.
• Good tradeoff skills in design and ownership of projects from request to deployment.
• Familiarity with TypeScript and React for frontend changes.
• Clear writing skills for documentation and pull request descriptions.

Benefits:

• Work at the forefront of AI, contributing to advanced models and benchmarks.
• Opportunity to showcase work at top AI conferences.
• Apply AI innovations to solve real-world business challenges.
• Collaborate with experienced colleagues from leading tech companies.
• Enjoy the speed and impact of a startup environment.