Description:

Zapier is seeking an AI Engineer to join the Editor:AI Team to enhance automation accessibility for everyone.
The role involves designing, developing, and maintaining AI-powered systems to improve user experience.
Responsibilities include integrating AI models into existing software, troubleshooting, and ensuring smooth operation of these systems.
Effective communication is essential for collaboration with engineers and explaining AI concepts to non-technical stakeholders.
The position requires a blend of classical ML research and backend engineering skills, particularly with large language models (LLMs).
The AI Engineer will work on data-driven feedback loops, integrating LLMs into software products, and exploring new LLM systems for improvements.
The role includes designing prompting strategies for LLMs, developing evaluation suites for model performance, and monitoring AI system health.

Requirements:

Candidates must have 5+ years of software engineering experience, with at least 3 years focused on building distributed, scalable cloud-based web applications.
Familiarity with technologies like transformer networks and attention mechanisms is required.
At least 1 year of experience working with LLMs in production environments is necessary, including advanced prompt techniques and fine-tuning LLMs.
Experience deploying evaluation frameworks for LLMs, focusing on performance, reliability, and bias assessment is essential.
Knowledge of Retrieval-Augmented Generation (RAG) systems and optimization strategies for knowledge retrieval is preferred.
Candidates should have experience with the full lifecycle of building, testing, deploying, and scaling LLM architectures.
The ability to identify and document trade-offs during development and experience with cloud infrastructure technologies is required.
A passion for delivering customer-focused solutions and embodying Zapier's values is essential.

Zapier promotes a diverse and inclusive work environment, welcoming applications from individuals of all identities.
The company offers a non-standard application process to enhance inclusion and equity.
Zapier is committed to providing reasonable accommodations for individuals with disabilities during the application and interview process.
Employees can expect timely communication regarding their application status throughout the hiring process.
The company values work-life balance and offers a fully remote work environment.