Remote AI / LLM Engineer

at Penguin Formula

Posted 1 day ago 4 applied

Description:

  • WeCookiT is an international software house that provides software development services to corporate customers through outsourcing, nearshoring, and turn-key project solutions.
  • The company focuses on the professional growth and personal care of its software developers, ensuring they can deliver premium services to customers.
  • The AI Engineer role requires hands-on experience with Large Language Models (LLMs) to integrate intelligent features into software products, focusing on Java backend development.
  • Key responsibilities include integrating LLMs into Java backend systems, developing local services for offline models, designing REST/JSON endpoints, personalizing model outputs, implementing natural language understanding logic, supporting hybrid architecture, ensuring data privacy and security, and collaborating with various teams.

Requirements:

  • Candidates must have experience with LLMs such as GPT, Falcon, LLaMA, and BloomZ.
  • Experience in integrating APIs from platforms like OpenAI, HuggingFace, and Ollama is required.
  • Strong skills in Python and Java for backend development, particularly with FastAPI and Flask, are necessary.
  • Expertise in Java backend development, especially with Spring Boot, is essential.
  • Familiarity with AWS services, including API Gateway, EC2, and Lambda, is required.
  • Candidates should have experience deploying AI models in on-premises environments.
  • Familiarity with model quantization and serving tools like HuggingFace, llama.cpp, and Ollama is necessary.
  • Nice to have skills include familiarity with LangChain, vLLM, or Retrieval-Augmented Generation (RAG), experience with multilingual prompt engineering, working knowledge of Angular, experience with AI solutions in offline enterprise environments, and knowledge of privacy regulations such as GDPR.

Benefits:

  • The position offers an innovative product focused on real-world Generative AI.
  • Employees will have influence in technical decisions and solution architecture.
  • The role provides flexible, remote work with a high degree of autonomy.
  • There are growth opportunities available with modern tools and open-source models.