Remote ML Ops Engineer

Description:

• Entangle is reshaping the blockchain landscape with advanced interoperability and data connectivity solutions.
• The company is creating a seamless framework for DApps to interact across various networks, addressing barriers between fragmented ecosystems.
• The Photon Messaging Protocol, universal data feeds, and customizable agent network provide high-performance, scalable infrastructure for developers in the DeFi space and beyond.
• The company is seeking an experienced ML Ops engineer with experience in AI projects to join their team.
• Key responsibilities include:
  • Model Deployment: Dockerizing and deploying multi-agent LLM instances, ensuring compatibility with LangGraph pipelines, optimizing model serving for low-latency, high-throughput applications, and implementing scalable model deployment strategies for concurrent multi-agent tasks.
  • Monitoring and Logging: Establishing end-to-end monitoring for the AI platform, tracking system health, latency, and failure rates, monitoring LLM-specific metrics, and developing drift detection mechanisms for model inputs and outputs.
  • Pipeline Automation: Automating training, evaluation, and deployment workflows for LangGraph-enabled pipelines, building and maintaining CI/CD pipelines, and automating versioning and rollback mechanisms for LLMs.
  • Infrastructure Management: Collaborating with DevOps teams to scale Kubernetes clusters, optimizing resource allocation for shared GPU/TPU inference loads, and implementing caching strategies for high-reuse LLM queries.
  • Collaboration and Documentation: Documenting multi-agent system workflows, collaborating with backend engineers and QA teams, and providing guidelines for extending LangGraph tools and chains.

Requirements:

• Experience deploying and optimizing LLMs in production, such as OpenAI and HuggingFace models.
• Proficiency with containerization (Docker) and orchestration (Kubernetes, Helm).
• Familiarity with LangChain, Web3 tools, or multi-agent systems is a strong plus.
• Strong understanding of CI/CD tools, such as GitHub Actions and Jenkins.
• Excellent communication skills and the ability to document complex systems clearly.

Benefits:

• The position offers an exciting opportunity in a growing international start-up with ambitious goals in a revolutionary, multi-billion dollar industry.
• Compensation is provided in USDT.
• The work environment is Scrum/agile, fostering collaboration and innovation.
• Employees will be part of a highly skilled engineering team.
• Attractive compensation includes token allocations.
• The position allows for remote work in a timezone that corresponds well with UAE time.
• Paid vacation and public holidays are included as part of the benefits.