RemoteYeah

Remote Senior Staff Software Engineer - AI/ML Inference Engineering

at ServiceNow

Posted 3 hours ago

Share:

Please let ServiceNow know you found this job on RemoteYeah. This helps us get more companies to post jobs here for you.

Description:

  • Lead the architecture, optimization, and operational excellence of the AI inference platform.
  • Own the end-to-end inference lifecycle, deploying optimized inference engines in production across multiple backends on Kubernetes.
  • Architect the intelligent gateway layer using Envoy and ext_proc for access control and observability.

Requirements:

  • 8+ years of backend software engineering experience.
  • 4+ years of designing and operating distributed systems.
  • Expertise in Go or Python, OOP, Design Patterns, and efficient algorithms.
  • Experience with model-serving and runtime systems like vLLM, TensorRT-LLM, Triton Inference Server.
  • Bachelor’s degree in computer science or related field; a master’s may offset experience.

Benefits:

  • Base pay range of $201,300 - $352,300, plus equity and variable compensation.
  • Health plans, 401(k) with company match, ESPP, flexible time away plan, and family leave programs.

Job title

Artificial Intelligence Engineer

Job type

Full-time

Experience level

Staff Senior

Required experience

8 years

Salary

$201,300—$352,300 / year

Degree requirement

Degree required

Skills

Kubernetes GitHub CI/CD Machine Learning Web security Large Language Models Helm Charts Python Go

Location requirements

🌍 North America Canada United States

Benefits

Health insurance Family leave Flexible Spending Account 401(k)

Report this job

Job expired or something else is wrong with this job?

Report job

Related jobs

Search More Artificial Intelligence Engineer Jobs
SerpApi

SerpApi

Scrape Google and other search engines from our fast, easy, and complete API.

RemoteYeah Ads