Description:

Design and deliver a centralized Incident Management Platform (Vantage) connecting backend systems, operational tools, and cloud data platforms.
Bridge alerting tools, Jira, and AI agents into Databricks lakehouse for reliable data products.

Requirements:

5+ years in Data Engineering or Backend Integration Engineering with a proven track record in production-grade data pipelines.
Mastery of Databricks, Delta Lake, and PySpark/Spark SQL in production environments.
Experience building and maintaining production REST APIs and webhooks in Python (FastAPI, Flask).
Hands-on experience with AWS services, primarily S3 and IAM.
Practical experience integrating LLMs/AI agents into workflows with human-in-the-loop validation.
Strong background in Git, CI/CD automation, and automated testing.
Advanced professional English proficiency for collaboration with global teams.

Skills