Description:

Lead Data Engineer role focusing on Solution Architecture, Databricks, AI, Full Stack Development, and DevOps.
Responsibilities include designing data pipelines, configuring Azure resources, and preparing technical documentation.

Requirements:

Proficiency in PySpark, PySQL, and Databricks, including Unity Catalog and Service Principals.
Experience with FastAPI, React, prompt engineering, and AI safety mechanisms.
Strong understanding of full stack development and CI/CD pipeline automation.
Excellent communication skills for collaboration with project stakeholders.

Skills