Description:

Seeking a Senior Data QA Automation Engineer to lead quality strategy and automated testing frameworks for big data platforms.
Responsible for end-to-end data validation strategy within Databricks Lakehouse architecture, ensuring high-quality and compliant data.

Requirements:

Bachelor’s or Master’s degree in Computer Science, Data Engineering, or related field.
8+ years of experience in data engineering, data QA, or SDET, with 2+ years in test automation in Databricks.
Mastery of Python and PySpark for processing large datasets.
Deep expertise in advanced SQL queries and Spark query execution plans.
Hands-on experience with big-data validation libraries (e.g., Great Expectations, pytest).
Strong knowledge of Databricks deployment on major cloud providers (AWS, Azure, GCP).

Skills