Description:

Join Zencore as a Senior Data Engineer, where you will work with fast-paced innovative companies, utilizing Databricks to drive their transformation.
Serve as a trusted advisor to clients, assisting them with ETL/ELT, Data Warehousing, Distributed Data Processing, Streaming Data systems, Data Modeling, Data Security & Governance, and BI/AI.
Develop production Spark applications and demonstrate strong skills in Python, PySpark, and Spark SQL.
Utilize Delta Lake technology and best practices for data pipeline development.
Work with Spark Structured Streaming and Databricks Delta Live Tables (DLT).
Apply advanced SQL knowledge and experience with relational databases.
Understand incremental update patterns and technologies available on Databricks.

Requirements:

5+ years of experience in a data engineering role.
2+ years of experience working with Databricks.
Preferred certification in Databricks’ Data Engineer Associate or Data Engineer Professional.
Familiarity with Databricks tech stack components like notebooks, clusters, jobs, workflows, serverless SQL, unity catalog, repos, dashboards, DLT, etc.
Proficiency in Python, PySpark, and Spark SQL.
Strong understanding of Delta Lake technology and its application in data pipeline development.
Experience with Spark Structured Streaming and Databricks Delta Live Tables (DLT).
Advanced SQL knowledge and experience with relational databases.
Understanding of incremental update patterns and technologies on Databricks.

Work with a team of professionals with extensive experience.
Share unbiased opinions and provide subject matter expertise to customers.
Connect customers to Google and expedite processes.
Remove uncertainty and risk by outlining cloud migration processes clearly.
Accelerate timelines and address challenges efficiently.
Show empathy and relate to customer complexities.
Follow core values at Zencore: Be Kind, Own the process, Enjoy the journey, Champion collaboration, Be receptive to feedback, Challenge the status quo.