Remote Sr Data Engineer

Description:

• The Senior Data Engineer will be responsible for developing and designing data engineering projects, handling large volumes of data.
• They will need at least 5+ years of experience using cloud data engineering services, preferably on AWS.
• The role requires 5+ years of experience as a Big Data architect/solution architect on Big Data platforms.
• The candidate should have 3+ years of proven experience as an architect/solution architect on the Databricks platform.
• They must have designed and implemented at least 2-3 end-to-end projects in Databricks.
• Expertise in E2E architecture of unified data platforms covering data lifecycle aspects is essential.
• The candidate should have experience in composable architecture to fully leverage Databricks capabilities.
• They should have implemented and configured Databricks environments for optimal performance and resource utilization.
• Experience in integrating data from various sources into Databricks for processing and analysis is required.
• The role involves designing and developing scalable batch and streaming data pipelines, data lake architectures, and data warehousing solutions on the Databricks platform using Spark and Delta Lake.
• Knowledge of the Databricks Lakehouse concept and its enterprise implementation is necessary.
• Strong understanding of data warehousing, governance, and security standards related to Databricks is expected.
• Proficiency in writing unit and integration tests, and setting best practices for Databricks CI/CD is required.

Requirements:

• 8+ years of experience in Data Engineering project development/design.
• At least 5+ years using cloud data engineering services, preferably on AWS.
• 5+ years as a Big Data architect/solution architect on Big Data platforms.
• 3+ years of proven experience as an architect/solution architect on the Databricks platform.
• Designed and implemented at least 2-3 end-to-end projects in Databricks.
• Expertise in E2E architecture of unified data platforms.
• Experience in composable architecture to fully leverage Databricks capabilities.
• Proficient in integrating data from various sources into Databricks for processing and analysis.
• Strong understanding of data warehousing, governance, and security standards related to Databricks.
• Proven experience as an Architect/Solution Architect on Databricks.
• Hands-on experience with AWS Databricks platform for data processing, warehousing, and analytics solutions.
• Strong background in cloud data engineering, ETL, data integration, and data governance.

Benefits:

• Opportunity to work remotely.
• Chance to work with cutting-edge technologies like Databricks.
• Competitive salary based on experience and skills.
• Potential for professional growth and development in a senior role.