Develop datasets to support data visualization, machine learning, and data-driven decision making for the client's product line.
Work with structured and unstructured datasets to automate data pipelines for ingestion, analysis, validation, normalization, and cleaning in a hybrid multi-cloud environment.
Create data ingestion pipelines from various sources using Data Bricks and Apache Spark.
Collaborate with analysts, solution architects, modelers, and developers to build data products and pipelines.
Provide technical and thought leadership within the team.
Requirements:
Strong T-SQL skills with experience in Snowflake.
Familiarity with CI/CD methods.
Significant experience in Python development.
Highly proficient in PySpark development.
Solid understanding of database engineering and design principles.
Possess a current Databricks Certification.
Experience in establishing business stakeholder relationships, leadership communications, and managing project delivery from design to launch.
Benefits:
Education Assistance/Student Loan Repayment - up to $2400 annually.
