Remote Lead Data Engineer

Description:

• A Lead Data Engineer will play a crucial role in turning vast amounts of complex data into valuable insights that will drive business decisions and innovation.
• You will work closely with cross-functional teams, including engineers, analysts, and business stakeholders, to identify opportunities, design experiments, build predictive models, feature engineering, and develop data-driven solutions.
• The ideal candidate should have a strong background in statistics, machine learning, programming, and data analysis, along with excellent communication and problem-solving skills.
• A background in financial systems is a plus, as is development experience in an iterative, Agile/SCRUM environment.
• Responsibilities include analyzing large, complex datasets to identify patterns, trends, and insights that can enhance business strategies and decision-making processes.
• You will design and implement statistical models, machine learning algorithms, feature engineering, and data mining techniques to develop predictive models and extract actionable insights from data.
• As a lead data engineer, you will implement large, complex enterprise data solutions from the ground up to drive innovation.
• You will recommend new technologies, tools, and standards to improve efficiency and productivity.
• Research, POC, test, and implement new technologies to support the application and data solutions architecture.
• The core skill set will be centered around data science, data engineering, machine learning, AI modeling: Python, SQL, Spark, Snowflake, JavaScript, visualizations, and cloud computing.
• You will review and audit design solutions and mentor software engineers.
• Other duties may be assigned as needed.

Requirements:

• Excellent communication and teamwork skills are essential.
• A minimum of 7 years of hands-on experience in Python or R is required.
• At least 7 years of experience in SQL, Spark, Airflow, data modeling, and ETL/Data pipeline is necessary.
• A minimum of 3 years of hands-on experience in data visualization using tools like Tableau or Power BI is required.
• At least 3 years of experience in machine learning and feature engineering is necessary.
• Solid hands-on cloud computing experience (AWS, Microsoft Azure, GCP) is required.
• Experience using event and data streaming tools such as Apache Kafka, Kinesis, or any related technology is essential.
• Strong troubleshooting and debugging skills are critical.
• Experience in designing and building data APIs is required.
• Familiarity with frontend technologies such as HTML5/CSS and JavaScript is a plus.
• Solid experience in Agile/SCRUM development methodologies and best practices is necessary.

Benefits:

• Cast & Crew provides a comprehensive package of employee benefits including Medical, Dental, Vision, and PTO.
• Health and wellness programs are available to employees.
• Employee discounts and additional benefits are offered.
• Note that Cast & Crew benefits are subject to eligibility requirements.